Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Contribute to GitLab
Sign in / Register
Toggle navigation
E
esi-table-data
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
esi-data-scrapping
esi-table-data
Commits
7ed0a294
Commit
7ed0a294
authored
Jul 06, 2017
by
Vasyl Bodnaruk
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Change select from DB
parent
6112944d
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
3 additions
and
5 deletions
+3
-5
aitop.py
exa/exa/spiders/aitop.py
+1
-1
mobihealthnews.py
exa/exa/spiders/mobihealthnews.py
+1
-2
techcrunch.py
exa/exa/spiders/techcrunch.py
+1
-2
No files found.
exa/exa/spiders/aitop.py
View file @
7ed0a294
...
...
@@ -39,7 +39,7 @@ class AitopSpider(scrapy.Spider):
return
False
for
i
in
self
.
build_items
(
response
):
#
if is_company_in_item(i):
if
is_company_in_item
(
i
):
print
(
i
)
next_url
=
self
.
next_url
(
response
)
# if next_url:
...
...
exa/exa/spiders/mobihealthnews.py
View file @
7ed0a294
...
...
@@ -22,11 +22,10 @@ class MobiHealthNewsSpider(scrapy.Spider):
print
(
self
.
condition
)
self
.
query
+=
' or {}'
.
format
(
self
.
condition
)
print
(
self
.
query
)
self
.
comp
=
db
.
select
(
self
.
query
)
super
(
MobiHealthNewsSpider
,
self
)
.
__init__
()
def
start_requests
(
self
):
companies
=
CompanyMaker
(
self
.
comp
)
companies
=
CompanyMaker
(
db
.
select
(
self
.
query
)
)
companies
.
make_companies
(
self
.
name
)
for
i
in
companies
.
get_companies
():
try
:
...
...
exa/exa/spiders/techcrunch.py
View file @
7ed0a294
...
...
@@ -20,11 +20,10 @@ class TechcrunchSpider(scrapy.Spider):
if
self
.
condition
:
print
(
self
.
condition
)
self
.
query
+=
' or {}'
.
format
(
self
.
condition
)
self
.
comp
=
db
.
select
(
self
.
query
)
super
(
TechcrunchSpider
,
self
)
.
__init__
()
def
start_requests
(
self
):
companies
=
CompanyMaker
(
self
.
comp
)
companies
=
CompanyMaker
(
db
.
select
(
self
.
query
)
)
companies
.
make_companies
(
self
.
name
)
for
i
in
companies
.
get_companies
():
try
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment