Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Contribute to GitLab
Sign in / Register
Toggle navigation
E
esi-table-data
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
esi-data-scrapping
esi-table-data
Commits
c15d2db9
Commit
c15d2db9
authored
Aug 16, 2017
by
Vasyl Bodnaruk
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Add tags use newspaper
parent
59a024da
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
1 deletion
+2
-1
pipelines.py
exa/exa/pipelines.py
+2
-1
No files found.
exa/exa/pipelines.py
View file @
c15d2db9
...
...
@@ -49,9 +49,10 @@ class ExaPipeline(object):
article
=
self
.
get_article
(
item
[
'url'
])
text
=
article
.
text
tags
=
self
.
get_tags
(
text
)
news
=
self
.
insert_news
(
item
,
tags
,
text
)
if
spider
.
name
==
'cb'
:
item
[
'tags'
]
=
article
.
tags
news
=
self
.
insert_news
(
item
,
tags
,
text
)
self
.
update_ml_data
(
news
,
item
[
'tags'
])
return
item
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment