Repository navigation

All pull requests

fix: handle punkt_tab fallback in split_sentences for NLTK >= 3.9
#1023danishashko opened Apr 1, 2026
Included Gujarati stopwords and saved them in stopwords-gu.txt
#1018Oam11 opened Aug 28, 2025
Fix homepage url restriction
#1013ljluestc opened Jun 22, 2025
Also require lxml-html-clean>=0.4.2.
#1012yilei opened Jun 21, 2025
Update download_corpora.py - add 'punkt_tab'
#1006Ronkiro opened Sep 20, 2024
Allow newspaper work on news websites like carbon-pulse
#975Cabu opened Oct 3, 2023
fix(sec): upgrade nltk to 3.6.6
#957chncaption opened Nov 15, 2022
fix(sec): upgrade requests to 2.20
#956chncaption opened Nov 15, 2022
fix itemprop containing articleBody
#953AndyTheFactory opened Oct 4, 2022
bengali support added
#951ffaisal93 opened Sep 23, 2022
Added ability to scrape javascript intensive apps
#941Sosshi opened Jun 12, 2022
1
Close opened category cache files when done
#938WillGITCode opened Apr 9, 2022
Change general exceptions in Configuration
#934nnick14 opened Feb 14, 2022
Remove non-working demo
#909robincunningham2 opened Sep 15, 2021
set daemon attribute directly instead of calling setDaemon function to clear deprecation warning in python3.10
#897Narendra-Neerukonda opened Jun 19, 2021
fix cleaning the wrong top node
#896idoshamun opened Jun 17, 2021
Add parallellization and caching to image download
#882dhgelling opened Apr 30, 2021
Added Marathi Language Extension
#875tanmay-punekar opened Mar 6, 2021
Fix concatenating sentence parts separated with newlines
#873dhgelling opened Feb 12, 2021
Skip unparsable urls
#872frankier opened Feb 11, 2021
Add Latvian language support
#867kaspars-gailitis opened Jan 3, 20214 tasks done
Adding Bengali Language Support
#866lookatmeimdanny opened Dec 24, 2020
Add article to node search tags
#8658W9aG opened Dec 17, 2020
Extract clean_top_node from clean_doc. Add unit tests to ensure clean…
#863monstrfolk opened Dec 13, 2020
Update in PUBLISH_DATE_TAGS for date extraction
#861yoonoh930 opened Dec 7, 2020

Pull requests