Commit Graph

430 Commits

Author SHA1 Message Date
Haris Muneer ⚡️ 633647118b
Update README.md 2020-12-01 21:52:00 +05:00
Haris Muneer ⚡️ 61fd560537
Update README.md 2020-12-01 21:51:38 +05:00
Haris Muneer ⚡️ 4bd1cbf6e9
Update README.md 2020-12-01 21:50:21 +05:00
Haris Muneer ⚡️ 52dda65bf7
Create FUNDING.yml 2020-12-01 20:27:04 +05:00
Haris Muneer ⚡️ 917c363190
Support UFS 2.0 2020-12-01 19:54:53 +05:00
Haris Muneer ⚡️ f65f6494fd
Update README.md 2020-12-01 19:46:05 +05:00
Haris Muneer ⚡️ 5f8273cea1
Merge pull request #189 from elig0n/patch-1
erroneous filename in error message
2020-12-01 03:08:39 +05:00
sickcodes 8834a7f9f7
Merge pull request #1 from elig0n/patch-2
--chromium not to require args
2020-11-29 13:04:10 +00:00
Eliran Gonen 0d1b5e91d5
--headless not to require args
make the required True argument redundant
2020-11-29 06:55:28 +02:00
Eliran Gonen adc7a005b7
--chromium not to require args
I've modified the --chromium argument to be enough in itself to provide 'True' with no need to add CLI argument to it.
2020-11-29 06:45:48 +02:00
Eliran Gonen f8eb40aa9c
erroneous filename in error message
should be credentials.yaml and not credentials.txt
2020-11-29 06:32:00 +02:00
lesander a683e1ee24
fix linter
unrelated to this MR but should fix the linter
2020-11-11 13:59:21 +01:00
lesander aa8b701490
fix linter 2020-11-11 13:55:54 +01:00
lesander 492561ba87
append input check 2020-11-11 13:44:52 +01:00
lesander 280969e9c8
Detect cookiebanner, fix facebook group urls and handle driver.close exception 2020-11-11 13:42:39 +01:00
sickcodes 7b136e9796 Add --chromium & --headless optional flags 2020-10-04 11:41:43 +00:00
Haris Muneer ⚡️ 4f54d8473d
Merge pull request #170 from Hassaan-Elahi/patch-1
Update README.md
2020-09-25 14:59:49 +05:00
Hassaan Elahi 00c168bea9
Update README.md 2020-09-25 11:19:51 +05:00
Haris Muneer ⚡️ 7c7832fdee
Update README.md 2020-09-19 17:38:14 +05:00
Haris Muneer ⚡️ 97afc82585
Update README.md 2020-09-14 05:03:54 +05:00
Haris Muneer ⚡️ 41aa6fa449
Update README.md 2020-07-21 03:50:11 +05:00
Haris Muneer ⚡️ d3eabce9b0
Merge pull request #149 from DeDe43ISR/fix_post_content
fix #91 - fixed posts.txt contains no text
2020-07-21 03:45:13 +05:00
DeDe Ubuntu Lap 678b592e86 fix #91 update status selectors id
Signed-off-by: DeDe Ubuntu Lap <yarden984321@gmail.com>
2020-07-19 20:10:40 +03:00
Haris Muneer ⚡️ f6aee6db36
Update .gitignore 2020-07-14 18:16:12 +05:00
Haris Muneer ⚡️ 01d07e1fa6
Update setup.py 2020-05-22 12:56:26 +05:00
Haris Muneer ⚡️ dd6b3e47fe
Update README.md 2020-05-22 12:55:53 +05:00
Haris Muneer ⚡️ 38d3b35c30
Update README.md 2020-05-22 12:51:57 +05:00
Haris Muneer ⚡️ d7c8eb6810
Update README.md 2020-05-22 12:37:31 +05:00
Haris Muneer ⚡️ 48483a4019
Update .gitignore 2020-04-18 00:38:10 +05:00
Haris Muneer ⚡️ dc18b20a47
Delete ufs_icon.png 2020-04-17 21:00:32 +05:00
Haris Muneer ⚡️ 58769c413d
Delete screenshot.png 2020-04-17 21:00:22 +05:00
Haris Muneer ⚡️ bf616112dc
Delete main.png 2020-04-17 21:00:11 +05:00
Haris Muneer ⚡️ a5b8c10246
Update README.md 2020-04-17 20:59:32 +05:00
Haris Muneer ⚡️ dd4a0541d3
Merge pull request #104 from aayaffe/feature/page_scraper
Scraping group posts
2020-04-17 20:55:21 +05:00
Amit Yaffe d5861f643f Added the new features to readme.md.
Fixed a few mistakes in output file headers, and removed redundant if.
2020-04-16 19:08:40 +03:00
Amit Y d654c55344 Added gitgnore entries used during dev.
Added the option to set comments in input.txt file
Added options to scrape group posts and single group post (automatically identify the link)
2020-04-14 17:06:05 +03:00
Amit Y 67f2be02f6 Added support for more languages (UTF-8) 2020-04-14 16:14:33 +03:00
Haris Muneer ⚡️ d9dc89ef3a
Merge pull request #102 from aayaffe/v2.0
Added support for automatic chromedriver management. Removed chrome d…
2020-04-11 18:26:45 +05:00
Haris Muneer ⚡️ 3cb987c25b
Update .gitignore 2020-04-11 18:26:06 +05:00
Amit Yaffe 991f036d10 Formatted with black 2020-04-11 16:13:05 +03:00
Amit Yaffe c23669c65f Ignore data files and scraped data under Scraper directory 2020-04-11 10:58:06 +03:00
Amit Yaffe a0f9c17c65 Added support for automatic chromedriver management. Removed chrome driver binaries 2020-04-06 11:01:59 +03:00
Haris Muneer ⚡️ 4ed08fe3d2
Merge pull request #96 from elyesmanai/enhancements
refactoring
2020-03-28 21:32:49 +05:00
Elyes Manai bc3cc0db82 updated readme for real this time 2020-03-28 17:29:29 +01:00
Elyes Manai 43d626514e parameters collection for scrapping automated & tested \ command line arguments added & tested \ some enhancements to 2 functions \ utils.py addded, code refactored & tested \ updated readme 2020-03-28 17:24:26 +01:00
Haris Muneer ⚡️ e64ed73afb
Merge pull request #90 from FrostFlame/89-refactoring
89-refactoring (xpaths and selectors are now in selectors.json)
2020-03-18 15:15:04 +05:00
Haris Muneer ⚡️ 98b3f23bb3
Update README.md 2020-03-08 19:16:15 +05:00
Haris Muneer ⚡️ 160d8c21f9
Update README.md 2020-03-08 19:14:35 +05:00
Haris Muneer ⚡️ e3153ac8f0
Update README.md 2020-03-08 19:07:25 +05:00
Haris Muneer ⚡️ b3f1ed4172
Update README.md 2020-03-08 19:02:46 +05:00