evanferrao
/
dump-mirrorbot
mirror of https://github.com/Box-boi/dump-mirrorbot.git
1
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity
236 Commits 2 Branches 21 Tags 2 MiB
Commit Graph

193 Commits

Author SHA1 Message Date
Shivam Jha 687321ac72
Set logging level to debug 2020-01-16 10:46:50 -08:00
Aki 351d4030a8 fs_utils.py: Use python-magic for guessing mimetype (#31) 
1. mimetypes is not a reliable way to know the mime type of a file.

2. python-magic uses libmagic which identifies file types by checking their headers according to a predefined list of file types.

	https://github.com/ahupp/python-magic
 2020-01-16 09:06:55 -08:00
Shivam Jha 00a8e57467
Fixed error in gdrivetools 2020-01-10 17:36:51 +05:30
jaskaranSM 5598159626
Refactor parse logic 2020-01-04 07:46:23 +05:30
lzzy12 326129fdeb Make Oauth Scope a list as it should be 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-01-04 07:42:55 +05:30
lzzy12 e5f997d1f3 Revert "Fixed potential race conditions in GoogleDriveHelper class" 
This reverts commit 20dae25dc9.

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-01-03 10:41:54 +05:30
jaskaranSM 7b2d5d50ab Implement Exponential Backoff 
- for handling Google Drive API errors such as 5xx,4xx
 2020-01-03 10:15:40 +05:30
jaskaranSM 1543da735c Fixed bugs in MirrorListener 2020-01-02 13:41:39 +05:30
jaskaranSM b84ffcc416 prevent cleaning of uploading/archiving downloads 2020-01-02 10:25:45 +05:30
jaskaranSM 22d5797942 Fixed variable assignment 2019-12-29 20:20:16 +05:30
jaskaranSM a64b1b5346 Fixed stucked downloads when stopped via aria bt-stop-timeout 2019-12-29 19:50:01 +05:30
jaskaranSM 30dd2d97f5 Minor Refactor 2019-12-29 19:14:52 +05:30
jaskaranSM 38fa1ec2a6 Fixed Handling of Cancellation of uploads/archivals 2019-12-29 19:13:10 +05:30
jaskaranSM 7c4779cfc6
Added Authorization for Drive List Command. 2019-12-29 18:07:12 +05:30
lzzy12 20dae25dc9 Fixed potential race conditions in GoogleDriveHelper class 
* Also simplified code a bit
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-26 16:39:59 +05:30
lzzy12 820d72f317 Fixed files not being shown which were not uploaded by bot 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-26 14:47:05 +05:30
lzzy12 4fc07cd7a9 Fix typo in speed indicator 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 19:17:35 +05:30
lzzy12 4dd1aa4977 Handle empty strings in config variables 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 18:20:56 +05:30
lzzy12 4e1f7a8a77 Small optimisations all around 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 16:40:43 +05:30
lzzy12 8e886a3030 Add Index URL in /list cmd 
Also simplified code a bit

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 15:53:43 +05:30
lzzy12 53b6829235 Fixed Team Drive list functionality 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 15:15:36 +05:30
lzzy12 ac24ff0371 Optimise adding index url to messsage 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 14:53:58 +05:30
Shubham dubey eb388c7cea Fix Index trailing issue on directories 2019-12-25 14:53:58 +05:30
jaskaranSM e69625c406 Fix git conflict 2019-12-24 21:16:46 +05:30
jaskaranSM 8a516024cb Fixed Folder upload to Team Drives 2019-12-24 21:11:33 +05:30
lzzy12 b31a39f11a Enable TeamDrive support 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 20:12:39 +05:30
lzzy12 0ed1ca3531 Enable TeamDrive support 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 19:49:48 +05:30
lzzy12 6dfb3e9863 Simplify get_readable_msg code 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 17:35:09 +05:30
lzzy12 82ae49a33a Re implement upload progress after rebase 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 17:24:35 +05:30
jaskaranSM 19b6f91d5d Dont edit the message if content is same 2019-12-23 18:51:35 +05:30
Shivam Jha c4964ad9d0
Fix hardcoded value of status Update interval 2019-12-23 17:36:35 +05:30
lzzy12 01ed02e57c Fix mimetype error 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-23 16:29:20 +05:30
lzzy12 e2e1453013 Fixup errors after rebase 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-23 16:17:57 +05:30
lzzy12 b4cd971930 Read setup variables from environment variables 
Also Adds support for heroku env variables

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-23 15:46:56 +05:30
jaskaranSM 0d30f19a4e Project Rebase 
- Changelog:
 Improved Performance
 Fixed Stucked Messages
 Seperated Download Progress Status From Listener
 Disabled Upload Progress (Temporarily)
 2019-12-23 13:26:32 +05:30
lzzy12 4f9fa3f63f Fix typo 
Also Adds support for heroku env variables

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-09 17:05:57 +05:30
lzzy12 6c66a2ad8a Read setup variables from environment variables 
Also Adds support for heroku env variables

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-09 15:34:12 +05:30
lzzy12 db0dcb0d8b [DO NOT DEPLOY] Incomplete save 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-11-12 17:32:58 +05:30
jaskaranSM 584bd138df Refactored Download start logic 2019-11-12 15:01:08 +05:30
Shivam Jha df82d5944e
Fix progress update in torrent download 2019-11-10 01:24:13 +05:30
lzzy12 da622c04be Don't depend on bot to run for generate_gdrive_token.py 2019-11-07 14:48:35 +05:30
jaskaranSM ac39b7e682
Added Missing Statement 2019-11-01 21:29:23 +05:30
jaskaranSM 3a3eca2411 Refactored disk to stats and added bot uptime 
- Also helps tracking auto reboots on Heroku.
 2019-11-01 21:18:46 +05:30
jaskaranSM 8be32c6e5c Fixed Broken Mimetype Detection 2019-11-01 20:26:36 +05:30
Shivam Jha 7b5375fd21
Fix up after f7960a7dfe 2019-11-01 19:00:35 +05:30
lzzy12 826ab1d6f5 Update README.md 2019-11-01 17:46:10 +05:30
lzzy12 bf956b3fa6 Merge branch 'master' of https://github.com/lzzy12/python-aria-mirror-bot 2019-11-01 16:54:04 +05:30
lzzy12 f7960a7dfe Fix empty file progress 
Fixes #8

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-11-01 16:33:54 +05:30
jaskaranSM b9084fe506
list: Dont try to get size for folders 2019-10-31 22:23:40 +05:30
Shivam Jha c754d228e4
gdriveTools: Fix error in search 2019-10-31 00:04:43 +05:30
Shivam Jha 830ee1ad3e
gdriveTools: Fix search 
Recent force push seems to cause loss of commits. 
* Lesson learnt: NEVER FORCE PUSH IN MASTER BRANCH
 2019-10-31 00:02:55 +05:30
jaskaranSM a0d8947d6b
list: fix bug 2019-10-30 21:04:32 +05:30
Shivam Jha 8e65b6280d
Only Allow owner to cancell all downloads 2019-10-30 17:28:59 +05:30
jaskaranSM 03952750e2 Fix tagging users without username (#7) 2019-10-28 11:59:40 +05:30
Arsalan c403eab909 fixed the wrong comment (#6) 2019-10-28 10:52:22 +05:30
lzzy12 fd1c49d93f Fix indentation error 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-27 19:02:36 +05:30
jaskaranSM deb4b43fdd Validate Url and Magnet with Regex 2019-10-27 17:29:02 +05:30
jaskaranSM 3bac006fb3 Output file size in list search results 
- Also Listing Recent Uploads Fixed. ( * )
 2019-10-22 19:47:50 +05:30
jaskaranSM fdb49ac62a Fixed Cancelled Downloads stuck in Download Queue. 
- Also some minor Modifications.
 2019-10-22 18:20:47 +05:30
jaskaranSM 6ed78411fc
message_utils: Handle TimeOuts. 2019-10-20 18:53:18 +05:30
jaskaranSM b7e65d9c9c Changed sleep() call for Fixing Delay. 
- Also Tweaked Torrent Metadata Status Logic a bit.
 2019-10-19 16:44:26 +05:30
Shivam Jha fa664e6663
Check if log.txt exists before trying to open 
This fixes #3
 2019-10-17 21:45:03 +05:30
lzzy12 35f99c849f Handle an crash when user deletes the bot message manually 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-15 21:41:04 +05:30
lzzy12 9f26ed107c Allow owner to unauthorize a user or a chat 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-14 21:53:31 +05:30
lzzy12 d38bc90e82 Don't do anything on KillThreadException until we figure a better way 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-14 20:51:34 +05:30
lzzy12 6ce2507c36 Implement /log command for easier debugging 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-14 20:50:35 +05:30
lzzy12 a0cdda9e6e Improve gdrive progress tracking 
* Still bugged

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-14 19:49:33 +05:30
lzzy12 7228461ab9 Cast time formats to int 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-13 21:14:47 +05:30
lzzy12 c9ede8bf16 Fix torrent download from telegram 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 23:40:04 +05:30
Shubham dubey cc90560657
This triggers my OCD 2019-10-12 17:39:04 +05:30
lzzy12 17a08973e1 Handle some more crashes related download cleanup 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 22:54:30 +05:30
lzzy12 7b485d13b0 Fix crashes related to cancel mirror 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 22:45:30 +05:30
lzzy12 c1e4bf246c Simply sleep the upload progress thread instead of using event locks 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 22:14:22 +05:30
lzzy12 4fa2e71e98 Show upload ETA in appropriate time units 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 22:12:07 +05:30
lzzy12 70eaada75f Stop blocking the thread while uploading the file causing slow speeds 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 21:22:21 +05:30
lzzy12 bb74416eca Stop trying to add invalid urls 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 21:02:12 +05:30
lzzy12 16886f5ac8 Make changing of bot commands easier 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 20:56:49 +05:30
lzzy12 5d6c0c8ff7 Implementing auto delete message 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 20:22:21 +05:30
lzzy12 a432ad8a5d Fix some messages sent by bot 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-12 19:50:50 +05:30
lzzy12 b5c3989451 exit_cleanup: Use aria2.remove_all method instead of loop 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-11 23:28:46 +05:30
lzzy12 fda8785c64 get_readable_message: Acquire lock before accessing the download_dict 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-11 23:25:13 +05:30
lzzy12 6fe360ebaa Delete the element from download_dict if the download failed 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-11 19:56:54 +05:30
lzzy12 2e378a9f0b Add initial project documentation 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-11 19:19:32 +05:30
lzzy12 fad3913e26 Implement cancelall 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-11 00:30:58 +05:30
lzzy12 9d83cd31c7 Random fixes all around the source 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-11 00:30:58 +05:30
lzzy12 c683c7732f Fix authorization on bot restart 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-10 21:44:52 +05:30
lzzy12 ce16f77b6d Clean download directory on startup 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-07 23:17:09 +05:30
lzzy12 65303e3143 Change status while archiving download 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-07 23:05:05 +05:30
lzzy12 1761d16f70 Fix disk_usage size unit conversion logic 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-07 22:13:38 +05:30
lzzy12 80388249c5 Implement tar-mirror invoked by /tarmirror 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-07 22:13:38 +05:30
lzzy12 d36ba18a9f Categorise modules according to their jobs 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-07 22:13:38 +05:30
lzzy12 e49445c603 Use loop count instead of progress_bytes for upload progress 
* We still have to find the best way to limit the update
: Help needed

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-07 22:13:38 +05:30
lzzy12 3a8f284186 Only allow authorized users to use the bot 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-06 23:18:16 +05:30
lzzy12 3bfe24786e Use threading.Lock to prevent concurrent access to shared resources 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-06 20:56:36 +05:30
lzzy12 b58cb47584 Trying to fix bug 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-05 22:48:37 +05:30
lzzy12 99efa2dacb Fix error 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-05 21:25:13 +05:30
lzzy12 8d95cfa3b7 Fix upload ETA 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-05 21:18:58 +05:30
lzzy12 1e3b5578d5 Implement speed and ETA for upload 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-10-05 19:54:11 +05:30
lzzy12 706047f102 cancel_mirror: Handle some more user made errors 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-09-29 22:02:02 +05:30
lzzy12 7eda6b5f79 Add support for mirroring torrent files sent on telegram 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-09-29 21:22:50 +05:30