profile
viewpoint
Prabhakar Gupta prabhakar267 @amzn Bengaluru, India https://www.prabhakargupta.com Applied Scientist @amzn

prabhakar267/aware 31

Platform for people to raise their opinions and concerns related to environment and pollution in their locality

prabhakar267/dove 27

:moneybag: An offline payment service

mkstn/village-connect 25

Making internet available to people with no internet connection

mkstn/follow-me-or-not 20

Chrome extension to check if the GitHub profile you are visiting, follows you or not in a Twitter-like UI

adityajain21/Friend-Starzer 11

Python script to star all the repositories of your friend.

prabhakar267/chat-server-and-client 11

Simple server and client side python scripts for instant messaging

mkstn/Hack-NSIT-website 9

Official website of Hack@NSIT 2016 | Annual Software Hackathon of NSIT

mkstn/evolve-website 8

Official website of Software Development Society of NSIT - e.volve

NSITonline/timetable-json-maker 8

A simple web app to save timetables for different sections in our college, NSIT in JSON files and then retrieve the same for using in NSIT Connect - Official app of NSIT.

prabhakar267/date-info 7

API to let user fetch the events that happen(ed) on a specific date

startedcisnlp/simalign

started time in 21 hours

startedFabianGroeger96/cnn-number-detection

started time in 5 days

issue openedspotify/luigi

Fails complete pipeline when encounters `RuntimeError`

I have been seeing a pattern lately that if one of the tasks fail because of RuntimeError, the complete pipeline fails. I have added the logs I am getting after the I get RuntimeError.

RuntimeError: ... Error Message ...
DEBUG: 1 running tasks, waiting for next task to finish
2020-09-01 20:50:51.118 DEBUG worker - run: 1 running tasks, waiting for next task to finish
INFO: Informed scheduler that task   MyTask_201_1_15000_81547ef5f6   has status   FAILED
2020-09-01 20:50:51.125 INFO worker - _add_task: Informed scheduler that task   MyTask_201_1_15000_81547ef5f6   has status   FAILED
DEBUG: Asking scheduler for work...
2020-09-01 20:50:51.126 DEBUG worker - _get_work: Asking scheduler for work...
DEBUG: Done
2020-09-01 20:50:51.131 DEBUG worker - _log_remote_tasks: Done
DEBUG: There are no more tasks to run at this time
2020-09-01 20:50:51.131 DEBUG worker - _log_remote_tasks: There are no more tasks to run at this time
DEBUG: There are 108 pending tasks possibly being run by other workers
2020-09-01 20:50:51.131 DEBUG worker - _log_remote_tasks: There are 108 pending tasks possibly being run by other workers
DEBUG: There are 108 pending tasks unique to this worker
2020-09-01 20:50:51.131 DEBUG worker - _log_remote_tasks: There are 108 pending tasks unique to this worker
DEBUG: There are 108 pending tasks last scheduled by this worker
2020-09-01 20:50:51.131 DEBUG worker - _log_remote_tasks: There are 108 pending tasks last scheduled by this worker
INFO: Worker Worker(salt=977824301, workers=1, host=ip-172-31-40-217, username=ubuntu, pid=19510) was stopped. Shutting down Keep-Alive thread
2020-09-01 20:50:51.132 INFO worker - run: Worker Worker(salt=977824301, workers=1, host=ip-172-31-40-217, username=ubuntu, pid=19510) was stopped. Shutting down Keep-Alive thread
  • Python version: Python 3.6.10
  • Luigi version: luigi==3.0.1
  • OS: Ubuntu 16.04

Is this an intended behaviour and is there a way to by pass this failure and let other non-dependent tasks run?

created time in 22 days

issue commentfacebookresearch/LASER

sentence embedding for japanese: one vector instead of actual number of sentences

@asiliskins Did you manager to find the issue?

asiliskins

comment created time in a month

fork prabhakar267/youtube

Code from the Engineer Man YouTube channel

https://youtube.com/engineerman

fork in 2 months

startedengineer-man/youtube

started time in 2 months

push eventprabhakar267/coursera-programming-exercises

Prabhakar Gupta

commit sha 97dbe3effb892add2e147904e74b898c19fb9d78

Add natural-language-processing-with-probabilistic-models

view details

push time in 2 months

delete branch prabhakar267/coursera-programming-exercises

delete branch : dev

delete time in 2 months

push eventprabhakar267/coursera-programming-exercises

Prabhakar Gupta

commit sha d96db19f350938918b46ae1d874f6f0bf05f1692

Add natural-language-processing-with-classification-and-vector-spaces

view details

push time in 2 months

create barnchprabhakar267/coursera-programming-exercises

branch : dev

created branch time in 2 months

more