Handling request exceptions while using threads

Question

i am using request.post in thread as i have hit the url and not wait for response as i have around 4.5 k event to be sent one event at a time.

def request_task(url, data, headers):
    try:
        response = requests.post(url, json=data, headers=headers)

    except requests.ConnectionError as e:
        print (e)
     except requests.exceptions.RequestException as e:
         print (e)

def fire_and_forget(url, json, headers):
    x=threading.Thread(target=request_task, args=(url, json, headers))
    x.start()

def push():
    fire_and_forget(url, json=data, headers=headers)

I am not sure where should i be using try block and am i doing it the right way as i am using thread .

Could any one suggest how can i catch the exceptions also taking thread into consideration

Answer 1

There are different places you can add the try block. It all depends on where you think you might find an exception. Here are few examples:

def request_task(url, data, headers):
    try:
        response = requests.post(url, json=data, headers=headers)

    except requests.ConnectionError as e:
        print (e)
     except requests.exceptions.RequestException as e:
         print (e)

def fire_and_forget(url, json, headers):
    x=threading.Thread(target=request_task, args=(url, json, headers))
    x.start()

def push():
    try:
        fire_and_forget(url, json=data, headers=headers)
    except:
        print ("Thread creation failure")

or something like this:

def request_task(url, data, headers):
    try:
        response = requests.post(url, json=data, headers=headers)

    except requests.ConnectionError as e:
        print (e)
     except requests.exceptions.RequestException as e:
         print (e)

def fire_and_forget(url, json, headers):
    try:
        x=threading.Thread(target=request_task, args=(url, json, headers))
    except:
        print ("Thread creation failure")     
    try:
        x.start()
    except:
        print("Could not start thread")

def push():
    fire_and_forget(url, json=data, headers=headers)

Comments

hi @Richard thank you for your answer .
But my concern is i am not able to catch the exception .
example : in resquest_task method if i pass a wrong URL also i am not able to catch the exception.

---

Hello @sumanth,

I tried the code and it worked without any problem. When I give a wrong url, the exception was caught and was printed on the console:

HTTPConnectionPool(host='www.edurekka.co', port=80): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x000002682CDB5E80>: Failed to establish a new connection: [Errno 11001] getaddrinfo failed',))