Can not subscribe to more than 100 instruments

APIs, Automation, Algos & Code
1

Hi team, I have been trying to subscribe 200 instruments, but can not. Somehow dhanhq python library throws an error. I have tried with multiple instruments list and can not find any solution… Can you please help me resolve this. Thanks in advance.

My code -

# More basic code here, main code starts below

async def on_connect(instance):
    print("Connected!")
async def on_message(instance, message):
    print(message)
feed = marketfeed.DhanFeed(client_id=client_id,
    access_token=access_token,
    instruments=instruments[:100],
    subscription_code=subscription_code,
    on_connect=on_connect,
    on_message=on_message
    )

print(f'Total subscribed instruments right now: {len(feed.instruments)}. Subscribing more...')
feed.subscribe_symbols(subscription_code, instruments[99:200])
print(f'Total subscribed instruments right now: {len(feed.instruments)}. Going to run feed now.')

feed.run_forever()

My error:

C:\___DHANHQ_PACKAGE_LOCATION_HERE___\dhanhq\marketfeed.py:79: RuntimeWarning: Enable tracemalloc to get the object allocation traceback
Total subscribed instruments right now: 100. Subscribing more...
Total subscribed instruments right now: 200. Going to run feed now.
Connected!
Connected!
Connection has been closed
2

Hello @lalitnmudgal

Just to check here, are you able to subscribe to first 100 instruments and get data for those with this same code?

3

Yes, I did that and it works very well.

4

@Hardik can you please check this once and replicate on your system?

5

Hello @lalitnmudgal

Sure, will take a look into this and update here.

6

Hi @Hardik, could you please share an update on this? Thanks.

7

Hello @lalitnmudgal

Yes, one thing here. Which function are you calling to subscribe to the next 100 instruments?

8

It is subscribe_symbols. Also mentioned in the code above.

9

@Hardik could you please share an update on this?

10

Hello @lalitnmudgal

Yes, we are working on an update to the DhanHQ Python library, which will fix this.

11

Hi @Hardik
Is this fixed now in the official github repo?

12

Hello @R.E.M

Yes, just reviewing this. There are open PRs for this, will merge from the same post testing and update. I will post it here as soon as it is reviewed and merged.

1 Like
13

Also, could you confirm what is the max limit (if any) that would be supported? Suppose I want to track all f&o stocks (~ 200) + their futures and ATM options, that means approx 1k-2k stocks. Will the websockets be the right choice?

Or are you guys also working on a polling mechanism for getting a large number of LTP and OI data since not everyone will need the whole stream and some may only need the data on on-demand basis when their script runs.

14

Hello @R.E.M

Yes, on the websockets, you can get live data stream of upto 5000 instruments on a single websocket, which is an efficient way when you are trying to poll data for large number of instruments at a single time.

On the LTP API, we are looking into feasibility of delivering data via this method.

15

Thanks @Hardik, look forward to the library update.

for the polling api, you could keep a very small rate limit (e.g. 10 times per minute), so that people don’t misuse it when the streaming api was a better choice.

1 Like
16

Hi @Hardik , it’s been a week, is there any ETA for this? I’m paying monthly charges for the data api but it doesn’t work as advertised (yet). Hope you understand.

17

Hello @R.E.M

We are testing the same before deploying. Will update here as soon as it is done.

18

Hi @Hardik

I see that on the Dev branch we have some changes, but the function subscribe_symbols doesn’t take two params anymore?

Also, if I try to call it before running the event loop, I get this error:

Blockquote
File “/usr/lib/python3.10/asyncio/tasks.py”, line 336, in create_task
loop = events.get_running_loop()
RuntimeError: no running event loop

19

Hello @R.E.M

Let me take a look, will update you on this!

20

Hi @Hardik Do you have an update on when we can get the python library updated to support more than 100 instruments for market feed?

1 Like