Currently, I leave DevTools open in the Network tab, and when a certain table is updated, I click on the request and in Response the complete dictionary is there. I copy all the text and paste it into a JSON file.
The URL changes with each new update; if there’s a websocket, it doesn’t appear, and it’s impractical to keep requesting it every second via Python or keeping a Selenium instance or similar open 24 hours a day, increasing the computer’s CPU and RAM consumption as it does.
Is there any way to automate saving the content of the request response that appears in the Network tab and save it to my computer in real time, as soon as it appears there, it’s already saved on my computer?
This way I could create a Python code just to read the files in the folder where they are being saved, completely eliminating costs and difficulties.
