I work with clinical data at a company that, until I arrived, didn't have a data policy. Currently, raw data extraction relies solely on manually downloading CSV/Excel files from an internal portal with User + Password authentication, and these are already included in the workflow.
Are there any Python/R libraries that automate or semi-automate this process? Or do anyone have any experience automating these types of processes?
I know it would be best if the software had an API, but since they are "small" and very old, the vendors don't offer me solutions in this regard.
For now, I'm sticking with manual downloads and periodically uploading files to folders pointed to by the stream.