[Question] Crawl and download Google drive content

I am invited to view a google drive folder (not sure if this is the appropriate terminology), which contains a bunch of files and folders sorted hierarchically. I can see the content, and can download the files one-by-one, but I am not given permission to download everything at once, so as to view at leisure. Since this link will likely expire soon, is there a way to save time and crawl (and download) its content, without having to do it on a file-by-file case?

I have tried some extensions (apparently chrome web store requires login nowadays?), some projects on github (requiring installation of go), and rclone. rclone (debian/ubuntu) seems the most promising solution, but I couldn’t find a way to do what I want (which is to just download everything in the same hierarchical order). I should add that I do not OWN the particular google drive folder, so I cannot upload files to it - just view/download.

I should add that because I do not use a gmail account, I have to visit the link provided, receive a text code from Google on my e-mail, and then use that code to get authorization to view the drive contents. This is in contrast to others who HAVE a google account, and just log in with their google account. This probably matters to rclone, and is maybe the reason I couldn’t make it work.

Rclone uses the Drive API which makes it trivial, but requires an API access token to be created, which requires a Google user account - so yeah, only automated way would be some browser automation like Selenium. No idea of pre-made tools to do that.

1 Like

Not 100% sure, but I think you can access folders shared with you as yourself through the Google Drive API, if you don’t own them. … i.e. Delegate your own permissions, or a subset of them to API use.