提问者:小点点

如何从google drive将数据导入google colab?


我有一些数据文件上传到我的谷歌驱动器。我想把这些文件导入google colab。

REST API方法和PyDrive方法演示如何创建新文件并将其上传到驱动器和colab上。使用它,我无法弄清楚如何在我的python代码中读取已经存在于我的驱动器上的数据文件。

我完全是个新手。有人能帮我吗?


共3个答案

匿名用户

(2018年4月15日更新:gspread经常更新,因此为了确保稳定的工作流程,我指定了版本)

对于电子表格文件,基本思想是使用包gspread和pandas读取驱动器中的电子表格,并将其转换为pandas数据帧格式。

在Colab笔记本中:

#install packages
!pip install gspread==2.1.1
!pip install gspread-dataframe==2.1.0
!pip install pandas==0.22.0


#import packages and authorize connection to Google account:
import pandas as pd
import gspread
from gspread_dataframe import get_as_dataframe, set_with_dataframe
from google.colab import auth
auth.authenticate_user()  # verify your account to read files which you have access to. Make sure you have permission to read the file!
from oauth2client.client import GoogleCredentials
gc = gspread.authorize(GoogleCredentials.get_application_default()) 

然后我知道了3种阅读谷歌电子表格的方法。

按文件名:

spreadsheet = gc.open("goal.csv") # Open file using its name. Use this if the file is already anywhere in your drive
sheet =  spreadsheet.get_worksheet(0)  # 0 means the first sheet in the file
df2 = pd.DataFrame(sheet.get_all_records())
df2.head()

按网址:

 spreadsheet = gc.open_by_url('https://docs.google.com/spreadsheets/d/1LCCzsUTqBEq5pemRNA9EGy62aaeIgye4XxwReYg1Pe4/edit#gid=509368585') # use this when you have the complete url (the edit#gid means permission)
    sheet =  spreadsheet.get_worksheet(0)  # 0 means the first sheet in the file
    df2 = pd.DataFrame(sheet.get_all_records())
    df2.head()

按文件键/ID:

spreadsheet = gc.open_by_key('1vpukIbGZfK1IhCLFalBI3JT3aobySanJysv0k5A4oMg') # use this when you have the key (the string in the url following spreadsheet/d/)
sheet =  spreadsheet.get_worksheet(0)  # 0 means the first sheet in the file
df2 = pd.DataFrame(sheet.get_all_records())
df2.head()

我在Colab笔记本中共享了上述代码:https://drive.google.com/file/d/1cvur-jpIpoEN3vAO8Fd_yVAT5Qgbr4GV/view?usp=sharing

资料来源:https://github.com/burnash/gspread

匿名用户

!) 将数据设置为公共可用,然后用于公共电子表格:

from StringIO import StringIO  # got moved to io in python3.

import requests
r = requests.get('https://docs.google.com/spreadsheet/ccc? 
key=0Ak1ecr7i0wotdGJmTURJRnZLYlV3M2daNTRubTdwTXc&output=csv')
data = r.content

In [10]: df = pd.read_csv(StringIO(data), index_col=0,parse_dates= 
['Quradate'])

In [11]: df.head()

更多信息:将谷歌电子表格CSV放入熊猫数据框

如果私人数据排序相同,但你将不得不做一些认证体操。。。

匿名用户

来自谷歌Colab代码片段

from google.colab import auth
auth.authenticate_user()

import gspread
from oauth2client.client import GoogleCredentials

gc = gspread.authorize(GoogleCredentials.get_application_default())

worksheet = gc.open('Your spreadsheet name').sheet1

# get_all_values gives a list of rows.
rows = worksheet.get_all_values()
print(rows)

# Convert to a DataFrame and render.
import pandas as pd
pd.DataFrame.from_records(rows)