csv文件超过104万数据怎么办?

一、notepad++

打开文件,

按Ctrl+G定位行

然后按Ctrl+shift+home就能选择到第一行了

然后按Ctrl+shift+End就能选择到最后一行

二、python

import csv
data = []
with open("目标文件.csv", "r")as csvfile:
    dd = csv.reader(csvfile)
    for item in dd:
        if data.line_num==1000000:   #取前1000000行
            break
        data.append(item)
with open("1.csv","w",newline="") as f1:
    ff=csv.writer(f1)
    for item in data:
        ff.writerow(item)
import csv
data = []
with open("目标文件.csv", "r")as csvfile:
    dd = csv.reader(csvfile)
    for item in dd:
        if data.line_num<1000000:   #取消取前1000000行
            continue
        data.append(item)
with open("2.csv","w",newline="") as f1:
    ff=csv.writer(f1)
    for item in data:
        ff.writerow(item)
import csv

data1=[]
data2=[]
with open("赣州20210504.csv", "r")as csvfile:
    dd = csv.reader(csvfile)
    for item in dd:
        if dd.line_num<1000000:   
           data1.append(item)    #取前1000000行
        else:
           data2.append(item)    #取1000000行以后的值
with open("11.csv","w",newline="") as f1:
    ff1=csv.writer(f1)
    for item in data1:
        ff1.writerow(item)

with open("10.csv","w",newline="") as f2:
    ff2=csv.writer(f2)
    for item in data2:
        ff2.writerow(item)

 

Logo

CSDN联合极客时间,共同打造面向开发者的精品内容学习社区,助力成长!

更多推荐