How to Read Text Files with Pandas?
Last Updated :
21 Aug, 2024
In this article, we will discuss how to read text files with pandas in Python. In Python, the Pandas module allows us to load DataFrames from external files and work on them. The dataset can be in different types of files.
Text File Used
Read Text Files with Pandas
Below are the methods by which we can read text files with Pandas:
- Using read_csv()
- Using read_table()
- Using read_fwf()
Read Text Files with Pandas Using read_csv()
We will read the text file with pandas using the read_csv() function. Along with the text file, we also pass separator as a single space (‘ ’) for the space character because, for text files, the space character will separate each field. There are three parameters we can pass to the read_csv() function.
Syntax:
Syntax: data=pandas.read_csv('filename.txt', sep=' ', header=None, names=["Column1", "Column2"])
Parameters:
- filename.txt: As the name suggests it is the name of the text file from which we want to read data.
- sep: It is a separator field. In the text file, we use the space character(' ') as the separator.
- header: This is an optional field. By default, it will take the first line of the text file as a header. If we use header=None then it will create the header.
- names: We can assign column names while importing the text file by using the names argument.
Example 1
In this example, we are using read_csv() function to read the csv file.
Python
# Read Text Files with Pandas using read_csv()
# importing pandas
import pandas as pd
# read text file into pandas DataFrame
df = pd.read_csv("gfg.txt", sep=" ")
# display DataFrame
print(df)
Output:
Example 2
In this example, we will make the header filed equal to None. This will create a default header in the output. And take the first line of the text file as data entry. The created header name will be a number starting from 0.
Python
# Read Text Files with Pandas using read_csv()
# importing pandas
import pandas as pd
# read text file into pandas DataFrame and
# create header
df = pd.read_csv("gfg.txt", sep=" ", header=None)
# display DataFrame
print(df)
Output:
Example 3:
In the above output, we can see it creates a header starting from number 0. But we can also give names to the header. In this example, we will see how to create a header with a name using pandas.
Python
# Read Text Files with Pandas using read_csv()
# importing pandas
import pandas as pd
# read text file into pandas DataFrame and create
# header with names
df = pd.read_csv("gfg.txt", sep=" ", header=None,
names=["Team1", "Team2"])
# display DataFrame
print(df)
Output:
Read Text Files with Pandas Using read_table()
We can read data from a text file using read_table() in pandas. This function reads a general delimited file to a DataFrame object. This function is essentially the same as the read_csv() function but with the delimiter = '\t', instead of a comma by default. We will read data with the read_table function making separator equal to a single space(' ').
Syntax: data=pandas.read_table('filename.txt', delimiter = ' ')
Parameters:
- filename.txt: As the name suggests it is the name of the text file from which we want to read data.
Example: In this example, we are using read_table() function to read the table.
Python
# Read Text Files with Pandas using read_table()
# importing pandas
import pandas as pd
# read text file into pandas DataFrame
df = pd.read_table("gfg.txt", delimiter=" ")
# display DataFrame
print(df)
Output:
Read Text Files with Pandas Using read_fwf()
The fwf in the read_fwf() function stands for fixed-width lines. We can use this function to load DataFrames from files. This function also supports text files. We will read data from the text files using the read_fwf() function with pandas. It also supports optionally iterating or breaking the file into chunks. Since the columns in the text file were separated with a fixed width, this read_fwf() read the contents effectively into separate columns.
Syntax: data=pandas.read_fwf('filename.txt')
Parameters:
- filename.txt: As the name suggests it is the name of the text file from which we want to read data.
Example: In this example, we are using read_fwf to read the data.
Python
# Read Text Files with Pandas using read_fwf()
# importing pandas
import pandas as pd
# read text file into pandas DataFrame
df = pd.read_fwf("gfg.txt")
# display DataFrame
print(df)
Output:
Similar Reads
How to Read JSON Files with Pandas? JSON (JavaScript Object Notation) store data using key-value pairs. Reading JSON files using Pandas is simple and helpful when you're working with data in .json format. There are mainly three methods to read Json file using Pandas Some of them are:Using pd.read_json() MethodUsing JSON Module and pd.
2 min read
Reading rpt files with Pandas In most cases, we usually have a CSV file to load the data from, but there are other formats such as JSON, rpt, TSV, etc. that can be used to store data. Pandas provide us with the utility to load data from them. In this article, we'll see how we can load data from an rpt file with the use of Pandas
2 min read
How to read csv file with Pandas without header? Prerequisites: Pandas A header of the CSV file is an array of values assigned to each of the columns. It acts as a row header for the data. This article discusses how we can read a csv file without header using pandas. To do this header attribute should be set to None while reading the file. Syntax:
1 min read
How to read large text files in Python? In this article, we will try to understand how to read a large text file using the fastest way, with less memory usage using Python. To read large text files in Python, we can use the file object as an iterator to iterate over the file and perform the required task. Since the iterator just iterates
3 min read
How To Read Space-Delimited Files In Pandas In this article, We'll learn to efficiently read and process space-delimited files with variable spaces using Pandas in Python.What is a Space-Delimited file?Space-delimited files are a type of text file where data is organized into records (rows) and fields (columns), separated by spaces instead of
4 min read
Reading and Writing to text files in Python Python provides built-in functions for creating, writing, and reading files. Two types of files can be handled in Python, normal text files and binary files (written in binary language, 0s, and 1s). Text files: In this type of file, Each line of text is terminated with a special character called EOL
8 min read