> ## Content Index
> Fetch the complete content index at: https://www.bambooweekly.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# Bamboo Weekly #6: End of the humanities?
- URL: https://www.bambooweekly.com/bw-6-end-of-the-humanities/
- Published: 2023-03-08T16:01:20.000Z
- Updated: 2026-08-06T10:46:09.000Z
- Description: Get practice working with Excel files, cleaning data, formatting, window functions, and strings.
- Author: Reuven M. Lerner
- Tags: excel, cleaning, formatting, window-functions, strings

## This week’s topic: End of the humanities?

I got my undergraduate degree at MIT, where virtually all of my classmates were studying science or engineering. For most of us, a university education was very practical, giving us knowledge and skills that would directly give us jobs. And yes, MIT required that we take at least eight classes in the humanities, arts, and social sciences. But people who *majored* in those sorts of subjects were seen as, well, taking the easy way out. And not getting obvious practical skills.

The worst were those students at Columbia University, where every single undergraduate was required to study art history. Wow, did we get a good laugh from that!

Fast forward to today, and … well, I’m married to a curator, who got a degree in art history. I now appreciate art — and more importantly, I appreciate the perspective and knowledge that you get from learning such subjects. I’m very happy having studied computer science, but believe the world would be less interesting without the arts and humanities.

The thing is, a humanities degree is no more obviously practical than it was back when I was in school, oh-so-long ago. You learn lots of art and literature, which is fun and interesting, but doesn’t clearly tee you up for a great job. You learn to write and to think critically, which are definitely important and useful skills, but that’s not necessarily enough to get your first job.

And so, not surprisingly, the number of Americans getting humanities degrees has dropped like a stone. This was the subject of [an article in the New Yorker several weeks ago](https://www.newyorker.com/magazine/2023/03/06/the-end-of-the-english-major?ref=bambooweekly.com), called “The end of the English major.” Felix Salmon [wrote about it in his Axios column](https://www.axios.com/2023/03/04/studying-english-makes-little-sense?ref=bambooweekly.com), as well.

This week, I thus decided to dive into the data: How much of a drop have we really seen for college students getting degrees in the arts and social sciences? What subjects are people now studying instead?

## Data and questions

Our data for this week comes from the US Department of Education, which tracks a huge number of data points regarding universities — both the institutions and their students — in a program they call IPEDS, short for Integrated Postsecondary Education Data System. From the IPEDS site ([https://nces.ed.gov/ipeds](https://nces.ed.gov/ipeds?ref=bambooweekly.com)), you can select and retrieve a wide variety of information.

I chose to retrieve, from the Digest of Education Statistics, a table showing the total number of students majoring in each of 30 different areas of study. You can view the table at [https://nces.ed.gov/programs/digest/d21/tables/dt21\_322.10.asp](https://nces.ed.gov/programs/digest/d21/tables/dt21%5F322.10.asp?ref=bambooweekly.com). Better yet, you can download the file from:

```
https://nces.ed.gov/programs/digest/d21/tables/xls/tabn322.10.xls
```

Our questions for this week are:

- Retrieve the Excel file with selected years, and turn it into a data frame.
- Remove the line numbering the surveys. Remove the total. And remove the lines at the bottom, after "Other and not classified".
- Remove the \\n\\ markings (for footnotes) from the "Field of study" column
- Remove newlines and other extraneous whitespace from the "Field of study" column
- Set the "Field of study" column to be the index.
- Which majors have had the greatest \*increase\* since the survey began in 1970-1971?
- Display the numbers with a comma before every three digits –so that instead of showing "1000" it shows "1,000"
- Which majors have had the greatest \*decrease\* since the survey began in 1970-1971?
- If we only look at the last 10 years of the study (i.e., starting in 2010-11), do we see similar changes in majors?
- What percentage decline do we see in all fields containing the word "art," "language," "history," or "culture" in their names in the last 10 years?

The learning goals for this week are include cleaning unwanted rows, cleaning string data, selecting columns, and working with axes.

I’ll be back tomorrow with detailed solutions to these questions.

Reuven