Anthropic Claude tutorial: How to summarize PDF files with Claude

mkdir claude_tutorial
cd claude_tutorial

python3 -m venv venv

# Linux/MacOS
source venv/bin/activate

# Windows
venv\Scripts\activate.bat

pip install PyPDF2 pycryptodome # PyPDF2 and ycryptodome are used to read PDF files
pip install anthropic # Anthropic SDK

import os

from PyPDF2 import PdfReader

import anthropic

API_KEY = "sk-ant-..."

anthropic_client = anthropic.Client(API_KEY)

def summarize_pdf(path: str) -> str:
    reader = PdfReader(path)
    text = "\n".join([page.extract_text() for page in reader.pages])

    no_tokens = anthropic.count_tokens(text)
    print(f"Number of tokens in text: {no_tokens}")

    if no_tokens > 100000:
        raise ValueError(f"Text is too long {no_tokens}.")

    prompt = f"{anthropic.HUMAN_PROMPT}: Summarize the following text, should be readable:\n\n{text}\n\n{anthropic.AI_PROMPT}:\n\nSummary"
    res = anthropic_client.completion(prompt=prompt, model="claude-v1.3-100k", max_tokens_to_sample=1000)

    return res["completion"]

summary_little_prince = summarize_pdf(PATH_LITTLE_PRINCE)

The story is narrated by an aviator whose plane crashes in the Sahara desert. There he meets a little boy who is a prince from a tiny asteroid. The little prince tells the aviator about his tiny planet, how he cared for his small rose and protected it from baobabs, and his adventures traveling the universe.
The little prince visits six other asteroids, each inhabited by a single adult. He discovers the pompous and pointless life of each one, especially the businessman, geographer, and conceited man. He realizes how absurd and meaningless their lives are.
He eventually lands on Earth, where he meets a snake, fox, flowers, and railway switchman. The fox teaches him that “One sees clearly only with the heart. What is essential is invisible to the eye.” The little prince realizes the fox is the only creature that truly understands him.
A year later, the little prince returns to say goodbye to the fox before returning to his tiny planet. The little prince is worried that his beloved rose, left alone for so long, may have suffered in his absence. The aviator never learns whether the rose survived.
The story explores themes of loneliness, friendship, love, and loss. Although a children's book, it has become popular with adults for its poetic style and profound insights into human nature.
In the 2004 news article, it is revealed that wreckage of Saint-Exupery's plane that crashed in 1944 was found in the Mediterranean Sea. Although no body was recovered, authorities identified the plane based on its serial number. Saint-Exupery disappeared during a wartime spy mission, and the discovery of the wreckage provides some closure, although his mysterious end will still remain.

summary_old_man_and_the_sea = summarize_pdf(PATH_OLD_MAN_AND_THE_SEA)

The story is set in 1940s Cuba. The main character is Santiago, an old fisherman who has been unable to catch any fish for 84 days. Despite being considered unlucky by the other fishermen, Santiago refuses to give up. He sails his skiff far out into the Gulf Stream where he hooks a giant marlin. After a prolonged struggle, he manages to harpoon the fish, but then has to fight off sharks in order to bring it home. By the time he does, all that remains is a stripped carcass of the once massive marlin tied to the side of his boat. Despite being ridiculed when he returns to land, the old man is able to retain his dignity and is left with a renewed sense of hope for the future.