Skip to content
View original post on X: Allie K. MillerX· 13/100AI score13/100

AI model progress since GPT-4: context window and GPQA scores

AISummary

Allie K. Miller compares GPT-4 with Astra, noting GPT-4 had an 8k/32K token cap and scored 39% on GPQA Diamond. She says Astra has a 1M token context window and scores 96% on GPQA Diamond. She also recalls that GPT-4 users were limited to 50 messages every 4 hours.

Post on XView on X
Allie K. MillerVerified on X
@alliekmiller

Three years and seven months ago, we could only send AI 50 messages every 4 hours to GPT-4.

GPT-4 had a token cap of 8k/32K.
Astra has 1M.

GPT-4 scored a 39% on GPQA Diamond.
Astra scored 96%.

Sometimes I take for granted how far it's all come.

Source: Allie K. Miller · x.comPublished