How Much Do We Need to Know?