Hall of Masters

Claude Shannon

클로드 섀넌

Founder of information theory

65 records in all

  • Principles 19
  • Episodes 40
  • Quotes 6
Ask with this master's words

3 free questions a day, no sign-up.

Photo: Unknown author / Tekniska museet  CC BY 2.0  Original  cropped

Episodes

6 basic records of 40

Episodes are real events from public sources, summarised by us.

  • Founding Computer Chess

    Claude Shannon published a paper titled Programming a Computer for Playing Chess which laid the foundation for the field. He calculated that chess has at least 10 to the power of 120 possible games, showing that computers needed more than just raw power to win.

    LessonWhen a problem is too vast for brute force, you must define the search space and focus on high-probability paths.

  • The Necessity of Context in Communication

    Shannon noted that for efficient encoding to work, the decoder must understand the source's characteristics. In practice, this means a compressed message often needs to include a header or metadata describing the source to ensure the recipient can interpret it correctly.

    LessonEfficiency in communication is only possible when both parties share a clear understanding of the underlying context or 'source'.

  • Defining the Fundamental Problem

    섀넌은 통신의 핵심이 수신자가 채널을 통해 받은 신호를 바탕으로 송신자가 보낸 데이터를 정확히 식별하는 것이라고 보았어요. 이를 위해 메시지를 인코딩, 압축, 전송하는 다양한 방법을 연구했어요.

    Lesson해결하려는 문제의 본질을 명확히 정의하는 것이 기술적 돌파구의 시작이에요.

  • Proving Compression Limits

    섀넌은 소스 코딩 정리를 통해 엔트로피가 데이터 압축의 절대적 한계임을 증명했어요. 이후 잡음이 있는 채널에서도 데이터 전송 효율을 높일 수 있음을 입증하며 이론을 강화했어요.

    Lesson이론적인 한계치를 알면 자원을 낭비하지 않고 최적의 효율을 목표로 삼을 수 있어요.

  • Measuring English Language Entropy

    Shannon conducted experiments using human predictors to estimate the information rate of the English language. He found that English text typically carries between 0.6 and 1.3 bits of information per character, revealing significant redundancy in how we communicate.

    LessonUnderstanding the baseline efficiency of your medium allows you to optimize how much actual value you are delivering.

  • Publishing the Mathematical Theory

    Following his initial presentation, Shannon co-authored 'The Mathematical Theory of Communication' with Warren Weaver. This book brought his complex mathematical proofs to a wider audience and solidified the principles of channel capacity.

    LessonDocumenting and sharing a core discovery in an accessible format can turn a technical proof into an industry standard.

You are seeing 16 basic records. Membership answers from all 65 of this master's records.

See membership

More masters in this field

See the whole field

Science and first-principles thinking

These records are our compilation of public statements and sources. We are not affiliated with or endorsed by Claude Shannon or any related company. If something should come down, tell us. Takedown request form