Explore BrainMass

Coding and Information Theory

Information theory was founded in 1948 by the mathematician Claude Shannon in his "A Mathematical Theory of Communications". In it, he strives to find fundamental limits on signal processing operations in order to facilitate reliable storage, compression and communication of data. This is clearly a huge concern, as all computing requires movement of data to work. The central obstacle to this goal is noisy channels of communication.

Photograph of Claude Shannon taken by Alfred Eisenstaedt, painted on a wall in France's Abode of Chaos contemporary art museum.
Image Source: thierry ehrmann /

Transmission over such channels is an engineering problem at the heart of information theory and it led to the very important source coding theorem. This theorem states that, on average, the number of bits needed to store or communicate one symbol is determinable by its entropy. The coding theory that sprung from this centers around the effort to find explicit methods ("codes") that are efficient enough to reduce the net error rate of signal transmission over a noisy channel. The closer to that channel's fundamental maximum limit as described by information theory, the more efficient that transmission is and the closer that channel is to being used to its maximum potential. These codes come in two forms:

  • data compression, which works to remove errors in the initial 'packaging' of the data for sending, and 
  • error-correction, which strives to put right errors that result from the sending itself (see the Error Detection and Correction section for more)

VBA product price calculator

• VBA Question 4. (This uses VBA commands InputBox, MsgBox, Dim, For Next, If Then Else, Cells, Option Explicit and a button) The file PriceData.xlsx has a single sheet that lists all 128 of your products by product code. For each product, it lists the unit price and a discount percentage the customers receive if they pu

Little Man Computer, Clustering models, Main Memory Update

Describe what the following LMC program does. Mailbox Contents 00 901 01 309 02 207 03 902 04 708 05 602 06 000 07 1 08 000 09 DAT b) The contents in memory occasionally have to be moved to another area of memory. When that happens, the mailbox references must be adjusted so that the program continue

Programming C+

Why should you not use an external file name in any place other than the open statement?

Relative Benefit

Relative benefit is the degree to which a new technology is perceived to be superior to the current technology. An organisation is more likely to adopt the new technology when it perceives greater relative benefit compared to the current technology. Agile software development practices promise marked improvement in software deve

What Makes Software Important?

What makes software so important? List a number of ways that software has an impact on our life. List at least five non-computer related businesses where software has a significant, if 'behind the scenes' impact.

Universalist Rationality Theory

?Universalist rationality theory assumes that actors within an institution are rational. They function with their own material interests in mind, maximizing efficiency and resources. It is believed that IS innovation itself is subject to rationality. Yet, many have criticized this notion. Discuss the validity of these critiques

How does software engineering differ?

Explain how the lack of metrics for measuring certain software properties affects the software engineering discipline. How does software engineering differ from other, more traditional fields of engineering such as electrical and mechanical engineering?

Collaboration Design

The Whodunit system design had a great start, and providing more detail is the next appropriate step in the design process. Collaboration diagrams help provide this additional detail, and they will be the focus of this assignment. For this assignment, you will prepare a collaboration design and description in Microsoft Word

Use Case Narrative

Here is the scenario... Scenario: Whodunit offers unique computer forensics services to a nationwide client base of businesses and private individuals seeking evidence of specific kinds of computer use. Whodunit staff members are experts in their specialized area of computer investigations, but they lack the knowledge and

Concepts of Elliptic Curves

1. What is an elliptic curve? 2. What is the sum of three points on an elliptic curve that lie on a straight line?

ways to motivate project teams

What are some ways to motivate project teams? Are the ideas presented in the article "Using Earned Value Management Indexes as Team Development Factor and a Compensation Tool" applicable to your organization? Why or why not?

3D Images- parallel projection and perspective projections

I need help with parallel projections and perspective projections, this is what I have so far: Vertex List v X Y Z v X Y Z ... and Face List f V1 V2 V3 f V3 V2 V1 .... I have a java application that reads in a vertex list and face list. I also have code to write 2-D lines and ouput that image file. In my cod

Primary Keys

Read the article then answer the following questions: 1. Post a summary of the essential points in the article. 2. The author discusses "...three fundamental demands on the candidate keys that we must never deviate from, if it is to become the subject for a primary key." D

Information and coding theory question.

When S is a source, let S^n denote the n-th extenstion of S. Is it true that S^4n = (S^2n)^2 ? I belive that it is true but i need a good complete explanation .

Hardware Theory -- Expanding opcode

I have been having a lot of problems with this and really have no clue as to what to do.. Please include steps as well as answer.. Thanks Design an expanding opcode to allow all the following to be encoded in a 36-bit instructions: 7 instructions with three 15-bit addresses and two 3-bit register number 500 instructions