Explore BrainMass
Share

# Coding and Information Theory

Information theory was founded in 1948 by the mathematician Claude Shannon in his "A Mathematical Theory of Communications". In it, he strives to find fundamental limits on signal processing operations in order to facilitate reliable storage, compression and communication of data. This is clearly a huge concern, as all computing requires movement of data to work. The central obstacle to this goal is noisy channels of communication.

Photograph of Claude Shannon taken by Alfred Eisenstaedt, painted on a wall in France's Abode of Chaos contemporary art museum.
Image Source: thierry ehrmann / Flickr.com.

Transmission over such channels is an engineering problem at the heart of information theory and it led to the very important source coding theorem. This theorem states that, on average, the number of bits needed to store or communicate one symbol is determinable by its entropy. The coding theory that sprung from this centers around the effort to find explicit methods ("codes") that are efficient enough to reduce the net error rate of signal transmission over a noisy channel. The closer to that channel's fundamental maximum limit as described by information theory, the more efficient that transmission is and the closer that channel is to being used to its maximum potential. These codes come in two forms:

• data compression, which works to remove errors in the initial 'packaging' of the data for sending, and
• error-correction, which strives to put right errors that result from the sending itself (see the Error Detection and Correction section for more)

### VBA product price calculator

• VBA Question 4. (This uses VBA commands InputBox, MsgBox, Dim, For Next, If Then Else, Cells, Option Explicit and a button) The file PriceData.xlsx has a single sheet that lists all 128 of your products by product code. For each product, it lists the unit price and a discount percentage the customers receive if they pu

### Little Man Computer, Clustering models, Main Memory Update

Describe what the following LMC program does. Mailbox Contents 00 901 01 309 02 207 03 902 04 708 05 602 06 000 07 1 08 000 09 DAT b) The contents in memory occasionally have to be moved to another area of memory. When that happens, the mailbox references must be adjusted so that the program continue

### Programming C+

Why should you not use an external file name in any place other than the open statement?

### Different Causes of Software Errors

Critically discuss the different causes of software errors.

### Relative Benefit

Relative benefit is the degree to which a new technology is perceived to be superior to the current technology. An organisation is more likely to adopt the new technology when it perceives greater relative benefit compared to the current technology. Agile software development practices promise marked improvement in software deve

### What Makes Software Important?

What makes software so important? List a number of ways that software has an impact on our life. List at least five non-computer related businesses where software has a significant, if 'behind the scenes' impact.

### Does the Internet require governance? Do you agree that a monolithic body of Internet governance is necessary or desirable? Justify your answers.

Does the Internet require governance? Do you agree that a monolithic body of Internet governance is necessary or desirable? Justify your answers.

### Universalist Rationality Theory

?Universalist rationality theory assumes that actors within an institution are rational. They function with their own material interests in mind, maximizing efficiency and resources. It is believed that IS innovation itself is subject to rationality. Yet, many have criticized this notion. Discuss the validity of these critiques

### Which key aspect of research is the most important one?

Discuss what are the three key aspects of research? Which one of them you consider the most important, or are they equally important? Approx 350 to 400 words.

### How does software engineering differ?

Explain how the lack of metrics for measuring certain software properties affects the software engineering discipline. How does software engineering differ from other, more traditional fields of engineering such as electrical and mechanical engineering?

### How data, information and knowledge are related to the concept of knowledge management?

How are data, information and knowledge related to the concept of knowledge management? How are they different? Please define each one: data, information, knowledge and KM.

### Collaboration Design

The Whodunit system design had a great start, and providing more detail is the next appropriate step in the design process. Collaboration diagrams help provide this additional detail, and they will be the focus of this assignment. For this assignment, you will prepare a collaboration design and description in Microsoft Word

### Data Flow Diagram

Scenario: Whodunit offers unique computer forensics services to a nationwide client base of businesses and private individuals seeking evidence of specific kinds of computer use. Whodunit staff members are experts in their specialized area of computer investigations, but they lack the knowledge and skills to create the comput

### Use Case Narrative

Here is the scenario... Scenario: Whodunit offers unique computer forensics services to a nationwide client base of businesses and private individuals seeking evidence of specific kinds of computer use. Whodunit staff members are experts in their specialized area of computer investigations, but they lack the knowledge and

### Information Technology Evaluation and Implementation

Describe and contrast the hierarchy of needs, ERG theory, and two-factor theory.

### Theory of Computation: Truth or Lie Teller Example

Discuss the question below: Suppose you were in a country where each person was either a truth teller or a liar. (A truth teller always tells the truth, a liar always lies.) What single question could you ask a person that would allow you to detect whether that person was a truth teller or a liar?

### Concepts of Elliptic Curves

1. What is an elliptic curve? 2. What is the sum of three points on an elliptic curve that lie on a straight line?

### Describe the theory and concepts involved in the design of web pages

One recent change in web design is the shift in standards from HTML to XHTML. Describe how a web designer defines a page as "XHTML" as opposed to "HTML" and identify two different types of XHTML standards. What are the differences between these two standards?

### ways to motivate project teams

What are some ways to motivate project teams? Are the ideas presented in the article "Using Earned Value Management Indexes as Team Development Factor and a Compensation Tool" applicable to your organization? Why or why not?

### Using PERT Methodology in Strategic Decisions

Based on the article "One Application for Using PERT Methodology in Strategic Decisions," write a memo to your CIO recommending how PERT may be used for strategic decision making and assisting project managers who need to deal with complex problems?

### 3D Images- parallel projection and perspective projections

I need help with parallel projections and perspective projections, this is what I have so far: Vertex List v X Y Z v X Y Z ... and Face List f V1 V2 V3 f V3 V2 V1 .... I have a java application that reads in a vertex list and face list. I also have code to write 2-D lines and ouput that image file. In my cod

### Primary Keys

Read the article http://www.orafaq.com/articles/archives/000031.htm then answer the following questions: 1. Post a summary of the essential points in the article. 2. The author discusses "...three fundamental demands on the candidate keys that we must never deviate from, if it is to become the subject for a primary key." D

### Information and coding theory question.

When S is a source, let S^n denote the n-th extenstion of S. Is it true that S^4n = (S^2n)^2 ? I belive that it is true but i need a good complete explanation .

### Hardware Theory -- Expanding opcode

I have been having a lot of problems with this and really have no clue as to what to do.. Please include steps as well as answer.. Thanks Design an expanding opcode to allow all the following to be encoded in a 36-bit instructions: 7 instructions with three 15-bit addresses and two 3-bit register number 500 instructions

### Working with set theory: subtraction, union, and intersection.

If we define the following two sets: A = {1, 2, 3, 4, 5} B = {5, 6, 7, 8, 9} What are the following: A - B? A union B? (The union of A and B) A intersect B? (The intersect of A and B)