Free Essay

Video Processing

In:

Submitted By amrishsoni
Words 4501
Pages 19
Basics of Video

Yao Wang
Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu Outline






Color perception and specification
Video capture and display
Analog raster video
Analog TV systems
Digital video

© Yao Wang, 2004

Video Basics

Color Perception and Specification






Light -> color perception
Human perception of color
Type of light sources
Trichromatic color mixing theory
Specification of color
– Tristimulus representation
– Luminance/Chrominance representation

• Color coordinate conversion

© Yao Wang, 2004

Video Basics

3

Light is part of the EM wave

from [Gonzalez02]

© Yao Wang, 2004

Video Basics

4

Illuminating and Reflecting Light
• Illuminating sources:
– emit light (e.g. the sun, light bulb, TV monitors)
– perceived color depends on the emitted freq.
– follows additive rule
• R+G+B=White

• Reflecting sources:
– reflect an incoming light (e.g. the color dye, matte surface, cloth) – perceived color depends on reflected freq (=emitted freqabsorbed freq.)
– follows subtractive rule
• R+G+B=Black
© Yao Wang, 2004

Video Basics

5

Eye Anatomy

From http://www.stlukeseye.com/Anatomy.asp
© Yao Wang, 2004

Video Basics

6

Eye vs. Camera

Camera components

Eye components

Lens

Lens, cornea

Shutter

Iris, pupil

Film

Retina

Cable to transfer images

Optic nerve send the info to the brain

© Yao Wang, 2004

Video Basics

7

Human Perception of Color


Retina contains photo receptors
– Cones: day vision, can perceive color tone • Red, green, and blue cones
• Different cones have different frequency responses • Tri-receptor theory of color vision
[Young1802]

– Rods: night vision, perceive brightness only •

Color sensation is characterized by

From http://www.macula.org/anatomy /retinaframe.html

– Luminance (brightness)
– Chrominance
• Hue (color tone)
• Saturation (color purity)
© Yao Wang, 2004

Video Basics

8

Frequency Responses of Cones

from [Gonzalez02]

Ci = ∫ C (λ )ai (λ )dλ , i = r , g , b, y
© Yao Wang, 2004

Video Basics

9

Frequency Responses of Cones and the Luminous Efficiency Function
100

Relative sensitivity

80

Blue 20
Luminosity
function
Red
Green

60

40

20

0
400

500

600

700

Wavelength

Ci = ∫ C (λ )ai (λ )dλ , i = r , g , b, y
© Yao Wang, 2004

Video Basics

10

Color Hue Specification

© Yao Wang, 2004

Video Basics

11

Trichromatic Color Mixing


Trichromatic color mixing theory
– Any color can be obtained by mixing three primary colors with a right proportion
C = ∑ Tk Ck , Tk : Tristimulus values k =1, 2,3



Primary colors for illuminating sources:
– Red, Green, Blue (RGB)
– Color monitor works by exciting red, green, blue phosphors using separate electronic guns



Primary colors for reflecting sources (also known as secondary colors): – Cyan, Magenta, Yellow (CMY)
– Color printer works by using cyan, magenta, yellow and black
(CMYK) dyes

© Yao Wang, 2004

Video Basics

12

RGB vs CMY

© Yao Wang, 2004

Video Basics

13

red

Blue

Green
© Yao Wang, 2004

Video Basics

14

Color Representation Models


Specify the tristimulus values associated with the three primary colors – RGB
– CMY



Specify the luminance and chrominance
– HSI (Hue, saturation, intensity)
– YIQ (used in NTSC color TV)
– YCbCr (used in digital color TV)



Amplitude specification:
– 8 bits for each color component, or 24 bits total for each pixel
– Total of 16 million colors
– A true RGB color display of size 1Kx1K requires a display buffer memory size of 3 MB

© Yao Wang, 2004

Video Basics

15

Color Coordinate Conversion
• Conversion between different primary sets are linear
(3x3 matrix)
• Conversion between primary and XYZ/YIQ/YUV are also linear
• Conversion to LSI/Lab are nonlinear
– LSI and Lab coordinates
• coordinate Euclidean distance proportional to actual color difference • Conversion formulae between many color coordinates can be found in [Gonzalez92]

© Yao Wang, 2004

Video Basics

16

Video Capture and Display






Light reflection physics
Imaging operator
Color capture
Color display
Component vs. composite video

© Yao Wang, 2004

Video Basics

17

Video Capture
• For natural images we need a light source (λ: wavelength of the source) ?
.
– E (x, y, z, λ): incident light on a point (x, y, z world coordinates of the point)
• Each point in the scene has a reflectivity function.
– r(x, y, z, λ): reflectivity function
• Light reflects from a point and the reflected light is captured by an imaging device.
– c(x, y, z, λ) = E (x, y, z, λ) × r(x, y, z, λ): reflected light.

Courtesy of Onur Guleryuz
© Yao Wang, 2004

Video Basics

18

More on Video Capture
• Reflected light to camera
– Camera absorption function ψ ( X, t ) = ∫ C ( X, t , λ )ac (λ )dλ

– Projection from 3-D to 2-D

X→x
P

ψ ( P( X), t ) = ψ ( X, t ) or ψ (x, t ) = ψ ( P −1 (x), t )
• The projection operator is non-linear
– Perspective projection
– Othographic projection
© Yao Wang, 2004

Video Basics

19

Perspective Projection Model
Y
X
Y

3-D point Z

X
X
Z

C y F

x

Camera center x=F x Y
X
,y=F
Z
Z

y x Image plane © Yao Wang, 2004

The image of an object is reversed from its
3-D position. The object appears smaller when it is farther away.

2-D image Video Basics

20

How to Capture Color
• Need three types of sensors
• Complicated digital processing is incorporated in advanced cameras
2 fs,1/ fs,2
Rate
conv.

Matrix & encoder

2fs,1

Nonlinear processing Color corrector

B

Image enhancer Interpolation

G

fs,1

Pre-process

R

Analog process

Lens

A/D

fs,1

( fs,1)
CCDs

Digital CN output 2fs,1
13.5 MHz

D/A

Analog CN &
CS output

D/A

Viewfinder output Figure 1.2 Schematic block diagram of a professional color video camera. Reprinted from
Y. Hashimoto, M. Yamamoto, and T. Asaida, Cameras and display systems, IEEE (July 1995),
83(7):1032–43. Copyright 1995 IEEE.
© Yao Wang, 2004

Video Basics

21

Video Display
• CRT vs LCD
• Need three light sources projecting red, green, blue components respectively

© Yao Wang, 2004

Video Basics

22

Analog Video
• Video raster
• Progressive vs. interlaced raster
• Analog TV systems

© Yao Wang, 2004

Video Basics

23

Raster Scan
• Real-world scene is a continuous 3-D signal
(temporal, horizontal, vertical)
• Analog video is stored in the raster format
– Sampling in time: consecutive sets of frames
• To render motion properly, >=30 frame/s is needed

– Sampling in vertical direction: a frame is represented by a set of scan lines
• Number of lines depends on maximum vertical frequency and viewing distance, 525 lines in the NTSC system

– Video-raster = 1-D signal consisting of scan lines from successive frames

© Yao Wang, 2004

Video Basics

24

Progressive and Interlaced Scans
Interlaced Frame

Progressive Frame
Horizontal retrace

Field 1

Field 2

Vertical retrace

Interlaced scan is developed to provide a trade-off between temporal and vertical resolution, for a given, fixed data rate (number of line/sec).
© Yao Wang, 2004

Video Basics

25

Waveform and Spectrum of an
Interlaced Raster
Horizontal retrace for first field

Vertical retrace from first to second field

Vertical retrace from second to third field

Blanking level
Black level
Th

White level

Tl

T

T

t
2
t

(a)
(f)

0

fl

2 fl

3 fl

fmax

f

(b)

© Yao Wang, 2004

Video Basics

26

Color TV Broadcasting and Receiving

RGB
--->
YC1C2

Luminance,
Chrominance,
Audio
Multiplexing

Modulation

YC1C2
--->
RGB

DeMultiplexing

DeModulation

© Yao Wang, 2004

Video Basics

27

Why not using RGB directly?


R,G,B components are correlated
– Transmitting R,G,B components separately is redundant
– More efficient use of bandwidth is desired



RGB->YC1C2 transformation
– Decorrelating: Y,C1,C2 are uncorrelated
– C1 and C2 require lower bandwidth
– Y (luminance) component can be received by B/W TV sets



YIQ in NTSC
– I: orange-to-cyan
– Q: green-to-purple (human eye is less sensitive)
• Q can be further bandlimited than I

– Phase=Arctan(Q/I) = hue, Magnitude=sqrt (I^2+Q^2) = saturation
– Hue is better retained than saturation
© Yao Wang, 2004

Video Basics

28

Color Image

I image (orange-cyan)

Y image

Q image (green-purple)

I and Q on the color circle
Q: green-purple

I: orange-cyan

© Yao Wang, 2004

Video Basics

30

Conversion between RGB and YIQ
• RGB -> YIQ
Y = 0.299 R + 0.587 G + 0.114 B
I = 0.596 R -0.275 G -0.321 B
Q = 0.212 R -0.523 G + 0.311 B
• YIQ -> RGB
R =1.0 Y + 0.956 I + 0.620 Q,
G = 1.0 Y - 0.272 I -0.647 Q,
B =1.0 Y -1.108 I + 1.700 Q.
© Yao Wang, 2004

Video Basics

31

TV signal bandwidth


Luminance
– Maximum vertical frequency (cycles/picture-height)= black and white lines interlacing f v,max = Kf 's , y / 2
– Maximum horizontal frequency (cycles/picture-width) f h,max = f v,max ⋅ IAR
– Corresponding temporal frequency (cycles/second or Hz) f max = f h,max / T 'l = IAR ⋅ Kf 's , y /2T 'l
– For NTSC,



f max = 4.2 MHz

Chrominance
– Can be bandlimited significantly
• I: 1.5 MHz, Q: 0.5 MHz.

© Yao Wang, 2004

Video Basics

32

Bandwidth of Chrominance Signals






Theoretically, for the same line rate, the chromiance signal can have as high frequency as the luminance signal
However, with real video signals, the chrominance component typically changes much slower than luminance
Furthermore, the human eye is less sensitive to changes in chrominance than to changes in luminance
The eye is more sensitive to the orange-cyan range (I) (the color of face!) than to green-purple range (Q)
The above factors lead to
– I: bandlimitted to 1.5 MHz
– Q: bandlimitted to 0.5 MHz

© Yao Wang, 2004

Video Basics

33

Multiplexing of Luminance and
Chrominance


Chrominance signal can be bandlimited
– it usually has a narrower frequency span than the luminance and the human eye is less sensitive to high frequencies in chrominance



The two chrominance components (I and Q) are multiplexed onto the same sub-carrier using QAM
– The upper band of I is limited to 0.5 MHz to avoid interference with audio •



Position the bandlimited chrominance at the high end spectrum of the luminance, where the luminance is weak, but still sufficiently lower than the audio (at 4.5 MHz=286 fl)
The actual position should be such that the peaks of chrominance spectrum interlace with those of the luminance f c = 455 fl / 2 ( = 3.58 Hz for NTSC)

© Yao Wang, 2004

Video Basics

34

Spectrum Illustration

(f )

0

Luminance

fl

2 fl

3 fl

Chrominance

225 fl 226 fl 227 fl 228 fl

229 fl 230 fl

f

fc
(Color subcarrier)

© Yao Wang, 2004

Video Basics

35

Multiplexing of luminance, chrominance and audio
(Composite Video Spectrum)
6.0 MHz

Luminance
I
I and Q
Audio

4.5 MHz
1.25
MHz

4.2 MHz
3.58 MHz

fc

fp

fa

f

Color
Audio
subcarrier subcarrier

Picture carrier (b)
© Yao Wang, 2004

Video Basics

36

Quadrature Amplitude Modulation
(QAM)
• A method to modulate two signals onto the same carrier frequency, but with 90o phase shift cos( 2π f1t )

cos( 2π f1t )

s1 ( t ) m (t )

LPF

m (t )

LPF

s 2 (t )

s 2 (t )

sin( 2π f1t )

sin( 2π f1t )

QAM modulator

© Yao Wang, 2004

s1 ( t )

QAM demodulator

Video Basics

37

Adding Color Bursts for
Synchronization

For accurate regeneration of the color sub-carrier signal at the receiver, a color burst signal is added during the horizontal retrace period
Figure from From Grob, Basic Color Television Principles and Servicing, McGraw Hill, 1975 http://www.ee.washington.edu/conselec/CE/kuhn/ntsc/95x417.gif © Yao Wang, 2004

Video Basics

38

Multiplexing of Luminance and
Chrominance
Y(t)

I(t)

LPF
0-4.2MHz

LPF
0-1.5MHz

-π/2
Q(t)

Σ

BPF
2-4.2MHz

LPF
0-0.5MHz
Gate


Acos(2πfct)
© Yao Wang, 2004

Video Basics

Σ
Composite
video

Color burst signal 39

DeMultiplexing of Luminance and
Chrominance
Composite video Y(t)

Comb Filter
0-4.2MHz

+

LPF
0-1.5MHz



I(t)

Horizontal sync signal

Gate

2Acos(2πfct)

Phase comparator © Yao Wang, 2004



-π/2
LPF
0-0.5MHz

Q(t)

Voltage controlled oscillator
Video Basics

40

Luminance/Chrominance Separation


In low-end TV receivers, a low pass filter with cut-off frequency at 3MHz is typically used to separate the luminance and chrominance signal.
– The high frequency part of the I component (2 to 3 Mhz) is still retained in the luminance signal.
– The extracted chrominance components can contain significant luminance signal in a scene with very high frequency (luminance energy is not negligible near fc)
– These can lead to color bleeding artifacts




For better quality, a comb filter can be used, which will filter out harmonic peaks correspond to chrominance signals.
Show example of comb filter on board

© Yao Wang, 2004

Video Basics

41

What will a Monochrome TV see?
• The monochrome TV receiver uses a LPT with cut-off at 4.2 MHz, and thus will get the composite video
(baseband luminance plus the I and Q signal modulated to fc =3.58 MHz)
– Because the modulated chrominance signal is at very high frequency (227.5 cycles per line), the eye smoothes it out mostly, but there can be artifacts
– The LPF in Practical TV receivers have wide transition bands, and the response is already quite low at fc.

© Yao Wang, 2004

Video Basics

42

Color TV Broadcasting and Receiving

RGB
--->
YC1C2

Luminance,
Chrominance,
Audio
Multiplexing

Modulation

YC1C2
--->
RGB

DeMultiplexing

DeModulation

© Yao Wang, 2004

Video Basics

43

Transmitter in More Details
Audio

FM modulator
4.5MHz

R(t)

B(t)

RGB to YIQ conversion

G(t)

Y(t)

LPF
0-4.2MHz

I(t)

LPF
0-1.5MHz

-π/2
Q(t)

Σ

BPF
2-4.2MHz



Acos(2πfct)
© Yao Wang, 2004

Video Basics

VSB
To
transmit antenna LPF
0-0.5MHz
Gate

Σ

Color burst signal
44

Receiver in More Details
Audio



Gate
VSB
Demodulator
From antenna

Y(t)

Comb Filter
0-4.2MHz

2Acos(2πfct)

+

LPF
0-1.5MHz

I(t)

-π/2



LPF
0-0.5MHz

R(t)
YIQ to RGB conversion

BPF, 0-4.2 MHz

BPF, 4.4-4.6MHz

Composite video To speaker G(t)

To CRT

FM demodulator

B(t)

Q(t)

Voltage
Phase
controlled comparator oscillator
Horizontal
sync signal

© Yao Wang, 2004

Video Basics

45

Matlab Simulation of Mux/Demux
• We will show the multiplexing/demultiplexing of YIQ process for a real sequence (‘mobile calendar’)
– Original Y,I, Q frames
– Converted Y,I, Q raster signals and their respective spectrums – QAM of I and Q: choice of fc, waveform and spectrum
– Multiplexing of Y and QAM(I+Q): waveform and spectrum
– What wil a B/W TV receiver see:
• W/o filtering vs. with filtering

– What will a color TV receiver see:
• Original and recovered Y,I, Q
• Original and recovered color image
• Spectrum and waveforms

© Yao Wang, 2004

Video Basics

46

Spectrum of Y, I, Q
10

10

10

10

10

10

10

10

Y S pectrum

6

10

5

10

4

10

3

10

2

10

1

10

0

10

-1

0

5

10

10 x 10

I S pectrum

6

10

5

10

4

10

3

10

2

10

1

10

0

10

-1

0

5

5

10

10 x 10

Q S pectrum

6

5

4

3

2

1

0

-1

0

5

10

5

x 10

Spectrum of Y, I, and Q components, computed from first two progressive frames of “mobilcal”, 352x240/frame
Maximum possible frequency is 352x240x30/2=1.26 MHz.
Notice bandwidths of Y, I, Q components are 0.8,0.2,0.15 MHz, respectively, if we consider 10^3 as the cut-off magnitude.
© Yao Wang, 2004

Video Basics

47

5

QAM of I and Q: Waveform
I Waveform

Q Waveform

QAM multiplexed I & Q

60

60

40

40

40

20

20

20

0

Gra y Level

80

Gra y Level

80

60

Gra y Level

80

0

0

-20

-20

-20

-40

-40

-40

-60

-60

-60

-80

0

0.5

1
Time

1.5 x 10

-4

-80

0

0.5

1
Time

1.5 x 10

-4

-80

0

0.5

1
Time

1.5 x 10

Line rate fl =30*240; Luminance fmax=30*240*352/2*0.7=.89 MHz, The color subcarrier fc=225*fl /2=0.81MHz.
M(t)=I(t)*cos(2πfct)+Q(t)*sin (2πfct)
© Yao Wang, 2004

Video Basics

48

-4

QAM of I and Q: Spectrum
10

10

10

10

10

10

10

10

I S pectrum

6

10

5

10

4

10

3

10

2

10

1

10

0

10

-1

0

5

10

10 x 10

Q S pectrum

6

10

5

10

4

10

3

10

2

10

1

10

0

10

-1

0

5

5

10

10 x 10

QAM I+Q S pectrum

6

5

4

3

2

1

0

-1

0

5

10

5

x 10

Spectrum of I, Q, and QAM multiplexed I+Q, fc=225*fl/2=0.81 MHz
© Yao Wang, 2004

Video Basics

49

5

Composite Video: Waveform
Y Waveform

Compos ite Waveform

200

150

150
Gray Level

250

200

Gray Level

250

100

100

50

0

50

0

0.5

1
Time

1.5 x 10

-4

0

0

0.5

1
Time

1.5 x 10

-4

Waveform of the Y signal Y(t) and the composite signal V(t)=Y(t)+M(t). 1 line
© Yao Wang, 2004

Video Basics

50

Composite Video: Spectrum
10

10

10

10

10

Y S pectrum

6

10

5

10

4

10

3

10

2

0

2

4

6

8

10

12 x 10

© Yao Wang, 2004

10
5

Compos ite Video S pectrum

6

5

4

3

2

0

2

4

6

8

10

12 x 10

Video Basics

5

51

Blown-up View of Spectrum
10

Compos ite S pectrum (beginning)

6

10

6

Compos ite S pectrum (near fc )

Chrominance peaks Luminance peaks
10

10

10

5

10

4

10

3

10

5

4

3

Luminance peaks
10

2

0

5

10

10

15 x 10

2

7.5

8

4

8.5

9 x 10

5

Notice the harmonic peaks of Y and M interleaves near fc
© Yao Wang, 2004

Video Basics

52

Composite Video Viewed as a
Monochrome Image w/o filtering
Original Y

Composite Signal as Y

On the right is what a B/W receiver will see if no filtering is applied to the baseband video signal

© Yao Wang, 2004

Video Basics

53

Low-Pass Filter for Recovering Y

Frequency response

Impulse response (filter coefficients)

Ma gnitude (dB)

50

0.6

0

0.5
-50

0.4

-100
-150

0

2

4

6
8
Fre que ncy (Hz)

10

0.3

12 x 10

5

P has e (degrees )

0

0.2

-500

0.1

-1000

-1500

0

0

2

4

6
8
Fre que ncy (Hz)

10

12

-0.1

x 10

5

0

5

10

15

20

25

f_LPF=30*240/2*150=0.54MHz; fir_length=20;
LPF=fir1(fir_length,f_LPF/(Fs/2));
© Yao Wang, 2004

Video Basics

54

Recovered Y with Filtering

Original Y

Recovered Y

On the right is what a B/W receiver will see if a lowpass filter with cutoff frequency at about 0.75 MHz is applied to the baseband video signal. This is also the recovered Y component by a color receiver if the same filter is used to separate Y and QAM signal.
Y’(t)=conv(V(t),LPF(t))
© Yao Wang, 2004

Video Basics

55

Y Waveform Comparison
Y Waveform

Compos ite Waveform

Y from Compos ite us ing LP F

200

200

150

150

150

Gray Level

250

Gray Level

250

200

Gray Level

250

100

100

100

50

50

50

0

0

0.5

1
Time

© Yao Wang, 2004

1.5 x 10

-4

0

0

0.5

1
Time

Video Basics

1.5 x 10

-4

0

0

0.5

1

1.5

Time

x 10

56

-4

Demux Y and QAM(I,Q)
QAM Waveform

Demultiplexed QAM

60

40

40

20

20
Gray Level

80

60

Gray Level

80

0

0

-20

-20

-40

-40

-60

-60

-80

0

0.5

1
Time

1.5 x 10

-4

-80

0

0.5

1
Time

1.5 x 10

-4

M’(t)=V(t)-Y’(t)
© Yao Wang, 2004

Video Basics

57

QMA Modulation and Demodulation


Modulated signal:
– M(t)=I(t)*cos(2πfct)+Q(t)*sin (2πfct)



Demodulated signal:
– I’(t)=2*M(t)*cos(2πfct), Q’(t)=2*M(t)*sin(2πfct)
– I’(t) contains I(t) at baseband, as well as I(t) at 2fc and Q(t) at 4fc
– A LPF is required to extract I(t)

cos( 2π f1t )

cos( 2π f1t )

s1 ( t ) m (t )

LPF

m (t )

LPF

s 2 (t )

s 2 (t )

sin( 2π f1t )

sin( 2π f1t )

QAM modulator
© Yao Wang, 2004

s1 ( t )

QAM demodulator
Video Basics

58

Lowpass filter for Extracting QAM(I+Q)
Frequency response

Impulse response

Magnitude (dB)

50

0.16
0.14

0

0.12

-50

0.1

-100

0

2

4

6
8
Frequency (Hz)

10

12 x 10

5

0.08

P has e (degrees )

0

0.06

-200

0.04

-400

0.02

-600

0

-800

0

2

4

6
8
Frequency (Hz)

10

-0.02

12 x 10

5

0

5

10

15

20

25

f_LPF=0.2MHz; fir_length=20;
LPF=fir1(fir_length,f_LPF/(Fs/2));
© Yao Wang, 2004

Video Basics

59

QAM Demodulation: Waveform
Original I

Demodulated I

Demodulation+LP F I

60

60

40

40

40

20

20

20

0

Gray Level

80

Gray Level

80

60

Gray Level

80

0

0

-20

-20

-20

-40

-40

-40

-60

-60

-60

-80

0

0.5

1
Time

1.5 x 10

-4

-80

0

0.5

1
Time

1.5 x 10

I’(t)=2*M(t)*cos(2πfct)
© Yao Wang, 2004

Video Basics

-4

-80

0

0.5

1
Time

1.5 x 10

I’’(t)=conv(I’(t),LPF(t))
60

-4

QAM Demodultion: Spectrum
10

10

10

10

10

I S pectrum

6

10

5

10

4

10

3

10

2

0

5

10

10 x 10

© Yao Wang, 2004

Extracted I S pectrum w/o LP F

6

10

5

10

4

10

3

10

2

0

5

5

10

10 x 10

Video Basics

5

Extracted I S pectrum after LP F

6

5

4

3

2

0

5

10 x 10

61

5

original I

original Q

50

50

100

100

150

150

200

200
100

200

300

100

Recovered I

200

300

Recovered Q

50

50

100

100

150

150

200

200
100

© Yao Wang, 2004

200

300

100
Video Basics

200

300
62

Original color frame

Recovered color frame
© Yao Wang, 2004

Video Basics

63

Different Color TV Systems

Parameters

NTSC

PAL

SECAM

Field Rate (Hz)

59.95 (60)

50

50

Line Number/Frame

525

625

625

Line Rate (Line/s)

15,750

15,625

15,625

Color Coordinate

YIQ

YUV

YDbDr

Luminance Bandwidth (MHz)

4.2

5.0/5.5

6.0

Chrominance Bandwidth (MHz)

1.5(I)/0.5(Q)

1.3(U,V)

1.0 (U,V)

Color Subcarrier (MHz)

3.58

4.43

4.25(Db),4.41(Dr)

Color Modulation

QAM

QAM

FM

Audio Subcarrier

4.5

5.5/6.0

6.5

Total Bandwidth (MHz)

6.0

7.0/8.0

8.0

© Yao Wang, 2004

Video Basics

64

Who uses what?

From http://www.stjarnhimlen.se/tv/tv.html#worldwide_0
© Yao Wang, 2004

Video Basics

65

Digital Video
• Digital video by sampling/quantizing analog video raster BT.601 video
• Other digital video formats and their applications

© Yao Wang, 2004

Video Basics

66

Digitizing A Raster Video



Sample the raster waveform = Sample along the horizontal direction Sampling rate must be chosen properly
– For the samples to be aligned vertically, the sampling rate should be multiples of the line rate
– Horizontal sampling interval = vertical sampling interval
– Total sampling rate equal among different systems f s = 858 fl (NTSC) = 864 fl (PAL/SECAM) = 13.5 MHz

© Yao Wang, 2004

Video Basics

67

BT.601* Video Format

858 pels

864 pels

Active
Area

122 pel 16 pel 576 lines

720 pels
625 lines

480 lines

525 lines

720 pels

Active
Area

132 pel 525/60: 60 field/s

12 pel 625/50: 50 field/s

* BT.601 is formerly known as CCIR601
© Yao Wang, 2004

Video Basics

68

RGB YCbCr

Y_d = 0.257 R_d + 0.504 G_d + 0.098 B_d + 16,
C_b = -0.148 R_d - 0.291 G_d + 0.439 B_d + 128,
C_r = 0.439 R_d -0.368 G_d - 0.071 B_d + 128,
R_d = 1.164 Y_d’ + 0.0 C_b’+ 1.596 C_r’,
G_d = 1.164 Y_d’ - 0.392 C_b’ -0.813 C_r’,
B_d = 1.164 Y_d’ + 2.017 C_b’ + 0.0 C_r’,
Y_d’=Y_d -16, C_b’=C_b-128, C_r’=C_r-128

© Yao Wang, 2004

Video Basics

69

Chrominance Subsampling Formats

4:4:4
For every 2x2 Y Pixels
4 Cb & 4 Cr Pixel
(No subsampling)

4:2:2
For every 2x2 Y Pixels
2 Cb & 2 Cr Pixel
(Subsampling by 2:1 horizontally only)

4:1:1
For every 4x1 Y Pixels
1 Cb & 1 Cr Pixel
(Subsampling by 4:1 horizontally only)
Cb and Cr Pixel

Y Pixel

© Yao Wang, 2004

4:2:0
For every 2x2 Y Pixels
1 Cb & 1 Cr Pixel
(Subsampling by 2:1 both horizontally and vertically)

Video Basics

70

Digital Video Formats
Video Format

Frame Rate
(Hz)

Raw Data Rate
(Mbps)

H DTV Over air. cable, satellite, MPEG2 video, 20-45 Mbps
S MPTE296M
1280x720
4:2:0
SMPTE295M
1920x1080
4:2:0

24P/30P/60P
24P/30P/60I

265/332/664
597/746/746

Video production, MPEG2, 15-50 Mbps
BT.601
720x480/576
BT.601
720x480/576

60I/50I
60I/50I

249
166

High quality video distribution (DVD, SDTV), MPEG2, 4-10 Mbps
BT.601
720x480/576
4:2:0
60I/50I

124

Intermediate quality video distribution (VCD, WWW), MPEG1, 1.5 Mbps
SIF
352x240/288
4:2:0
30P/25P

30

Video conferencing over ISDN/Internet, H.261/H.263, 128-384 Kbps
CIF
352x288
4:2:0
30P

37

Video telephony over wired/wireless modem, H.263, 20-64 Kbps
QCIF
176x144
4:2:0
30P

9.1

© Yao Wang, 2004

Y Size

Color
Sampling

4:4:4
4:2:2

Video Basics

71

Video Terminology


Component video







Three color components stored/transmitted separately
Use either RGB or YIQ (YUV) coordinate
New digital video format (YCrCb)
Betacam (professional tape recorder) use this format

Composite video
– Convert RGB to YIQ (YUV)
– Multiplexing YIQ into a single signal
– Used in most consumer analog video devices



S-video
– Y and C (QAM of I and Q) are stored separately
– Used in high end consumer video devices



High end monitors can take input from all three

© Yao Wang, 2004

Video Basics

72

Homework
• Reading assignment:
– Chap. 1.

• Problems:









Prob. 1.5.
Prob. 1.6.
Prob. 1.7.
Prob. 1.8.
Prob. 1.9.
Prob. 1.10
Prob. 1.11
Prove mux/demux with QAM will get back the original two signals © Yao Wang, 2004

Video Basics

73

Similar Documents

Premium Essay

Video Conferencing

...Ex-MBA 2011-2014 Semester -1 Subject: Technology in Business ------------------------------------------------- VIDEO CONFERENCING – A BOON TO COMPANIES TO REDUCE COSTS, TIME AND SAVE OUR ENVIRONMENT Completed By, Shantesh Varik Roll No: 2011G14 INTRODUCTION – Aim and Objective Videoconferencing is a virtual conference like setup using a number of telecommunication technologies which allow two or more locations to interact via two-way video and audio transmissions simultaneously. Videoconferencing is slightly different from videophone calls as it is designed to serve a conference rather than individuals. In a tight economy, with companies spending much less on IT, the tech giants will take growth wherever they can find it. The Wall Street Journal reported recently that Cisco and HP are in a pitched battle for customers for their high-end teleconferencing systems. According to the report, it's "one of the few technologies that has benefited from the downturn, growing 30% from last year as businesses look to reduce travel expenses." Cisco, HP, Nortel, and telepresence-focused players like Teleris have developed impressive, beautiful systems that make you feel like you're in the same room with your colleagues. The catch is that not only will you save money, but you'll also reduce your environmental footprint through reduced travel. These companies are cashing in on the business world's pressing need to cut costs, while also appealing to the desire to get green...

Words: 4013 - Pages: 17

Free Essay

Student

...Video Conferencing Protocols Welcome to the TANDBERG University prerequisite Video Conferencing Protocols. Before commencing you are requested to ensure that you have completed the Introduction to the TANDBERG University eLearning Experience Module that is available through this portal. Video Conferencing Protocols @@MODULE @@MODULETITLE Lesson: Video Conferencing Protocols Learning Objectives On completion of this lesson, you will demonstrate an understanding of some of the protocols which are used in a video conference. You will know how to: Explain the difference between H.320, H.323 and SIP Explain bandwidth and it’s effect on video/audio quality and which standards are used in a call Describe the differences between G.711, G.722, G.722.1, G.728, and AAC-LD Explain the differences between H.261, H.263, H.264, QCIF, CIF, SIF, 4CIF, 4SIF, iCIF, iSIF, and HD slide 2 © TANDBERG Inc. Video Conferencing Protocols Page 2 Video Conferencing Protocols @@MODULE @@MODULETITLE Video Conferencing Protocols Circuit Switched Bandwidth is guaranteed Bandwidth is not shared On demand Information is in a single bit stream Packet Switched Bandwidth is not guaranteed Bandwidth is shared Circuits are built as needed and not available on demand Information is in packets slide 3 Video Conferencing Protocols Video conferencing can be run across two types of networks. These are called ‘Circuit Switched’ and Packet Switched’. Circuit...

Words: 4311 - Pages: 18

Free Essay

Document

...Applications (0975 – 8887) Volume 83 – No 9, December 2013 Real Time Traffic Density Count using Image Processing Naeem Abbas Muhammad Tayyab M.Tahir Qadri Sir Syed University of Engg & Technology University Road Karachi-75300, Pakistan Sir Syed University of Engg & Technology University Road Karachi-75300, Pakistan Sir Syed University of Engg & Technology University Road Karachi-75300, Pakistan ABSTRACT Due to the increase in the number of vehicles day by day, traffic congestions and traffic jams are very common. One method to overcome the traffic problem is to develop an intelligent traffic control system which is based on the measurement of traffic density on the road using real time video and image processing techniques. The theme is to control the traffic by determining the traffic density on each side of the road and control the traffic signal intelligently by using the density information. This paper presents the algorithm to determine the number of vehicles on the road. The density counting algorithm works by comparing the real time frame of live video by the reference image and by searching vehicles only in the region of interest (i.e., road area). The computed vehicle density can be compared with other direction of the traffic in order to control the traffic signal smartly. Keywords Traffic density count, image processing, intelligent controlling of traffic. 1. INTRODUCTION The number of vehicles on the road increases...

Words: 2431 - Pages: 10

Free Essay

Stereo Acoustic Perception Based on Real Time Video Acquisition

...ACOUSTIC VISION – Acoustic Perception Based On Real Time Video Acquisition for Navigation Assistance Supreeth K Rao#, Arpitha Prasad B*, Anushree R Shetty&, Chinmai$ , Rajeshwari Hegde@ #,*,&,, Department of Telecommunication Engineering, @ Guide and faculty BMS College of Engineering, Bangalore, India # supreethkrao@gmail.com arpithaprasad@gmail.com & anushree.shetty12@gmail.com $ cpchinmai@gmail.com * Abstract— A smart navigation system based on an object detection mechanism has been designed to detect the presence of obstacles that immediately impede the path, by means of real time video processing. This paper is discussed keeping in mind the navigation of the visually impaired. A video camera feeds images of the surroundings to a Da-Vinci Digital Media Processor, DM642, which works on the video, frame by frame. The processor carries out image processing techniques whose result contains information about the object in terms of image pixels. The algorithm aims to select that object, among all others, that poses maximum threat to the navigation. A database containing a total of three sounds is constructed. Hence, each image translates to a beep, where every beep informs the navigator of the obstacles directly in front of him. This paper implements a more efficient algorithm compared to its predecessor, NAVI. Keywords— Navigation, Edge Detection, Flood Function, Object Detection, DM642, Acoustic Transformation I. INTRODUCTION Assistance...

Words: 2605 - Pages: 11

Free Essay

Xperia U

...Xperia™ U ST25i, ST25a White paper February 2012 White paper | Xperia™ U Purpose of this document Sony mobile product White papers are intended to give an overview of a product and provide details in relevant areas of technology. Document history Version February 2012 First released version Version 1 Sony Developer World For the latest technical documentation and development tools, go to www.sonymobile.com/developer. This White paper is published by: Sony Ericsson Mobile Communications AB, SE-221 88 Lund, Sweden www.sonyericsson.com © Sony Ericsson Mobile Communications AB, 2009-2012. All rights reserved. You are hereby granted a license to download and/or print a copy of this document. Any rights not expressly granted herein are reserved. First released version (February 2012) Publication number: 1257-8163.1 This document is published by Sony Ericsson Mobile Communications AB, without any warranty*. Improvements and changes to this text necessitated by typographical errors, inaccuracies of current information or improvements to programs and/or equipment may be made by Sony Ericsson Mobile Communications AB at any time and without notice. Such changes will, however, be incorporated into new editions of this document. Printed versions are to be regarded as temporary reference copies only. *All implied warranties, including without limitation the implied warranties of merchantability or fitness for a particular purpose, are excluded. In no event shall...

Words: 3195 - Pages: 13

Free Essay

Video Conference

...challenges that video teleconferencing (VTC) can help them overcome. • Video conferencing is one technology that’s a smart investment, reducing your costs while making the most of the resources you have. • video conferencing can serve multiple purposes within a small business—from online meetings and presentations to conducting training and providing customer support. • Collaboration: Video conferencing solutions like Cisco WebEx let employees across your company share their expertise, resulting in more productive collaboration and faster decision-making. This increased productivity makes your company more efficient, further reducing costs • Increased communication: Staying in touch with partners, suppliers, and customers is vital to the success of any small business. By combining better video quality and clearer audio, video conferencing improves the overall experience customers and partners have with your company, giving you a competitive edge. • Educational Opportunities:There are always highly influential and accomplished people with your industry whom you can study or which team you want employees to master from. Most smaller businesses can’t afford to have these professionals arrived at their office for events, however they are able to take them in by having a video conference. • Contact people in your industry whom you feel you can practice a lot from or who may educate the workers, and have them if they could be ready to accept speaking through video conference using...

Words: 545 - Pages: 3

Free Essay

Instrucciones Gigaset Hd600T

...Índice Por su seguridad Instrucciones de seguridad 2 2 El Gigaset HD600 T ¿Qué es TDT? Gigaset HD600 T Funciones del mando a distancia Funciones del panel frontal Conexiones del panel trasero Funciones del panel lateral 4 4 4 6 9 9 10 Instalación del Gigaset HD600 T Preparar la instalación Seleccionar la antena Conectar dispositivos Diagrama de conexiones 11 11 11 12 13 Interfaz del menú Instalación por primera vez Menú de Configuración Menú DTV Menú AV IN (entrada de audio y vídeo) Menú Sincronizador de grabación Menú de navegación Menú copia de archivos Radio por Internet Menú IMS Actualización del firmware Guía electrónica de programación (EPG) de InOut TV 16 16 17 26 28 28 31 38 40 41 41 42 Anexo Especificaciones Preguntas más frecuentes Permiso Derechos de autor y marcas comerciales Garantía Declaración GPL Servicio Técnico (Servicio de Atención al Cliente) Certificado de garantía Condiciones generales de uso del servicio InOut TV 44 44 45 47 48 48 48 49 49 50 Glosario 51 1 Para su seguridad Lea detenidamente las instrucciones de seguridad antes de poner en marcha la unidad. Tenga en cuenta que algunas funciones descritas en estas instrucciones de uso no están disponibles en todas las versiones de software. Instrucciones de seguridad Instrucciones generales de seguridad Tenga a mano estas instrucciones de funcionamiento y entregue la unidad a otras personas solamente con las instrucciones y los accesorios suministrados...

Words: 13390 - Pages: 54

Free Essay

Causes of Loos of Audience and Sales in Media Outlets

...shows across the United States. Record music and movies in VHS format were also introduced to American homes. With the introduction of the digital format our telecommunications received a tremendous boost, and some of the early media outlets were replaced by more efficient ways of communication. This paper will describe some of the factors behind the recent loss of audience and sales in such media outlets as record music, movies, network TV, DVDs and video games. The introduction of the digital format changed the way we watch TV; high definition made possible to see a picture like never before, like if we were looking through a window. Digitalization allowed for a much better sound and picture quality in CDs and DVDs, which replaced the vinyl disc and the VHS tape. These media, however, continued to evolution so much so that in recent years media outlets such as newspapers, movies, network TV, DVDs and video games became obsolete. Digital is the key factor. Media outlets such as newspapers, movies, DVDs and video games are more tangible and cost more money to produce. These tangible versions of media are temporary, while digital is a permanent, more efficient way of getting and sharing the message. Media outlets such as newspapers and magazines are printed versions and cost more money to produce. They require tons of paper which is disposable and ends up in the trash, polluting the environment, and cannot be...

Words: 693 - Pages: 3

Free Essay

Mamanger Dont Travel

...Managers need not travel for Business In this world of advancement in technology we have reached a stage where we can communicate instantly. Advancements in communication technology with the developments in IT sector have led to a tremendous growth in virtual reality. As a matter of fact most of the IT systems are replacing traditional practices like maintaining large documents in offices. Everything is computerized But even today a lot of companies expect their managers to travel for Business meetings. Some of these meeting have an agenda of review of work which actually could be done through video conferences. Let us first understand why Business travels are being made. * Enjoyment - Many people love to travel and given enough time and resources, they would travel more. Enjoyment and the experience of being in another place are enough. * Keeping up with the trend - Behind the serious motive and purpose of business travel is the need to upgrade and keep up with the latest trends. And sometimes, by vacationing at a tourist spot can achieve just that. * Update information - Business meetings wherever it may be conducted also implies the exchange of information and business trends. When surrounded by contemporaries and colleagues, a businessperson can assess other possible ventures. * Achieving goals - Business is business. And as the saying goes, there is always a purpose for everything. And the fundamental purpose of a business meeting is either to impress...

Words: 1269 - Pages: 6

Free Essay

Jatropha Curcas

...STATEMENT OF UNDERSTANDING AND AGREEMENT FOR FASEB-MARC SELECTED SCIENTIFIC MEETINGS For acceptance of this travel award to a FASEB selected scientific meeting, please sign, date and fax this completed form to the FASEB MARC Program office at (301) 634-7353 To: From: Gail Pinder, FASEB MARC Program ____________________________________________________ Please print your name clearly Institution: __________________________________________________ Meeting Dates: ______________________________________________ _____________________________________________________________ Meeting/Conference Title RE: Acceptance of Selected Scientific Meeting Travel Award As indicated in the FASEB-MARC Travel Award letter, with my acceptance of the travel award to a Selected Scientific Meeting, I have read and accepted the FASEB-MARC Program “Rules of Reimbursement” and all conditions of the FASEB-MARC Travel Award Program. By signing below and enclosing a copy of my Social Security Card*, I am expressing my complete understanding and agreement with these conditions and terms. ____________________________________________________________ Signature of Travel Award Recipient Date   FASEB MARC PROGRAM PHOTO CONSENT FORM I, _______________________________________________________, consent Participant’s Name (Please Print) to be photographed and/or videotaped on behalf of the FASEB MARC Program. I consent to use of the content of the photograph and/or videotape (including my name, image, words and voice)...

Words: 265 - Pages: 2

Free Essay

Digital Video

...Video Digital Canon HDSLR 60D Sensibilidad ISO máxima Tamaño sensor Resolución sensor Montura óptica Máx. framerate Latitud Salidas vídeo 6400 APS-C 18 Mpix EF/EF-S 60 fps 8 stops miniHDMI 7D 6400 APS-C 18 Mpix EF/EF-S 60 fps 8 stops miniHDMI 6D 25600 Full Frame 20 Mpix EF 50 fps 8 stops miniHDMI 5D 25600 Full Frame 22 Mpix EF 50 fps 8 stops miniHDMI 1D 51200 Full Frame 18 Mpix EF 60 fps 12 stops miniHDMI Compuesto Formato grabación H.264 H.264 H.264 H.264 MJPEG H.264 Bitrate grabación Precio alquiler/hora 44Mbps 24€ 45.7Mbps 55€ 28 Mbps 59€ 38 Mbps 150€ 25 Mbps 295€ Canon C300, C500 C300 Sensibilidad ISO máxima Tamaño sensor Formato Imagen Captura Resolución sensor Montura óptica Latitud Salidas vídeo Salidas audio Entrada audio Formato grabación Bitrate grabación Precio alquiler/hora 20.000 Super 35mm 16:9 720p, 1080p 8 Mpix EF 12 stops HDSDI, SDI, HDMI Analógico 2ch 2x XLR-3 + Phantom MXF (MPEG-2) 50Mbps 215€ C500 20.000 Super 35mm 16:9 4K RAW, 2K RAW 8 Mpix EF 12 stops HDSDI, SDI, HDMI Analógico 2ch 2x XLR-3 + Phantom MXF (MPEG-2) 50Mbps 290€ Sony F65 Sensibilidad ISO máxima Tamaño sensor Formato Imagen Captura Max. Framerate Resolución sensor Montura óptica Latitud Salidas vídeo Formato grabación Bitrate grabación Precio alquiler/hora 800 Super 35mm 16:9 2K, 4K 120 fps 17,7 Mpix PL 14 stops HDSDI F65 RAW/SR Master 220-2400Mbps 890€ Arri Alexa Sensibilidad ISO máxima Tamaño sensor Formato...

Words: 1528 - Pages: 7

Free Essay

Instrucciones Trabajo Siemens

...* CONTABILIDAD * ------------------------------------------------- Caso Individual Siemens Publicado en: viernes 19 de abril de 2013 En referencia al caso individual Siemens, os cuelgo las preguntas sobre el mismo. * Análisis de la situación: Razones estratégicas del cambio a Prokasta * Cálculo de costes por el sistema tradicional (o pre-Prokasta) * Cálculo de costes por el sistema Prokasta. * Elementos críticos que aparecen al aplicar Prokasta * Conclusiones La idea es hacer un análisis de la aplicación del sistema de costes Prokasta y la repercusión que tiene desde todos los puntos de vista, estratégico, económico, etc. El caso ha de ser entregado antes del lunes 29 de abril a las 14:00 H (UTC/GMT +2) Es importante la puntualidad, porque empezaremos a tratar el caso siemens en el foro 14, con lo que el entregarlo tarde implicará que se ha empezado a hacer pública la solución del caso. El buzón se cerrará el lunes a las 14:15 h del lunes 29 de abril (por si los rezagados). El caso está en la documentación impresa del curso ------------------------------------------------- TECNOLOGÍA * Hola a todos. Como comentaba el viernes aquí van las instrucciones más detalladas para el trabajo final, siguiendo la línea de lo que explicaba el primer día, aunque reduciendo el tiempo – esfuerzo de preparación para que sea asequible para los grupos: - Cada grupo selecciona una tecnología que va a ser disruptiva para un sector. Se trata de complementar...

Words: 451 - Pages: 2

Premium Essay

Gfkajehf

...The chart below shows what you have to do to reach each level. |Level 7 | Enquiry using sources / Knowledge: | | |We have extensively researched this project and are able to confidently demonstrate our knowledge. We offer a complex | | |analysis of the key features of our chosen topic and are able to compare the story with other events in history and reach | | |substantiated conclusions. It is evident that we have used a variety of sources in researching our story. | | |Organisation & Communication: | | |Our presentation is innovative and of high quality. It uses language and historical terms precisely in a way which clearly | | |communicates complex ideas. It is a team effort. | |Level 6 | Enquiry using sources / Knowledge: | | |We have researched the project in some depth and are able to demonstrate that...

Words: 453 - Pages: 2

Free Essay

Google Glass

...be paired with a phone using the My Glass app to allow quick fiddling with settings and customisation. Navigation You'll be able to use Google Maps to get directions although as there is no built in GPS receiver you'll need to tether Glass to your smartphone. Several third party developers have announced apps for services including Evernote, Skitch and Path. Memory There's 16GB of flash memory built into the device, although only 12GB is currently available for user storage. The device will sync to your Google Drive, giving you both a place to stash your photos and video clips as well as a stash of documents and files you can call up from the cloud. Camera There is a 5 megapixel camera built-in to the frame that can also capture video at 720p resolution. Battery The rechargeable battery last for roughly a day, although that's with the standard "typical use" caveat, which probably excludes a lot of video capture or playback. Connection Bluetooth and WiFi will be built in, but there is no GPS chip - so the Glass will probably work best alongside an Android phone for full Google Maps functionality. You can however pair with any Bluetooth enabled phone and we would expect some support for iOS at least. Design Glass is designed to be lightweight and as unobtrusive as possible. The frame will come with adjustable pads for comfort, and is expected to be both light...

Words: 566 - Pages: 3

Free Essay

Sony Xperia Sola

...Press Release Xperia sola from Sony – the smartphone with a sense of magic  Introducing “floating touch” navigation for magic web browsing without touching the screen  Easily open apps and launch actions in an instant with NFC and Xperia SmartTags  Reality Display with Mobile Bravia engine and fast capture camera boosted by a powerful dual-core processor 13 March, London, United Kingdom – Sony Mobile Communications today announced Xperia™ sola* as the latest addition to its portfolio of Android powered Xperia smartphones. Complete with Sony technology, premium entertainment and innovative floating touchTM navigation, the NFC enabled Xperia sola comes equipped with Xperia SmartTags, allowing consumers to change their smartphone’s settings and applications to fit their lifestyle in an instant. Xperia sola will be available to consumers globally in black, white and red in the second quarter. A floating touch of magic Making its smartphone debut exclusively on Xperia sola, Sony’s unique floating touch lets consumers navigate the web by hovering their finger above the screen so it acts like a moving curser, without actually having to touch the screen. Once the desired link is found it can be highlighted and a simple tap will load the page. Floating touch will evolve with new user functionality and applications through software updates and engagement with developers. Calum MacDougall, Head of Xperia Marketing for Sony Mobile Communications...

Words: 1254 - Pages: 6