Hands-On Real Time Communications

Rolando Herrero, PhD, holds faculty appointments at Northeastern University, University of Massachusetts at Lowell, and Southern New Hampshire University, USA, and is Founder of Link 7 Technology Research (L7TR), a research and development company with a focus on real time communications and Internet of Things technologies.

• Preface xiAcronyms xvAbout the Companion Website xxiiPart I Theoretical Background 11 Media Generation 31.1 Introduction 31.2 Signals 41.2.1 Speech 41.2.2 Audio 41.2.3 Video 61.3 Sampling and Quantization 111.3.1 Sampling 121.3.2 Quantization 181.4 Codecs 211.4.1 Speech Coding 211.4.1.1 Waveform Codecs 261.4.1.2 LPC 311.4.1.3 LBR Codecs 351.4.1.4 ITU-T Recommendation G. 711 371.4.1.5 ITU-T Recommendation G. 726 401.4.1.6 ITU-T Recommendation G.723. 1 401.4.1.7 ITU-T Recommendation G.729 Annexes A, D, and E 411.4.1.8 GSM 6.10 411.4.1.9 AMR 411.4.1.10 ITU-T Recommendation G. 728 431.4.1.11 ITU-T Recommendation G. 722 431.4.1.12 iLBC 431.4.1.13 Speex 431.4.1.14 EVRC and EVRC-B 441.4.1.15 GSM-EFR 441.4.1.16 LPC- 10 441.4.1.17 AMR-WB/ITU-T Recommendation G.7. 2 441.4.1.18 RTAudio 451.4.1.19 EVS 451.4.1.20 Lyra 461.4.2 Audio Coding 461.4.2.1 AAC 491.4.2.2 ITU-T Recommendation G. 718 491.4.2.3 ITU-T Recommendation G.722. 1 501.4.2.4 iSAC 501.4.2.5 Silk 501.4.2.6 Opus 501.4.2.7 LC3 511.4.3 Video Coding 511.4.3.1 ITU-T Recommendation H. 261 611.4.3.2 ITU-T Recommendation H.262 (MPEG-2 Part 2) 621.4.3.3 ITU-T Recommendation H. 263 621.4.3.4 ITU-T Recommendation H.264 (MPEG-4 Part 10) 621.4.3.5 ITU-T Recommendation H. 265 631.4.3.6 ITU-T Recommendation H.266 (MPEG-I Part 3) 631.4.3.7 AU1 631.4.3.8 Theora 641.4.3.9 MPEG-5 Part 2 641.5 Quality Scores 641.5.1 Network Impairments 671.5.2 PESQ 711.5.3 POLAQ 731.6 Summary 731.7 Homework Problems and Questions 74Bibliography 752 Media Session Signaling 792.1 Introduction 792.2 Lower Layers 792.2.1 Physical and Link Layers 802.2.2 Network Layer 852.2.2.1 IPv 4 862.2.2.2 IPv 6 912.2.3 Transport Layer 962.2.3.1 UDP 962.2.3.2 TCP 972.3 SIP 1002.4 SDP 1052.5 HTTP 1052.6 Security Considerations 1102.6.1 Challenges and Requirements 1112.6.2 Principles of Network Security 1122.6.3 TLS and DTLS 1162.6.4 SIP over TLS 1192.7 Summary 1232.8 Homework Problems and Questions 123Bibliography 1243 Media Packetization 1273.1 Introduction 1273.2 RTP 1273.3 RTCP 1313.4 SRTP and SRTCP 1323.4.1 SDES 1353.4.2 DTLS-SRTP 1363.5 Framing 1373.5.1 Speech 1383.5.1.1 AMR and AMR-WB 1403.5.1.2 EVRC and EVRC-B 1433.5.1.3 EVS 1453.5.2 Audio 1483.5.2.1 AAC 1483.5.2.2 Opus 1493.5.3 Video 1503.5.3.1 ITU-T Recommendation H. 261 1503.5.3.2 ITU-T Recommendation H. 263 1513.5.3.3 ITU-T Recommendation H. 264 1543.5.3.4 ITU-T Recommendation H. 265 1563.5.3.5 ITU-T Recommendation H. 266 1573.6 Summary 1573.7 Homework Problems and Questions 158Bibliography 1594 Media over Network 1614.1 Introduction 1614.2 Non-3GPP Networks 1614.2.1 Ethernet 1624.2.2 IEEE 802.11 1654.2.3 RTC 1734.2.4 WebRTC 1734.3 3GPP 4g/5g/6g 1744.3.1 IMS 1754.3.2 VoLTE 1754.3.3 VoNR 1774.4 IoT 1804.4.1 WPANs 1834.4.1.1 IEEE 802.15.4 1844.4.1.2 6LoWPAN 1894.4.2 LPWANs 2044.4.2.1 LoRa 2054.5 Putting All Together 2084.6 Summary 2094.7 Homework Problems and Questions 210Bibliography 211Part II Building Topologies 2155 Non-3GPP Networks 2175.1 Introduction 2175.1.1 Netualizer 2175.1.2 Wireshark 2235.2 Lower Layers 2245.2.1 Physical and Link Layers 2245.2.2 Network Layers 2295.2.3 Impairments 2345.2.4 Transport Layers 2385.2.4.1 UDP 2385.2.5 TCP 2415.3 RTC 2465.3.1 SIP and RTP 2475.3.2 Secure RTC 2615.3.3 TLS 2615.3.4 DTLS 2665.3.5 SRTP 2695.4 Codecs 2745.5 Summary 2765.6 Homework Problems and Questions 2775.7 Lab Exercises 278Bibliography 2786 3GPP Networks 2816.1 Introduction 2816.2 Lower Layers 2826.2.1 Physical/Link 2826.2.2 Network/Transport 2846.3 VoLTE 2926.3.1 Speech 2926.3.2 Audio and Video 2956.4 Summary 3006.5 Homework Problems and Questions 3016.6 Lab Exercises 302Bibliography 3037 IoT Networks 3057.1 Introduction 3057.2 WPAN 3057.2.1 Physical and Link Layers 3067.2.2 Network Layer 3097.2.3 Transport Layer 3187.2.4 WPAN Rtc 3237.3 LPWAN 3247.3.1 Physical and Link Layers 3247.3.2 Network Layer 3277.3.3 Transport Layer 3347.3.4 LPWAN RTC 3397.4 Summary 3407.5 Homework Problems and Questions 3407.6 Lab Exercises 341Bibliography 342Index 345