Fundamentals and Evolution of MPEG-2 Systems E-Book

Jan Van der Meer

• Herausgeber: John Wiley & Sons
• Kategorie: Wissenschaft und neue Technologien
• Sprache: Englisch

Seitenzahl: 914

Veröffentlichungsjahr: 2014

Beschreibung

This book describes the fundamentals and details of MPEG-2 Systems technology

Written by an expert in the field, this book examines the MPEG-2 system specification as developed in the early 1990’s, as well as its evolution into the fourth edition of the MPEG-2 systems standard, published in 2013. While MPEG-2 systems will continue to evolve further, this book describes the MPEG-2 system functionality as of October 2013. Furthermore, relevant background information is provided. The discussion of MPEG-2 system functionality requires knowledge of various fundamental issues, such as timing, and supported content formats. Therefore also some basic information on video and audio coding is provided, including their evolution. Also other content formats supported in MPEG-2 systems are described, as far as needed to understand MPEG-2 systems.

• Ordered logically working from the basics and background through to the details and fundamentals of MPEG-2 transport streams and program streams
• Explores important issues within the standardization process itself
• Puts the developments on MPEG-2 systems into historic perspective
• Includes support of 3D Video and transport of AVC, SVC and MVC
• Concludes with additional issues such as real-time interface, delivery over IP networks and usage by application standardization bodies
• Predicts a continuing promising future for MPEG-2 transport streams

Leseprobe

CONTENTS

Cover

Title Page

Copyright

Foreword

Preface

About the Author

Acknowledgements

Part One: Backgrounds of MPEG-2 Systems

Chapter 1: Introduction

1.1 The Scope of This Book

1.2 Some Definitions

References

Chapter 2: Technology Developments Around 1990

References

Chapter 3: Developments in Audio and Video Coding in MPEG

3.1 The Need for Compression

3.2 MPEG Video

3.3 MPEG Audio

References

Chapter 4: Other Important Content Formats

4.1 Metadata

4.2 Timed Text

4.3 Lossless and Scalable Lossless Audio

4.4 Multiview Video

4.5 3D Video

References

Chapter 5: Motivation for a Systems Standard

Chapter 6: Principles Underlying the MPEG-2 Systems Design

6.1 Building an End-to-End System

6.2 The Multiplex and Demultiplex Operation

6.3 Delivery Schedule of MPEG System Streams

6.4 Synchronization of Audio and Video

6.5 MPEG-2 System Streams and the STD Model

6.6 Timing Issues

6.7 Quality of Service Issues

6.8 Transport Layer Independence

References

Chapter 7: MPEG-1 Systems: Laying the MPEG-2 Foundation

7.1 Driving Forces

7.2 Objectives and Requirements

7.3 Structure of MPEG-1 System Streams

7.4 The MPEG-1 System Target Decoder

7.5 The MPEG-1 System Stream

7.6 MPEG-1 Applications

7.7 Conclusions on MPEG-1

References

Part Two: The MPEG-2 Systems Standard

Chapter 8: The Development of MPEG-2 Systems

8.1 Driving Forces

8.2 Objectives and Requirements

8.3 The Evolution of MPEG-2 Systems

References

Chapter 9: Layering in MPEG-2 Systems

9.1 Need for Program Streams and Transport Streams

9.2 PES Packets as a Common Layer

9.3 Program Streams

9.4 Transport Streams

References

Chapter 10: Conditional Access and Scrambling

10.1 Support of Conditional Access Systems

10.2 Scrambling in Transport Streams

10.3 Improving the Interoperability between CA Systems

10.4 Scrambling in Program Streams

Reference

Chapter 11: Other Features of MPEG-2 Systems

11.1 Error Resiliency

11.2 Re-Multiplexing of Transport Streams

11.3 Local Program Insertion in Transport Streams

11.4 Splicing in Transport Streams

11.5 Variable Bitrate and Statistical Multiplexing

11.6 Padding and Stuffing

11.7 Random Access and Parsing Convenience

11.8 Carriage of Private Data

11.9 Copyright and Copy Control Support

11.10 Playback Trick Modes

11.11 Single Program and Partial Transport Streams

11.12 Program Stream Carriage within a Transport Stream

11.13 PES Streams

11.14 Room for Future Extensions

References

Chapter 12: The MPEG-2 System Target Decoder Model

12.1 Introduction to the MPEG-2 STD

12.2 The Program Stream STD: P-STD

12.3 Transport Stream STD: T-STD

12.4 General STD Constraints and Requirements

12.5 Content Format Specific STD Issues

Chapter 13: Data Structure and Design Considerations

13.1 System Time Clock Samples and Time Stamps

13.2 PES Packets

13.3 Descriptors of Programs and Program Elements

13.4 Program Streams

13.5 Sections

13.6 Transport Streams and Transport Packets

Reference

Chapter 14: Content Support in MPEG-2 Systems

14.1 Introduction

14.2 MPEG-1

14.3 MPEG-2

14.4 (ITU-T Rec.) H.222.1

14.5 MHEG

14.6 MPEG-4

14.7 AVC

14.8 SVC

14.9 3D Video

14.10 JPEG 2000 Video

14.11 Metadata

14.12 Overview of Assigned Stream-type Values

References

Chapter 15: The Real-Time Interface for Transport Streams

Reference

Chapter 16: Relationship to Download and Streaming Over IP

16.1 IP Networks and MPEG-2 Systems

16.2 Streaming Over IP

16.3 Download

16.4 Carriage of MPEG-2 Systems Across IP Networks

16.5 Adaptive HTTP Streaming

References

Chapter 17: MPEG-2 System Applications

Chapter 18: The Future of MPEG-2 Systems

Reference

Epilogue

Annexes

Index

End User License Agreement

List of Tables

Table 3.1

Table 3.2

Table 7.1

Table 7.2

Table 7.3

Table 8.1

Table 8.2

Table 8.3

Table 9.1

Table 9.2

Table 9.3

Table 9.4

Table 11.1

Table 11.2

Table 12.1

Table 13.1

Table 13.2

Table 13.3

Table 13.4

Table 13.5

Table 13.6

Table 13.7

Table 14.1

Table 14.2

Table 14.3

Table 14.4

Table 14.5

Table 14.6

Table 14.7

Table 14.8

Table 14.9

Table 14.10

Table 14.11

Table 14.12

Table 14.13

Table 14.14

Table 14.15

Table 14.16

Table 14.17

Table 14.18

Table 14.19

Table 14.20

Table 14.21

Table 14.22

Table 14.23

Table 14.24

Table 14.25

Table 14.26

Table 14.27

Table 14.28

Table 14.29

Table 14.30

List of Illustrations

Figure 1.1

Figure 1.2

Figure 3.1

Figure 3.2

Figure 3.3

Figure 3.4

Figure 3.5

Figure 3.6

Figure 3.7

Figure 3.8

Figure 3.9

Figure 3.10

Figure 3.11

Figure 3.12

Figure 3.13

Figure 3.14

Figure 3.15

Figure 3.16

Figure 3.17

Figure 3.18

Figure 3.19

Figure 3.20

Figure 3.21

Figure 3.22

Figure 3.23

Figure 3.24

Figure 3.25

Figure 3.26

Figure 3.27

Figure 3.28

Figure 3.29

Figure 3.30

Figure 3.31

Figure 3.32

Figure 3.33

Figure 3.34

Figure 4.1

Figure 4.2

Figure 4.3

Figure 4.4

Figure 4.5

Figure 4.6

Figure 4.7

Figure 4.8

Figure 4.9

Figure 4.10

Figure 4.11

Figure 5.1

Figure 6.1

Figure 6.2

Figure 6.3

Figure 6.4

Figure 6.5

Figure 6.6

Figure 6.7

Figure 6.8

Figure 6.9

Figure 6.10

Figure 6.11

Figure 6.12

Figure 6.13

Figure 6.14

Figure 6.15

Figure 6.16

Figure 6.17

Figure 6.18

Figure 6.19

Figure 6.20

Figure 6.21

Figure 6.22

Figure 6.23

Figure 6.24

Figure 6.25

Figure 6.26

Figure 6.27

Figure 7.1

Figure 7.2

Figure 7.3

Figure 7.4

Figure 7.5

Figure 7.6

Figure 7.7

Figure 7.8

Figure 7.9

Figure 7.10

Figure 7.11

Figure 7.12

Figure 7.13

Figure 7.14

Figure 7.15

Figure 7.16

Figure 7.17

Figure 7.18

Figure 7.19

Figure 7.20

Figure 8.1

Figure 8.2

Figure 9.1

Figure 9.2

Figure 9.3

Figure 9.4

Figure 9.5

Figure 9.6

Figure 9.7

Figure 9.8

Figure 9.9

Figure 9.10

Figure 9.11

Figure 9.12

Figure 9.13

Figure 9.14

Figure 9.15

Figure 9.16

Figure 9.17

Figure 9.18

Figure 10.1

Figure 10.2

Figure 10.3

Figure 10.4

Figure 10.5

Figure 11.1

Figure 11.2

Figure 11.3

Figure 11.4

Figure 11.5

Figure 11.6

Figure 11.7

Figure 11.8

Figure 11.9

Figure 11.10

Figure 11.11

Figure 11.12

Figure 11.13

Figure 12.1

Figure 12.2

Figure 12.3

Figure 12.4

Figure 12.5

Figure 12.6

Figure 12.7

Figure 12.8

Figure 12.9

Figure 12.10

Figure 12.11

Figure 12.12

Figure 12.13

Figure 12.14

Figure 12.15

Figure 12.16

Figure 12.17

Figure 13.1

Figure 13.2

Figure 13.3

Figure 13.4

Figure 13.5

Figure 13.6

Figure 13.7

Figure 13.8

Figure 13.9

Figure 13.10

Figure 13.11

Figure 13.12

Figure 13.13

Figure 13.14

Figure 13.15

Figure 13.16

Figure 13.17

Figure 13.18

Figure 13.19

Figure 13.20

Figure 13.21

Figure 13.22

Figure 13.23

Figure 13.24

Figure 14.1

Figure 14.2

Figure 14.3

Figure 14.4

Figure 14.5

Figure 14.6

Figure 14.7

Figure 14.8

Figure 14.9

Figure 14.10

Figure 14.11

Figure 14.12

Figure 14.13

Figure 14.14

Figure 14.15

Figure 14.16

Figure 14.17

Figure 14.18

Figure 14.19

Figure 14.20

Figure 14.21

Figure 14.22

Figure 14.23

Figure 14.24

Figure 14.25

Figure 14.26

Figure 14.27

Figure 15.1

Figure 15.2

Figure 15.3

Figure 15.4

Figure 16.1

Figure 18.1

Figure 18.2

Figure 18.3

Figure 18.4

Guide

Cover

Table of Contents

Foreword

Part 1

Chapter 1

Pages

ii

iv

xi

xii

xiii

xiv

xv

xvi

xvii

xviii

xix

xx

xxi

xxii

xxiii

xxiv

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

333

334

335

336

337

338

339

340

341

342

343

344

345

346

347

348

349

350

351

352

353

354

355

356

357

358

359

360

361

362

363

364

365

366

367

368

369

370

371

372

373

374

375

376

377

378

379

380

381

382

383

384

385

386

387

388

389

390

391

392

393

394

395

396

397

398

399

400

401

402

403

404

405

406

407

408

409

410

411

412

413

414

415

416

417

418

419

420

421

422

423

424

425

426

427

428

429

430

431

432

433

434

435

436

437

438

439

440

Fundamentals and Evolution of MPEG-2 Systems

Paving the MPEG Road

Jan van der Meer

Senior Consultant, Jan van der Meer Consultancy, The Netherlands

This edition first published 2014

© 2014 John Wiley & Sons, Ltd

Registered office

John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, United Kingdom

For details of our global editorial offices, for customer services and for information about how to apply for permission to reuse the copyright material in this book please see our website at www.wiley.com.

The right of the author to be identified as the author of this work has been asserted in accordance with the Copyright, Designs and Patents Act 1988.

All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, except as permitted by the UK Copyright, Designs and Patents Act 1988, without the prior permission of the publisher.

Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic books.

Designations used by companies to distinguish their products are often claimed as trademarks. All brand names and product names used in this book are trade names, service marks, trademarks or registered trademarks of their respective owners. The publisher is not associated with any product or vendor mentioned in this book.

Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. It is sold on the understanding that the publisher is not engaged in rendering professional services and neither the publisher nor the author shall be liable for damages arising herefrom. If professional advice or other expert assistance is required, the services of a competent professional should be sought.

Library of Congress Cataloging-in-Publication Data applied for.

ISBN: 9780470974339

Foreword

Why do we need a book on MPEG Systems? The MPEG-2 Systems standard has been around since 1994 and is already widely deployed. Surely everyone who needs to know about it already know enough? Has it not been covered elsewhere? And is it not just a syntax of packets and time stamps? In fact, MPEG-2 Systems – the standard and designs that implement it – is significantly more involved than it first appears and there is widespread misunderstanding of some key aspects. Just as importantly, the theory, history, practice and applications are quite interesting, as this book shows. Jan van der Meer's book Fundamentals and Evolution of MPEG-2 Systems is the first to comprehensively and correctly explain what the MPEG-2 Systems standard is, how it works, why it works the way it does, how it relates to key video and audio standards, and the information you need to know in order to ensure that systems based on the standard perform robustly as expected. It also includes some interesting bits of history of the standard, including humorous anecdotes.

The MPEG-2 Systems standard, despite being nearly 20 years old, has succeeded wildly, with major growth in applications occurring particularly since 2000. Data from IHS quoted in the book shows that, for example, in 2014 alone over 600 million DTVs, set top boxes, BluRay and DVD disc players using MPEG-2 Systems are expected to be shipped, and that does not include the vast numbers of tablets, phones and PCs that also support MPEG-2 Systems for streaming. The MPEG-2 Systems standard has maintained its place as the systems layer for carrying video and audio, as the applications for it and the compression standards that work with it have continued to evolve. Its genesis was MPEG-1 Systems, which targeted video and audio on CDs, and the principles embodied in MPEG-1 Systems were carried over to MPEG-2 Systems. The latter was originally specified for use with MPEG-2 video and MPEG audio in both the Program Stream format targeting optical discs (DVD) and software based parsing applications and the MPEG Transport Stream format, which addressed the needs of digital terrestrial broadcasting, cable television and direct broadcast satellite. Many competing companies came together to develop, agree on, implement and promote this and related standards, kick-starting the massive revolution to digital video and audio via a range of media types. As new video and audio compression standards have been created since 1994, each gradually supplanting the ones that came before it, the MPEG-2 Systems standard has needed only minor additions to accommodate the new audio and video standards, and it has stayed with us. In addition to its use in broadcast environments, MPEG Systems is used in some popular streaming formats as well as infrastructure. The author predicts, with good reason, that it will continue to be widely used for the foreseeable future.

This book includes a suitable background of the topic of compressed video and audio, and a detailed explanation of the standard itself and in particular, what the standard really means, and how it applies in practice. For example, the System Target Decoder (STD) is not a ‘standard’ decoder, is not an optional part of the standard, and it is not something that one can choose to implement (or not implement). Rather, it is a minimal abstract model of an idealized hypothetical decoder that serves as a constraint on all valid MPEG Systems streams, incorporating both the unified transport, decoding and presentation timing model of the MPEG Systems standard and buffer models, with rules regarding overflow and underflow of the buffer models. If a stream fails a STD test, it is not a conforming stream, so decoder designers can rely on conforming streams always passing the STD test. The book includes an extensive set of figures illustrating buffer and buffer model fullness under a wide range of conditions.

Jan van der Meer is exceptionally well qualified to write this book. He was active in the MPEG Systems committee since its inception and remained active in it for many years. He contributed a great deal of clarity to the committee discussions and documentation and was a frequent source of ideas. As I chaired the committee through the development of the MPEG-1 and MPEG-2 Systems standards, Jan's presence, participation, clarity and humour were all invaluable in enabling the group to produce such a high quality standard. Jan's knowledge extends well beyond this standard, encompassing a wide range of related topics, as you will find evident from reading this book. Even if you are already quite familiar with the MPEG-2 Systems standard, I am confident that you will find many refreshing insights in his detailed and clever writing. I hope you enjoy it as much as I did.

Alexander (Sandy) MacInnis,November 2013

Preface

My first name is Jan, the Dutch version of John, nothing special. My last name is van der Meer, which, with some fantasy, means ‘from the Lake’. Again, nothing special, although I was born indeed very close to one of the various lakes in the north of the Netherlands, in an area considered by many Dutch people as one of the most backward regions in the Netherlands, though most of them never visited it. In fact, it is of course one of the most beautiful places in the world. Some may still recognize my origin from my articulation, as I refused to polish it; by no means do I wish to suggest coming from an unidentified region. Anyway, due to a lot of coincidences and some good reasons described elsewhere in this book, I got deeply involved in MPEG. That was special.

It is July 2007, MPEG is having its 81st meeting in Lausanne, Switzerland. I attend again, and it is a special meeting for me, not because it is the 58th MPEG meeting that I attend, but because it will be my last one. During 18 years I came to most MPEG meetings, starting with the eighth MPEG meeting in 1989. I witnessed the standardization of MPEG-1, MPEG-2, MPEG-4 and other MPEG standards. Though my initial focus was on video coding, most of my work was on MPEG-2 systems, addressing issues such as transport and synchronization of coded audio and video. Personally I am not a truly dedicated scientist, but more interested in making things work and less in the scientific considerations, though it is important to understand those.

After Sandy MacInnis's very successful chairmanship of the MPEG Systems group from 1990 to 1994, during which the MPEG-1 and MPEG-2 system standards were developed, I became MPEG Systems chair for 2 years, mainly to complete the Compliance and the Real-Time Interface specifications for MPEG-2 systems. In 1996 the main focus of MPEG moved to MPEG-4; at that time the company that I worked for, Philips, was not yet interested in MPEG-4 from a business perspective, and therefore I stopped attending every MPEG meeting, leaving the regular Philips representation to experts from Philips Research. Chairmanship of the MPEG Systems was taken over by Olivier Avaro, at that time working for France Telecom. To keep track of MPEG developments I attended one MPEG meeting in 1997, but in 1998, Philips recognized potential business in MPEG-4 technology and I was asked to attend MPEG regularly, which I continued until 2007.

Prior to attending my last MPEG meeting in Lausanne in July 2007, I informed Olivier Avaro, at that time still the MPEG Systems chair, that Lausanne was to be my last MPEG meeting. Olivier responded very disappointedly, in particular because I was one of the last MPEG-2 Systems experts still active in MPEG. During the MPEG-2 Systems development often over 100 experts attended the MPEG System meetings, but after its completion that number reduced in a significant manner.

Olivier expressed his concern that in MPEG the expertise in MPEG-2 System technology was decreasing to a level that may soon become critical, and that this may become a problem when in future MPEG-2 Systems needs to be extended, for example to support new audio and video coding specifications. Of course, I agreed with Olivier that in-depth knowledge of MPEG-2 Systems is essential for those extending the MPEG-2 Systems standard in future. Nevertheless, I explained to Olivier that it may not be good for MPEG, but that the Lausanne meeting really was to be my last one. ‘Well, OK’, Olivier said, ‘but if that will be your last meeting indeed, then why don't you write a book on MPEG-2 Systems to document your expertise?’

Well, writing a book on MPEG-2 systems was already one of my popular thoughts at the time MPEG-2 systems was finished, but I was overwhelmed by other activities, as usual, and I was not the only one. A book with a comprehensive review of MPEG-2 systems still did not exist. Therefore it seems to make sense, even almost 20 years after the standardization of MPEG-2 systems, to write a book to describe the fundamentals and evolution of MPEG-2 Systems technology, and to provide the background on how and why MPEG-2 Systems became what is.

After my full retirement from Philips in 2008 I had time available and decided to work on what became this book, but the start was slow. It took until the second half of 2009 to become more productive. My desire to write a book that is accessible to people with technical expertise, not only to MPEG system experts, required the drawing of many figures. Quite a few figures needed several days of drawing, changing and changing again, and when further progress was made, sometimes the very painful conclusion was reached that another figure was needed instead.

Moreover, I wanted the book to not only explain the issues that the MPEG-2 system experts needed to resolve, but also to express how much fun it was to jointly resolve these issues. But how to explain fun…? I guess people understand it is fun to write an e-mail like the one below to a MPEG-4 systems guru, who insisted that for usage of MPEG-4 technology in an MPEG-2 environment, important data structures, such as PES packets, needed to be replaced by an incompatible MPEG-4 equivalent, which means that MPEG-4 cannot be used in already existing MPEG-2 system-based applications. In an earlier e-mail I had already stated that adoption of new technology is often by building on other successful technology, rather than from scratch.

I like your comparison. MPEG-2 a car and MPEG-4 an airplane. Quite some time ago someone told me that MPEG-4 was about a flying submarine, but that was a bad joke of course. Anyhow, airplanes fly in general. And at this very moment I travel in one and I must say, I like it far above the clouds. But back home I have to live again with my old-fashioned car. Which does a reasonable job by the way, as does MPEG-2.

What I learned since I left MPEG (for the second time) was that meanwhile MPEG-4 did develop nice technology, that could be very useful in my old-fashioned MPEG-2 car. Let's say it won't let my car fly, but I would be able to navigate a lot better. But of course I would like to use the new technology in a cost-effective way as I cannot afford the costs that may be acceptable for airplanes. So I am looking for a good way to integrate. That means that I have to extend the specification of my car (13818-1) as well as the ‘safety procedure’ of using the car (STD model). I hope you don't object. Of course I agree with you that my car won't fly, but still I can travel conveniently and with the new technology a lot safer. And with respect to the risk of using the new tools, I understood that they are verified extensively, so that I can apply them without risk.

At that time several MPEG-4 system people were very passionate about their design and positioned it as the only viable system for the future; and they therefore objected to compromising this approach for the ‘simple purpose’ of adding value to MPEG-2 system applications.

But emails are typically not very suitable to include in a book. Fortunately I met Chad Fogg when invited to attend the 100th meeting of MPEG in Geneva, in April 2012. Chad is famous in the MPEG community, not only for his expertise, but also for the jokes he regularly makes by producing MPEG quizzes, all kind of top-10 s and other funny stuff usually related to ongoing work in MPEG. Seeing Chad again did trigger the idea to include some of his material in the book, where appropriate. I was very pleased when Chad not only agreed with this proposal, but also to write the Epilogue of this book. As only a very limited subset of Chad's material was suitable, below a few examples are provided that remained unused.

e-mail Chad Fogg, 22 November 1994

Subject:

Top 10 Punishments for Delinquent MPEG Delegates

Nr 9.

Crime: Sleeping during plenary session

Punishment:Being woken up during plenary session

Nr 1.

Crime: Laughing while saying the word “MPEG-4”

Punishment: […well, none, really…]

While initially several jokes were made about MPEG-4, it should be noted that the MPEG-4 work item produced many very successful standards, for example on audio and video coding and on file formats.

e-mail Chad Fogg, 1 April 1995

Subject:

Top 10 Resolutions of the Lausanne Meeting

Nr 7.

WG11 approves conclusions of Ad-Hoc group investigation that the D-video tape recorder operates more efficiently when plugged in.

Nr 5.

WG11 establishes liasonship with ski slopes to investigate ‘frozen syntax’ (Convenor notes observation by Swedish Head of Delegation, that like MPEG, water actually expands after freezing).

During the standardization process the draft specification is ‘frozen’, which means that no new technology is adopted, unless to repair a broken issue.

e-mail Chad Fogg, 30 October 1998

Subject:

Leonardo's Top 10 Pet Peeves

Nr 9.

Clinton gets interns, I have SC29.

A common experience when being retired is that it is hard to imagine you ever had time to work. Which explains why for writing this book I could only spend about 30% of my time. But also much more research was needed than originally anticipated; the writing of a book requires more than ‘a rough idea’ of the solution to a problem: you better be sure. Given that, I hugely underestimated the job; writing this book took about 4 years.

Describing MPEG-2 system technology was a challenge, but doable, though a mistake is easily made. Predicting the future is way more risky, in particular when you are no longer as deeply involved in the networks associated with MPEG-2 systems as you used to be. On the other hand, looking to developments from a certain distance also has advantages: it may provide a fresh view. Nevertheless, for the final chapter on the future of MPEG-2 systems I prepared a kind of disclaimer:

But always keep in mind the statement similar to the one already made back in the 17th century by Mr. Renè Descartes, a French philosopher, mathematician and writer, who spent most of his adult life in the Dutch Republic: “the only thing to be sure of is doubt”.

However, then I got a very positive response from the market research company IHS, who kindly provided market information on MPEG-2 system based products, not only on the past, but also on predictions for the future. This extremely valuable information provided a much firmer basis for statements on the MPEG-2 system future, so that the above disclaimer was no longer needed.

Finally, a major encouragement was provided by the National Academy of Television Arts and Sciences in New York, when MPEG was honoured with a prestigious 2013 Emmy Award for the development and standardization of MPEG-2 transport streams. This Technology and Engineering Emmy Award provides a great acknowledgement of the tremendous impact on the content distribution industry in general and on the television industry in particular of the work performed by the MPEG-2 system experts.

Jan van der Meer,October 2013

About the Author

Jan van der Meer was born in 1947 in Burgum, a small village in the province of Fryslân in the north of the Netherlands. He received his MS in Electronic Engineering in 1978 from the University of Twente in the Netherlands. Jan has broad interests; during his study he investigated macro-economic options to improve employment by reducing labour charges and at the same time increasing value-added tax, which resulted in two published papers. But Jan decided to pursue a career in electronic engineering by joining Philips in 1979, where he became (co-)inventor of 12 patents.

Throughout his career within Philips, Jan's task has been to interface between Research and Product Development, with the objective to make new technology from Research suitable for products. From this perspective, Jan has been involved in the creation of a series of standards and products for Optical Media, Broadcast, Mobile and Internet.

Jan played a leading role in the MPEG standards committee almost from its very beginning and contributed not only to the development of the MPEG-1, MPEG-2 and MPEG-4 standards, but also to their usage in specific application areas, such as specified by 3GPP, DAVIC, DVB, IETF and ISMA. Jan is acknowledged worldwide for his contributions to MPEG and other standard bodies.

The following lists the most important activities in which Jan has been involved.

In the early and mid-1980s, Jan developed various consumer product prototypes such as a (hand held) electronic translator, a video editor for VCRs and Camcorders and a Picture in Picture feature to extend TV sets; the latter included the development of an IC.

The HDMAC System, the analogue High Definition TV System that was developed in Europe in the late 1980s, jointly with other companies and broadcasters in the European Community, in the context of a European Project. Here, Jan initially worked with Philips Research to develop what became the HDMAC coding algorithm, followed by the development of prototype hardware for demonstration purposes and ICs for Philips HDMAC products.

In 1989, Jan became Manager of the so called Full Motion Video (FMV) Project with the objective to store movies and video clips on a Compact Disc. During this project, he became involved in MPEG, upon which Jan became the FMV System Architect, keeping track of ongoing product development on one hand and MPEG standardization on the other. The results of this project were the FMV extension for CD-I players (implemented on a cartridge) and the Video CD standard that has been very successful in the Far East.

Around 1993, Jan moved to the TV Group within Philips Consumer Electronics, where he became involved in the development of Digital Broadcast Products. He was involved in defining the architecture of digital TV Set Top Boxes and in the design of ICs for such STBs. Meanwhile he represented Philips in MPEG, where he chaired the MPEG Systems Group from 1994 until 1996 during the completion of the MPEG-2 System standard.

With a few short interruptions, Jan continued to represent Philips in MPEG until 2007. After chairing the MPEG Systems Group, he became (co-)editor of various MPEG-2 System amendments, such as:

Transport over MPEG-2 Systems of MPEG-4 streams;

Transport over MPEG-2 Systems of Metadata and MPEG-7 streams;

Transport over MPEG-2 Systems of AVC (H.264/MPEG-4 part 10) streams.

In MPEG, Jan was furthermore editor of MPEG-4 part 17 on streaming text.

From the mid-1990s onwards, Jan discussed, promoted and defined the use of MPEG technologies in a large variety of standardization bodies, such as:

DVB, the Digital Video Broadcasting organization in charge of defining specifications for digital broadcast services. Jan represented Philips in DVB on issues related to coding of audio and video and on subtitling from 1994 until 2007.

DAVIC, a consortium to develop a complete End-to-End System for Video on Demand services. In DAVIC, Jan chaired the group in charge of defining functionalities that DAVIC compliant STBs are required to support.

UK DTG, the Digital Television Group in the UK in charge of defining the Digital Broadcast System for the UK; here Jan successfully promoted the use of MHEG-5 as an API.

W3C, the World Wide Web Consortium; from 1997 until Philip's withdrawal from W3C in 2003, Jan represented Philips in the Advisory Committee of W3C.

IETF, the Internet Engineering Task Force. Within the Audio and Video Transport (AVT) group in IETF, Jan got involved in transport of MPEG-4 streams over IP; he became editor of RFC 3640, which became later the basis for the ISMACryp specification.

3GPP, where Jan promoted the use of MPEG-4 audio and video coding technology for use in mobile applications.

ISMA, the Internet Streaming Media Alliance, in charge of defining End-to-End systems for Streaming of Audio and Video over IP, where Jan represented Philips from 2001 until 2008.

MPEGIF, the MPEG Industry Forum, in charge of promoting the use of MPEG technology; Jan was a member of the MPEGIF Board of Directors from 2003 until 2007.

In 2002 and 2003, Jan got involved in licensing discussions on AVC (a.k.a. H.264 and MPEG-4 part 10) to provide ‘market feedback’ on licensing terms, upon which he joined in 2003 the Intellectual Property and Standardization (IP&S) department in Philips, where he was Director Standardization until 1 July 2008.

Within IP&S, Jan managed various research projects in Philips related to coding of audio and video.

From June 2004 to June 2008, Jan chaired the OMA DRM WG, the Working Group in the Open Mobile Alliance that is responsible for the development of the OMA DRM System. Under his responsibility, the OMA DRM 2.0 specification was completed and the OMA DRM 2.1, SRM 1.0 and SCE 1.0 specifications defined. In recognition for his leadership, Jan received in June 2008 the Contributor and Achievement Award from OMA.

On 1 July 2008, Jan retired from Philips; he is currently an independent consultant, located in Heeze, near Eindhoven, the Netherlands.

Publications

van der Meer, J. (1979) Bruto-winstnivellering ter bestrijding van werkloosheid (in Dutch), Economisch Statistische Berichten.

ESB Jaargang

,

64

(3191), 145–149.

van der Meer, J. (1980) Arbeidsplaatsenbeleid, sociale verzekeringen en indirecte belastingen (in Dutch), Sociaal Maandblad Arbeid.

SMA Jaargang

,

35

(2), 111–118.

Vreeswijk, F.W.P., Jonker, W., Leenen, J.R.G.M. and van der Meer, J. (1988) An HD-MAC Coding System. Proceedings of the Second International Workshop on Signal Processing of HDTV, L'Aquila, Italy.

van der Meer, J., Carey-Smith, C.M., Rohra, K. and Vreeswijk, F.W.P. (1988) Movement Processing for an HD-MAC Coding System. Proceedings of the Second International Workshop on Signal Processing of HDTV, L'Aquila, Italy.

van der Meer, J., Begas, H.W.A. and Vreeswijk, F.W.P. (1988) The Architecture of an HD-MAC Decoder. Proceedings of the Second International Workshop on Signal Processing of HDTV, L'Aquila, Italy.

Sijstermans, F. and van der Meer, J. (1991) CD-I full motion video encoding on a parallel computer.

Communications of the ACM

,

34

(4), 81–91.

van der Meer, J. (1992) The full motion system for CD-I.

IEEE Transactions on Consumer Electronics

,

38

(4), 910–920.

van der Meer, J. (1993) A derived paper in Japanese is found in ‘Data Compression and Digital Transmission’, Nikkei Electronics Books, pp. 123–136.

van der Meer, J. and Huizer, K. (1997) Interoperability between different Interactive Engines, Problems and Ways of Solutions. Symposium Record Programme Production, 20th International Television Symposium Montreux, p. 484.

van der Meer, J. and Huizer, Cornelis(Koen) M. (1998) MHEG/JAVA Enhanced Broadcasting, the competitive edge. Tagungsband 18. Jahrestagung der FKTG (Ferhseh- und Kinotechnische Gesellschaft e.V), Erfurt, pp. 555–565.

van der Meer, J. and Kaars, P.B. (2000) The Bridge Between Internet and Broadcast. Proceedings SCTE (Society of Cable Telecommunications Engineers) Conference on Emerging Technologies, Anaheim, CA, pp. 255–263.

van der Meer, J. (2000) Enhanced Broadcast Services with Complimentary Delivery over IP. Technical Papers 49th Annual NTCA (National Cable Television Association) Convention, New Orleans, LA, pp. 34–39.

Buhse, W. and van der Meer, J. (2007) The open mobile alliance digital rights management.

IEEE Signal Processing Magazine

,

24

(1), 140–143.