CN104782133A - Method and apparatus for media data delivery control - Google Patents
Method and apparatus for media data delivery control Download PDFInfo
- Publication number
- CN104782133A CN104782133A CN201380053098.0A CN201380053098A CN104782133A CN 104782133 A CN104782133 A CN 104782133A CN 201380053098 A CN201380053098 A CN 201380053098A CN 104782133 A CN104782133 A CN 104782133A
- Authority
- CN
- China
- Prior art keywords
- delay
- transmission
- media data
- buffer
- receiving entity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/764—Media network packet handling at the destination
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/762—Media network packet handling at the source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/004—Arrangements for detecting or preventing errors in the information received by using forward error control
- H04L1/0045—Arrangements at the receiver end
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/752—Media network packet handling adapting media to network capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/85406—Content authoring involving a specific file format, e.g. MP4 format
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/90—Buffering arrangements
- H04L49/9005—Buffering arrangements using dynamic buffer space allocation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
- H04N21/4381—Recovering the multiplex stream from a specific network, e.g. recovering MPEG packets from ATM cells
Abstract
A method and apparatus control delivery of media data in a transmission system. A method of operating a sending entity in the transmission system includes identifying a fixed delay associated with transmission of media data in the transmission system and sending information about the fixed delay as a requirement on a length of time after transmission that the media data is passed to an application layer component or presented to a user of a receiving entity. A method of operating a receiving entity in the transmission system includes receiving media data and information about a fixed delay associated with the media data and identifying a requirement on a length of time after transmission that the media data is passed to an application layer component or presented to a user from the information about the fixed delay.
Description
Technical field
The media data that the application relates generally in transmission system is sent, and more specifically, relates to sending and presenting of media data.
Background technology
Motion Picture Experts Group (MPEG) media transmission (MMT) are digital container standard or form, and it specifies the technology being used for sending the encoded media data for multimedia service in heterogeneous IP network environment.(namely the encoded media data of sending comprises the audio-visual media data of the discrete cell needing synchronous decoding and present data in the time of specifying, timing data) and based on service context or decoded at any time by user interactions and the data (that is, non-timed data) of other types that present the two.
Summary of the invention
Technical problem
MMT designs based on such hypothesis: the packet-based delivery network of the Internet Protocol (IP address) by using such as RTP (RTP), transmission control protocol (TCP), User Datagram Protoco (UDP) (UDP) etc. is sent by the media data of coding.MMT is also by considering that the feature of different delivery environments designs.Such as, the end-to-end delay sent of each grouping from sending entity to receiving entity may not be always constant, and bottom-layer network supplier must provide method signaling message and media data distinguished.Therefore, the standard of the improvement in needing MMT media data to send.
Technical scheme
Embodiment of the present disclosure provides the method and apparatus sent controlling media data in transmission system.
In one exemplary embodiment, a kind of method operating sending entity in transmission system is provided.The method comprises the fixed delay identifying and be associated with the transmission of media data in transmission system.The method also comprises and sends about the information of fixed delay, is delivered to the application layer component of receiving entity or is presented to the requirement of time span of user as media data after the transmission.
In another exemplary embodiment, provide a kind of method operating receiving entity in transmission system.The method comprises receiving media data and the information about the fixed delay be associated with media data.The method also comprise from the information identification about fixed delay after the transmission media data be delivered to application layer component or be presented to the requirement of time span of user.
In another exemplary embodiment, provide the device in a kind of sending entity in transmission system.This device comprises controller, is configured to identify the fixed delay be associated with the transmission of media data in transmission system.This device also comprises transmitter, is configured to send about the information of fixed delay, is delivered to the application layer component of receiving entity or is presented to the requirement of time span of user as media data after the transmission.
In Still another example embodiment, provide the device in the receiving entity in a kind of transmission system.This device comprises receiver, is configured to receiving media data and the information about the fixed delay be associated with media data.This device also comprises controller, be configured to from the information identification about fixed delay after the transmission media data be delivered to application layer component or be presented to the requirement of time span of user.
Before being described embodiment below, it is favourable for illustrating the definition running through some word and the phrase used in this patent document: term " comprises (include) " and " comprising (comprise) " and its derivative mean and comprise instead of limit; Term "or" is inclusive, mean and/or; Phrase " with ... be associated " and " associated with it " and derivative can mean comprise, be included, with ... interconnection, comprise, be included, be connected to or with ... connect, lotus root receive or with ... lotus root connects, can be with ... communication, with ... cooperation, staggered (interleave), side by side (juxtapose), close to ..., be tied to or with ... bind, have, have ... attribute etc.; Term " controller " means to control at least one equipment operated, system or its part, and such equipment can realize with hardware, firmware or software or certain combination of at least two in them.It should be noted that and be: the function be associated with any specific controller or can be concentrated at far-end or distribute in this locality.Run through the definition that this patent document provides some word and phrase, what it should be understood by one skilled in the art that is, under many circumstances, even if be not in most of the cases, these definition are applicable to the existing and following use of word and the phrase limited like this.
Accompanying drawing explanation
In order to understand the disclosure and advantage thereof more all sidedly, with reference now to the description below in conjunction with accompanying drawing, reference number identical in the accompanying drawings represents identical part:
Fig. 1 shows the example of the transmission system that various embodiment of the present disclosure can be implemented wherein;
Fig. 2 shows the block diagram of the MMT agreement I/O in MMT media data transmission environment according to various embodiment of the present disclosure;
Fig. 3 show according to various embodiment of the present disclosure at the behavior of transmitter side analog receiver and the block diagram for the receiver buffer model of estimating buffer delay and size requirements;
Fig. 4 shows the sequential chart according to the MMTP packet transaction in the MMTP decapsulation buffering area in Fig. 3 of various embodiment of the present disclosure;
Fig. 5 shows the process operating sending entity in transmission system of the embodiment according to the disclosure;
Fig. 6 shows the process operating receiving entity in transmission system of the embodiment according to the disclosure; And
Fig. 7 shows the exemplary electronic device that various embodiment of the present disclosure can be implemented wherein.
Embodiment
Fig. 1 to Fig. 7 discussed below and be only illustrative for describing the various embodiments of principle of the present disclosure in this patent document, and should not be interpreted as limiting the scope of the present disclosure by any way.It will be appreciated by the skilled addressee that principle of the present disclosure can realize in the system of any suitable layout and equipment.
MMT coding and media-delivery are discussed in file below and standard to describe: ISO/IEC JTC1/SC29/WG11, High efficiency coding and media delivery in heterogeneousenvironments Part 1:MPEG Media Transport (MMT) (high efficient coding in isomerous environment and media-delivery part 1:MPEG media transmit (MMT)), in July, 2012, it is merged in the disclosure, just looks like here fully to set forth equally.In order to efficiently and effectively send the media data of coding in heterogeneous IP network environment, MMT provides: for building the logical model of the content be made up of the various assemblies applied for mixed poly-(mash-up); Transmit the data structure about the information of the encoded media data for delivery layer process (such as packetizing and self adaptation); For sending method of packetization and the packet configuration of particular media type that (comprising mixing to send) use on TCP or UDP or the unknowable media content of coding method; For the form of the signaling message presenting and send of managing media content; For the form of the signaling message presenting and send of managing media content; Cross-layer exchanges the form of the information to promote communication across layers.
MMT defines three functional areas, comprises encapsulation, sends and signaling.The encapsulation function area definition logical construction of media content, MMT bag and the form of the data cell that processes will be carried out by the compatible entity of MMT.The assembly of the relation comprised between media content and media content specified by MMT bag, sends required information to provide self adaptation.The form of data cell is defined as encapsulating encoded media so that or the payload being stored or being carried as delivering protocol, and easily in storage and conversion between carrying.The application layer protocol of delivery functions area definition payload and form.With for sending compared with multimedia traditional application layer protocol, this application layer protocol provides the feature of enhancing, comprises multiplexing, for sending MMT bag.Payload format is defined as carrying particular media type or the unknowable encoded media data of coding method.Signaling capability area definition is for managing the form of the message of sending and consuming of MMT bag.Message for consumption management is used to the structure sending MMT bag with signal, and is used to send the structure of payload format and the configuration of agreement with signal for the message of bearer manager.
MMT defines the new frame of other static content for the Time Continuous multimedia and such as widget, file etc. of sending such as audio frequency, video.MMT specifies the agreement (that is, MMTP) for sending MMT bag to receiving entity.MMTP sends the part of transmission time as protocol header for MMTP bag using signal.This time makes receiving entity can by checking that the transmitting time that each MMT of importing into divides into groups and time of reception perform Key dithering.
Embodiment of the present disclosure is recognized, based on the type of transmission path, transformat and receiving equipment, the environmental condition for receiving media data may be different, which results in the delay (such as, end-to-end delay) between transmitting and sending.Such as, different transmission mediums (such as, RFDC (LTE, HSPA, 3G, wireless network etc.), physical medium (such as, wired, cable, Ethernet, optical fiber etc.), satellite broadcasting etc.) there is the different transmission delays be associated.Embodiment of the present disclosure is recognized, except transmission delay, other sources may cause shake.Such as, forward error correction (FEC) decoding may insert additional delay, and with the enable grouping recovering to lose, this needs to receive enough sources and parity packets.Other sources other postponed may be that the data interlacing owing to may perform during the transmission causes.Embodiment of the present disclosure is also recognized, receiving equipment assembly also may affect delay.The delay with the equipment of more large memories and faster disposal ability of such as computer can lower than the delay with other equipment of more small memory and slower disposal ability of such as Set Top Box.
Embodiment of the present disclosure is recognized, in certain environments, in such as broadcast environment, there is fixing end-to-end delay, that is, each transmission be grouped in point-to-multipoint transmission system from transmission until the MMT process stack staying receiving entity experiences identical delay.Such as, embodiment of the present disclosure is recognized importantly, when agnostic device, agreement or transmission medium realize, provides or ensures that all clients receiving same program present identical content at same time.In addition, in order to the hardware implementing of enable receiver, embodiment of the present disclosure is recognized, may need to provide the upper bound of the memory space guaranteed needed for the delay of fixing delivery of packets.According to the character of network and the setting of service, MMT grouping may be exposed to large-scale shake, and this can then cause different buffer requirements.Such as, larger source block provides FEC protect and the service of being carried by internet may need than carry in the broadcast be managed and the service not having FEC to protect more cushion.
Therefore, embodiment of the present disclosure provides for providing, strengthening and/or guarantee fixing end-to-end delay and for cushioning the method and apparatus that requires of finite memory importing MMT grouping into.Embodiment of the present disclosure also provides instrument to send buffer requests and fixed delay to receiving entity with signal.
Fig. 1 shows the example of the transmission system 100 that various embodiment of the present disclosure can be implemented wherein.In an illustrated embodiment, system 100 comprises sending entity 101, network 105, receiving entity 110-116, radio transmission point (such as, enode b (eNB), Node B), such as base station (BS) 102, base station (BS) 103 and other similar base stations or relay station (not shown).Sending entity 101 communicates with base station 103 with base station 102 via network 105, and network 105 can be, such as, and the Internet, media broadcast network or IP-based communication system.Receiving entity 110-116 communicates with sending entity 101 with 103 via network 105 and/or base station 102.
Base station 102 be base station 102 overlay area 120 in more than first receiving entity (such as, subscriber equipment, mobile phone, mobile radio station, subscriber station) be provided to the wireless access of network 105.More than first receiving entity comprises subscriber equipment 111, and it can be positioned at small enterprise (SB); Subscriber equipment 112, it can be positioned at enterprise (E); Subscriber equipment 113, it can be positioned at Wi-Fi hotspot (HS); Subscriber equipment 114, it can be positioned at the first house (R); Subscriber equipment 115, it can be positioned at Second home (R); With subscriber equipment 116, it can be mobile device (M), such as cell phone, the laptop computer with radio communication function, the PDA with radio communication function, flat computer etc.
More than second subscriber equipment in the overlay area 125 that base station 103 is base station 103 provides the wireless access to network 105.More than second subscriber equipment comprises subscriber equipment 115 and subscriber equipment 116.In an exemplary embodiment, base station 101-103 can use OFDM or OFDMA technology to communicate with one another and communicate with subscriber equipment 111-116.
Although depict only six subscriber equipmenies in FIG, be understandable that, system 100 can provide WiMAX and network for other subscriber equipment.It should be pointed out that subscriber equipment 115 and subscriber equipment 116 are positioned at overlay area 120 and the edge both overlay area 125.Subscriber equipment 115 communicates with both base stations 103 with base station 102 with subscriber equipment 116 is each, and can be said to be operating in switch mode, as known to those skilled.
Subscriber equipment 111-116 can access voice, data, video, video conference and/or other broadband service via network 105.In an exemplary embodiment, one or more subscriber equipment 111-116 can be associated with the access point of WiFi WLAN (AP).Subscriber equipment 116 can be any one in multiple mobile device, comprise there is radio function laptop computer, personal digital assistant, notebook, handheld device or other there is the equipment of radio function.Subscriber equipment 114 and 115 can be, such as, has the personal computer (PC) of radio function, laptop computer, gateway or other equipment.
Fig. 2 shows the block diagram of the MMT agreement I/O in MMT media data transmission environment 200 according to various embodiment of the present disclosure.In this illustrated examples, sending entity 205 sends media data by transmission medium to receiving entity 210 according to MMTP.Media data 215 processes according to MMTP at sending entity 205 place.Such as, sending entity 205 can perform MMT encapsulating fill, encode, send and signal, for using media data as MMT processing unit (MPU) and MMT slice unit (MFU) 215 (such as, the fragment of MPU).Treated media data subsequently (such as, as grouping) is sent to receiving entity 210, carries out processing (such as, decapsulation, decoding etc.) for according to MMTP.Then the media data everywhere managed at receiving entity 210 is passed to upper strata programming (such as, the application layer program of such as media player) as MPU and/or MFU and, for presenting to user, completes sending of media data.
Fig. 3 show according to various embodiment of the present disclosure at the behavior of transmitter side analog receiver and the block diagram for the receiver buffer model 300 of estimating buffer delay and size requirements.In various embodiment of the present disclosure, the such as sending entity 205 of Media delivery services device (or other MMT sensing nodes) calculates, determine and/or fixing end-to-end delay that identification point is sent the media data in multicast system.Such as, sending entity 205 can utilize model 300 to determine the effect of the media data process performed in stream of packets according to the reception restriction in the receiver of receiving entity 210.Such as, sending entity 205 can utilize model to determine required buffer delay and required buffer size, and by the entity of this information communication to receiving media data.
In this illustrated examples, fec decoder buffering area 305 is for estimating the model that the delay that is associated with fec decoder and/or buffer size require.Fec decoder typical case is used for many application, and wherein lower level transmission may for recovery channel error or not enough when network congestion may cause packet loss or excessive deferral.In order to perform fec decoder, receiving entity 210 uses buffering area, imports grouping into and is stored in this buffering area, until enough sources (" S ") and repair data (" P " parity data) can be used for performing fec decoder.
In this illustrated examples, sending entity 205 uses the model of fec decoder buffering area 305 to determine the action about fec decoder that receiving entity 210 will be taked, to estimate the delay be associated with fec decoder.In other words, sending entity 205 use the model prediction of fec decoder buffering area 305 to be taked by receiving entity 210 action to estimate that fec decoder postpones.This modeling by sending entity 205 pairs of fec decoder buffering areas 305 starts from, and it is empty at first that fec decoder buffering area 305 is assumed to be.Then, for having transmission time stamp t
seach import into grouping i, if buffer_occupancy (buffering area occupies)+packet_size (packet size) <max_buffer_size (maximum buffer size), then receiving entity 210 uses fec decoder buffering area 305 to carry out buffering packets i.Otherwise receiving entity 210 abandons grouping i, because it does not meet buffer models.Then receiving entity 210 determines whether FEC is applied to the i that divides into groups.If FEC is applied to the i that divides into groups, then receiving entity 210 determines the source block j of grouping belonging to i, determine the insertion time t of first grouping of source block j, at time t+FEC_buffer_time place by all groupings of source block j (after FEC error correction, if needed) move to Key dithering (de-jitter) buffering area, and abandon reparation grouping.Sending entity 205 utilize FEC_buffer_time as to the reception of first of source block the grouping until fec decoder by attempt for the buffer time needed for fec decoder.This time calculates based on FEC block size usually.
Key dithering buffering area 310 be by sending entity be used for estimating with divide into groups on the delay that is associated of Key dithering and/or buffer size require the model of (that is, removing the delay jitter divided into groups).Key dithering buffering area finally guarantees that MMTP grouping stands to postpone from source to the constant transmissions of the output of MMTP protocol stack, is assumed to be maximum traffic delay.Receiving entity 210 can abandon the data cell that experienced by the transmission delay being greater than maximum traffic delay, because it is too late.
This modeling by sending entity 205 pairs of Key dithering buffering areas 310 starts from, and it is empty at first that Key dithering buffering area 310 is assumed to be.Then this grouping is inserted in Key dithering buffering area 310 when MMTP grouping arrives by receiving entity 210.Receiving entity 210 is subsequently at time t
smMTP grouping is removed at+Δ place, wherein t
sbe the transmission time stamp of MMTP grouping, and Δ is the fixing end-to-end delay sent with signal for media data.After applying Key dithering, correct (or retransmitted by FEC/ recover) all MMTP grouping arrived is by end-to-end delay identical for experience.
MMTP decapsulation buffering area 315 is used for estimating by sending entity and will exporting delay that the MMTP process before passing to upper strata is associated and/or the model that buffer size requires.The output of MMTP processor can or MFU payload (postponing in operation low), complete vidclip, or complete MPU.MPU can be segmented into less grouping or be converged into larger grouping, and this depends on their size.Then the decapsulation (removing MMTP grouping and payload head) of grouping and any required solution segmentation/disaggregation are performed, as a part for MMTP process.This process may need some buffer delays, is called as decapsulation and postpones, and is segmented into when multiple MMTP divides into groups assembles with convenient MPU.But, in this illustrative embodiment, decapsulation postpones the part that can not be considered to fixing end-to-end delay, and the entity that the availability of the MPU consumed by encoded media layer can be divided into groups by MPU being segmented into multiple MMTP ensures, and no matter decapsulation postpones.
Fig. 4 shows the sequential chart 400 according to the MMTP packet transaction in the MMTP decapsulation buffering area 315 of various embodiment of the present disclosure.Sequential chart 400 is that the buffering area level in MMTP decapsulation buffering area 315 is about the example of time when MMTP grouping is processed and is output to upper strata.Such as, sequential chart 400 is the diagrams estimating the buffer requests be associated with MMTP packet transaction.
Started from by the modeling of sending entity 205 pairs of MMTP decapsulation buffering areas 315, it is empty at first that MMTP decapsulation buffering area is assumed to be.After performing Key dithering, MMTP grouping is inserted in MMTP decapsulation buffering area 315 by receiving entity 210.MMTP for the payload of carrying gathering divides into groups, and receiving entity 210 removes grouping and payload head, and polymerization is divided into independent MPU.MMTP for the payload of carrying segmentation divides into groups, and grouping remains in MMTP decapsulation buffering area 315 by receiving entity 210, until all homologous segments are correctly received or until receive the grouping of the MPU not belonging to same segment.If receive all fragments (such as, in time 405 or time 410) of MPU, then receiving entity 210 removes MMTP grouping and payload head, re-assemblies, and the MPU of reconstruct is forwarded to upper strata.Otherwise if do not receive some fragments of MPU, then receiving entity 210 can abandon the fragment of incomplete MPU.
Based on this receiver buffer model 300, the maximum delivered in hypothetical target path postpones, sending entity 205 can determine transmitting and scheduling, buffer size and buffer delay, reduces and/or guarantees do not have grouping to be dropped.Sending entity 205 provides and/or ensures, being grouped in of transmission delay that experienced by lower than setting threshold will be output to upper strata after the constant delay of point-to-multipoint transmission system, and Bu Shi client buffer district's underflow or spilling.
After the buffer size determined needed for media data and fixing end-to-end delay, sending entity 205 by this information communication to receiving entity 210.Such as, sending entity 205 can use the signaling protocol between sending entity and receiving entity, by this information communication to receiving entity 210.In various embodiments, sending entity 205 can run receiver buffer model 300 continuously, to verify that selected end-to-end delay and buffer size are aligned and run or the row that overhauls under can not causing buffering area.At receiver-side, the signaling instruction receiving entity 210 of fixed delay performs buffering, to make data cell before being forwarded to upper strata, and the fixing end-to-end delay of each data cell experience signalling.When suppose the clock between sending entity and receiving entity by synchronous, receiving entity 210 can carry out the output time of calculated data based on the fixing end-to-end delay of transmission time stamp and signalling.
In certain embodiments, sending entity 205 uses session description file, and such as Session Description Protocol (SDP) file, performs signaling.In sdp, the media session using MMTP agreement to send is described.Media session comprises fixing end-to-end delay and/or required buffer size.The example that the media session that table 1 below illustrates SDP file describes, it sends fixing end-to-end delay and buffering area size requirements with signal.
Table 1:
M＝asset 23442UDP/MMTP 1
a＝assetid：1MP4
A=minimal buffering district size: 1000000
A=end-to-end delay: 2500
In another embodiment, MMTP signaling capability is used to perform the signaling of fixing end-to-end delay and buffering area size requirements.In such embodiments, new signaling message is devised to carry above-mentioned information.
In this embodiment, buffer size provides in units of byte, and fixing end-to-end delay provides in units of millisecond.In other embodiments, sending entity 205 can use MMTP signaling message to perform signaling, and wherein, specific signaling message types is defined or information is included in existing signaling message.
When determining fixed delay, sending entity 205 is estimated in the maximum and tolerable transmission delay down to the expection in the transmission path of receiver.When the MMTP grouping requiring fec decoder to recover to lose, if employ FEC, then sending entity 205 adds FEC buffer delay, and it contains the time (such as, FEC_buffer_time discussed above) required for the block of assembling source.In addition, any delay that the fragment that sending entity 205 adds grouping may cause.The estimation of the MMTP transmission delay of gained is signaled as fixing end-to-end delay by sending entity 205.Estimate that an example of fixing end-to-end delay is provided by equation 1 below:
Fixing end-to-end delay=maximum traffic delay+FEC_buffer_time [equation 1]
In various embodiments, in order to estimate the buffer requests caused, sending entity 205 can use fixing end-to-end delay, and deducts the minimal propagation delay for the transmission path down to receiver, will need the maximum amount of the estimation be buffered by sending entity 205 as data.Then buffer size can be required that the Maximum Bit Rate being estimated as MMTP stream is multiplied by the duration of the buffered data calculated by sending entity 205.Estimate that the example of fixing end-to-end delay is provided by equation 2 below:
Buffer size=(maximum delay-minimum delay) * Maximum Bit Rate [equation 2]
Although various embodiment described herein discusses MMT data communication, it should be noted, each embodiment of the present disclosure is not limited to MMT communication.Such as, according to principle of the present disclosure, fixed delay and buffer size are determined to be applied to the data of any suitable type or the transmission system of delivery of media content and/or any suitable type.
Fig. 5 shows the process operating sending entity in transmission system of the embodiment according to the disclosure.Such as, process can be performed by the sending entity 205 in Fig. 2 depicted in figure 5.This process also can be performed by the sending entity 101 in Fig. 1.
Process starts from the fixed delay (step 505) that sending entity identification is associated with the transmission of media data.Such as, in step 505, sending entity can be the media server in point-to-multipoint transmission system, and time-sensitive content is provided to various equipment by various communication media by it.In order to identify this delay, sending entity can estimated delay or identify from the precalculated of another source or standardized delay.In one example in which, sending entity can be estimated and the transmission delay that transmission path (such as, wireless, Ethernet, satellite broadcasting etc.) from sending entity to one or more receiving entity in multicast system is associated.Such as, transmission delay can be to the estimation of maximum traffic delay based on the transmission medium be associated with each receiving entity in multicast system and device type.Sending entity also can be estimated and the buffer delay that the grouping processing the media data received in receiving entity is associated.Then sending entity can based on transmission delay and buffering Delay computing fixed delay.
Then sending entity determines that the buffer size of receiving entity requires (step 510).Such as, in step 510, data can need the time quantum of the expection cushioned by receiving entity to be defined as fixed delay to deduct minimal propagation delay by sending entity.Then the bit rate that sending entity can be measured based on this buffer time and be associated with media data calculates buffer size requirement.
After this, sending entity sends the information (step 515) about fixed delay and buffering area size requirements.Such as, in step 515, sending entity can send buffer size requirement with signal in the message, separate with transmission media data, or before the metadata or the transmission of adjoint media data.In these examples, fixed delay be after the transmission, media data presents to the requirement of the time span of the user of receiving entity.In other words, fixed delay is such time, and after such time, sending entity is allowed to media data to be upwards sent to upper procedure and finally presents to user for by media data.In these embodiments, sending entity provides and/or guarantees that media data is shown in about identical time may reside in the middle of the multiple receiving equipments in point-to-multipoint transmission environment, has nothing to do with transmission medium or receiving equipment type.
Fig. 6 shows the process operating receiving entity in transmission system of the embodiment according to the disclosure.Such as, process can be performed by the receiving entity 210 in Fig. 2 depicted in figure 6.This process also can be performed by the receiving entity 110 in Fig. 1.
Process starts from receiving entity receiving media data and the information (step 605) about the fixed delay be associated with media data.Such as, in step 605, receiving entity can together with media data or prior to this information of media data reception.
After then receiving entity identifies transmission, media data presents to the requirement (step 610) of time span receiving user.Such as, in step 610, receiving entity can use fixed delay, as determining when, the media data received is delivered to upper strata finally to present to the length of the time of user.
After this, the data be associated with media data received store (step 615) in the buffer by receiving entity.Such as, in step 615, receiving entity can when receiving medium data, until the transmission time be associated with the data received stabs add that the time of fixed delay passes.Then receiving entity determines whether current time is that transmission time stamp adds fixed delay (step 620).If current time is less than the transmission time, stamp adds fixed delay, then sending entity continues buffer media data, to present after a while and to send.If current time is greater than the transmission time, stamp adds fixed delay, then sending entity can abandon these data, because receive too late.
But if current time is the transmission time, stamp adds fixed delay, then the data received are supplied to user's (step 625) via user interface by receiving entity, and process stops subsequently.Such as, in step 625, media data can be delivered to application layer program by receiving entity, so that media data is presented user.In these embodiments, receiving entity identification in accordance with the fixed delay of media data, to guarantee that media data shows on receiving entity in about identical time may reside in other receiving entities in point-to-multipoint transmission environment.
Although Fig. 5 and Fig. 6 respectively illustrates the example of the process of sending entity and receiving entity in transmission system, various change can be made to Fig. 5 and Fig. 6.Such as, although be illustrated as series of steps, each step in each figure overlapping, parallelly can occur, occurs in sequence with different, or repeatedly occurs.
Fig. 7 shows the exemplary electronic device 700 that embodiment of the present disclosure can be implemented wherein.In this example, electronic equipment 700 comprises controller 704, memory 706, permanent reserve device 708, communication unit 710, I/O (I/O) unit 712 and display 714.In these illustrative examples, electronic equipment 700 is the sending entity 101 of Fig. 1 and/or the example realized of receiving entity 110-116.Electronic equipment 700 is also an example of sending entity 205 in Fig. 2 and/or receiving entity 210.
Controller 704 is any equipment, system or its parts, and it controls at least one operation.Such equipment can realize with hardware, firmware or software or certain combination of at least two in them.Such as, controller 704 can comprise the hardware processing element and/or software program that are configured to the operation controlling electronic equipment 700.Such as, controller 704 process can be loaded into the instruction of the software in memory 706.According to specific implementation, controller 704 can comprise the processor of multiple processor, multi-processor core or some other types.In addition, controller 704 can use multiple heterogeneous processor systems to realize, and wherein, primary processor and auxiliary processor are present on one single chip.As another illustrative example, controller 704 can comprise symmetric multiprocessor system, and it comprises multiple processors of identical type.
Memory 706 and permanent storage device 708 are examples of storage facilities 716.Storage facilities is any hardware that temporarily and/or for good and all can store information, and described information is, such as such as, but not limited to, program code and/or other suitable information of data, functional form.In these examples, memory 706 can be, such as, and random access memory or any other suitable volatibility or nonvolatile storage.Such as, permanent storage device 708 can comprise one or more assembly or equipment.Permanent storage device 708 can be hard disk drive, flash memory, CD or some above-mentioned combinations.The medium used by permanent storage device 708 also can be removable.Such as, removable hard disk drive can be used to permanent reserve device 708.
Communication unit 710 provides the communication with other data handling systems or equipment.In these examples, communication unit 710 can comprise wireless (honeycomb, wireless network etc.) transmitter, receiver and/or transmitter, network interface unit and/or any other the suitable hardware for passing through physics or wireless communication medium transmission and/or received communication.Communication unit 710 can communicate by using physics to provide with any one in wireless communication link or both.
I/O unit 712 allows and miscellaneous equipment input and output data, and described miscellaneous equipment can be connected to a part for electronic equipment 700 or electronic equipment 700.Such as, I/O unit 712 can comprise the touch panel, the microphone of audio reception input, the loud speaker providing audio frequency to export and/or the motor providing sense of touch to export that receive and touch user's input.I/O unit 712 is for providing an example with the user interface of delivery of media data (such as, voice data) to the user of electronic equipment 700.In another example, I/O unit 712 can provide connection for the user's input by keyboard, mouse, external loudspeaker, external microphone and/or some other suitable input-output apparatus.In addition, I/O unit 712 can send and output to printer.Display 714 provides the mechanism showing information to user, and is an example of the user interface providing and transmit media data (such as, image and/or video data) to the user of electronic equipment 700.
Program code for operating system, application or other programs can be arranged in the storage facilities 716 communicated with controller 704.In certain embodiments, program code is positioned on permanent storage device 708 in functional form.These instructions can be loaded in memory 706, process for by controller 704.Computer implemented instruction (it can be arranged in memory 706) can be used to implement the process of different embodiment by controller 704.Such as, controller 704 can perform for the one or more process in module as above and/or equipment.
In certain embodiments, various function described above is realized by computer program or supports, described computer program is formed by computer readable program code and is implemented in computer-readable medium.The program code of computer program can be arranged in optionally removable computer readable storage devices in functional form, and can be loaded into or be sent to electronic equipment 700 to be processed by controller 704.In some illustrative embodiments, program code can download to permanent storage device 708 by network from another equipment or data handling system and use in electronic equipment 700.Such as, the program code be stored in the computer-readable recording medium in server data processing system can download to electronic equipment 700 by network from server.There is provided that the data handling system of program code can be server computer, client computer or can store and some other equipment of delivery program code.
Embodiment of the present disclosure is recognized, MMTP has developed into by providing the puppy parc being suitable for delivery of media data improve and replace existing host-host protocol.MMTP solves delay-tolerant application and Real-time low delay application, such as live streaming media.As one man operate on multiple receiver in order to ensure MMTP agreement and guarantee can use in client between required buffer empty, embodiment of the present disclosure provides determines that end-to-end delay is to estimate between required buffer empty and this information signal to be sent to the method and apparatus of receiver.This function is even more important for hard-wired radio receiver for reception client (such as Set Top Box).
Although utilized exemplary embodiment to describe the disclosure, various change and amendment can be implied to those skilled in the art.Disclosure intention comprises these and falls into change within the scope of claims and amendment.
Claims (22)
1. in transmission system, operate a method for sending entity, the method comprises:
Identify the fixed delay be associated with the transmission of media data in transmission system; And
Send about the information of fixed delay, be delivered to the application layer component of receiving entity as media data after the transmission or be presented to the requirement of time span of user.
2. the method for claim 1, also comprises:
Based on fixed delay and the bit rate that is associated with media data, determine the buffer size requirement of receiving entity; And
Buffer size is required to send to the receiving entity be associated with media data.
3. method as claimed in claim 2, wherein, described sending entity is configured to use imaginary receiver buffer model, fixed delay and buffering area size requirements to verify whether the data of transmission meet.
4. the method for claim 1, wherein identify that fixed delay comprises:
Estimate with in multicast system from sending entity to the transmission delay that the transmission path of one or more receiving entity is associated;
Estimate and the buffer delay that the grouping processing the media data received is associated; And
Based on transmission delay and buffering Delay computing fixed delay.
5. method as claimed in claim 4, wherein, estimated propagation delay comprises:
Maximum traffic delay is estimated based on the transmission medium be associated with each receiving entity in multicast system and device type.
6. method as claimed in claim 4, wherein, estimate that buffer delay comprises:
Determine whether forward error correction (FEC) is applied to the grouping of transmission of media data; And
FEC buffer delay is comprised when estimating buffer delay.
7. in transmission system, operate a method for receiving entity, the method comprises:
Receiving media data and the information about the fixed delay be associated with media data; And
From the information identification about fixed delay after the transmission media data be delivered to application layer component or be presented to the requirement of time span of user.
8. method as claimed in claim 7, also comprises:
The data be associated with media data received are stored in the buffer, until the transmission time be associated with the data received stabs add that the time of fixed delay passes; And
Being stab in the transmission time be associated with the data received to add fixed delay in response to determining current time, via user interface, the data received being supplied to user
9. method as claimed in claim 7, wherein, described fixed delay time span based on to the estimation of the transmission delay be associated from sending entity to the transmission path of one or more receiving entity in multicast system and the estimation to the buffer delay be associated with the grouping processing the media data received.
10. method as claimed in claim 9, wherein, comprises based on the transmission medium be associated with each receiving entity in multicast system and device type the estimation of maximum traffic delay the estimation of transmission delay.
11. methods as claimed in claim 9, wherein, comprise the estimation to forward error correction buffer delay to the estimation of buffer delay.
Device in 12. 1 kinds of sending entities in transmission system, this device comprises:
Controller, is configured to identify the fixed delay be associated with the transmission of media data in transmission system; And
Transmitter, is configured to send about the information of fixed delay, is delivered to the application layer component of receiving entity or is presented to the requirement of time span of user as media data after the transmission.
13. devices as claimed in claim 12, wherein:
Described controller is configured to, based on fixed delay and the bit rate that is associated with media data, determine the buffer size requirement of receiving entity; And
Described transmitter is configured to buffer size to require to send to the receiving entity be associated with media data.
14. devices as claimed in claim 13, wherein, described sending entity is configured to use imaginary receiver buffer model, fixed delay and buffering area size requirements to verify whether the data of transmission meet.
15. devices as claimed in claim 12, wherein, described controller is configured to:
Estimate with in multicast system from sending entity to the transmission delay that the transmission path of one or more receiving entity is associated;
Estimate and the buffer delay that the grouping processing the media data received is associated; And
Based on transmission delay and buffering Delay computing fixed delay.
16. devices as claimed in claim 15, wherein, described controller is configured to:
Maximum traffic delay is estimated based on the transmission medium be associated with each receiving entity in multicast system and device type.
17. devices as claimed in claim 15, wherein, described controller is configured to:
Determine whether forward error correction (FEC) is applied to the grouping of transmission of media data; And
FEC buffer delay is comprised when estimating buffer delay.
Device in receiving entity in 18. 1 kinds of transmission systems, this device comprises:
Receiver, is configured to receiving media data and the information about the fixed delay be associated with media data; And
Controller, be configured to from the information identification about fixed delay after the transmission media data be delivered to application layer component or be presented to the requirement of time span of user.
19. devices as claimed in claim 18, also comprise:
Memory, is configured to the data be associated with media data received to store in the buffer, until the transmission time be associated with the data received stabs add that the time of fixed delay passes; And
Wherein, it is stab in the transmission time be associated with the data received to add fixed delay that described controller is configured in response to determining current time, via user interface, the data received is supplied to user
20. devices as claimed in claim 18, wherein, described fixed delay time span based on to the estimation of the transmission delay be associated from sending entity to the transmission path of one or more receiving entity in multicast system and the estimation to the buffer delay be associated with the grouping processing the media data received.
21. devices as claimed in claim 20, wherein, comprise based on the transmission medium be associated with each receiving entity in multicast system and device type the estimation of maximum traffic delay the estimation of transmission delay.
22. devices as claimed in claim 20, wherein, comprise the estimation to forward error correction buffer delay to the estimation of buffer delay.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910189779.9A CN110049011B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
| CN201910189780.1A CN109889535B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261712045P | 2012-10-10 | 2012-10-10 | |
| US61/712,045 | 2012-10-10 | ||
| US14/049,022 US10356143B2 (en) | 2012-10-10 | 2013-10-08 | Method and apparatus for media data delivery control |
| US14/049,022 | 2013-10-08 | ||
| PCT/KR2013/009049 WO2014058237A1 (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
Related Child Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910189780.1A Division CN109889535B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
| CN201910189779.9A Division CN110049011B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104782133A true CN104782133A (en) | 2015-07-15 |
| CN104782133B CN104782133B (en) | 2019-04-05 |
Family
ID=50432633
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910189779.9A Active CN110049011B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
| CN201910189780.1A Active CN109889535B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
| CN201380053098.0A Active CN104782133B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivering control |
Family Applications Before (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910189779.9A Active CN110049011B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
| CN201910189780.1A Active CN109889535B (en) | 2012-10-10 | 2013-10-10 | Method and apparatus for media data delivery control |
Country Status (10)
| Country | Link |
|---|---|
| US (3) | US10356143B2 (en) |
| EP (2) | EP3554086A1 (en) |
| JP (1) | JP6516674B2 (en) |
| KR (4) | KR102411983B1 (en) |
| CN (3) | CN110049011B (en) |
| AU (1) | AU2013330649B2 (en) |
| CA (1) | CA2887997C (en) |
| MX (1) | MX341787B (en) |
| RU (1) | RU2634908C2 (en) |
| WO (1) | WO2014058237A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106572062A (en) * | 2015-10-10 | 2017-04-19 | 上海交通大学 | Resource dynamical requesting method under heterogeneous media transmission network |
| CN109417515A (en) * | 2016-07-04 | 2019-03-01 | 瑞典爱立信有限公司 | For handling the methods, devices and systems of internet protocol packets |
| CN110505494A (en) * | 2018-05-18 | 2019-11-26 | 杭州海康威视数字技术股份有限公司 | Remove the method and device of network jitter |
| WO2020147768A1 (en) * | 2019-01-17 | 2020-07-23 | 华为技术有限公司 | Data processing method and data processing apparatus |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9852140B1 (en) * | 2012-11-07 | 2017-12-26 | Axcient, Inc. | Efficient file replication |
| KR102020025B1 (en) * | 2013-10-23 | 2019-09-10 | 한국전자통신연구원 | Apparatus and Method for Managing MMT buffer model using Reception quality feedback message |
| KR102202597B1 (en) * | 2014-06-20 | 2021-01-13 | 삼성전자주식회사 | A method and apparatus for providing a broadcast service based on a heterogenous network |
| KR102127641B1 (en) * | 2014-06-20 | 2020-06-30 | 삼성전자주식회사 | A method and apparatus for controlling reception of a broadcast service provided using application layer forward error correction scheme |
| JP6706784B2 (en) * | 2014-09-12 | 2020-06-10 | パナソニックＩｐマネジメント株式会社 | Transmitting device, receiving device, transmitting method and receiving method |
| KR101743441B1 (en) | 2015-02-13 | 2017-06-05 | 에스케이텔레콤 주식회사 | Method for providing streaming data through node linking with base station, and node using the same |
| WO2017022211A1 (en) * | 2015-08-03 | 2017-02-09 | パナソニックＩｐマネジメント株式会社 | Transmission method, reception method, transmission apparatus, and reception apparatus |
| US10205763B2 (en) * | 2015-08-26 | 2019-02-12 | Zhan Ma | Method and apparatus for the single input multiple output (SIMO) media adaptation |
| US10116576B2 (en) | 2015-10-19 | 2018-10-30 | Samsung Electronics Co., Ltd. | Methods and apparatus for random access of HEVC bitstream for MMT |
| CN107801103B (en) * | 2016-08-29 | 2020-04-03 | 上海交通大学 | Multimedia resource self-adaptive synchronization method based on network condition under heterogeneous network |
| KR102391799B1 (en) * | 2017-10-19 | 2022-04-29 | 삼성전자주식회사 | Apparatus and method for multimedia services based on unicast delivery |
| CN109688179B (en) * | 2017-10-19 | 2021-06-22 | 华为技术有限公司 | Communication method and communication device |
| FR3100412B1 (en) * | 2019-09-04 | 2021-08-06 | Sagemcom Broadband Sas | A method of decoding an audio / video input stream |
| CN111400653A (en) * | 2020-03-05 | 2020-07-10 | 江西师范大学 | Robustness analysis model evaluation method based on multi-path transmission system |
| CN111800491A (en) * | 2020-06-23 | 2020-10-20 | 成都完美时空网络技术有限公司 | Data transmission method, system, computing device and storage medium |
| CN113010538A (en) * | 2021-03-26 | 2021-06-22 | 和芯星通科技(北京)有限公司 | Satellite data management method |
| KR102589864B1 (en) * | 2023-02-16 | 2023-10-16 | (주)유유코리아 | Method for wireless WiFi transmission of digital sound with sound synchronization technology applied |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1669290A (en) * | 2002-07-19 | 2005-09-14 | 皇家飞利浦电子股份有限公司 | Jitter compensation method for systems having wall clocks |
| US20050254508A1 (en) * | 2004-05-13 | 2005-11-17 | Nokia Corporation | Cooperation between packetized data bit-rate adaptation and data packet re-transmission |
| US20060291386A1 (en) * | 2005-06-28 | 2006-12-28 | Nokia Corporation | Optimizing playback startup time of bursty real-time streams |
| US20070253449A1 (en) * | 2005-12-22 | 2007-11-01 | Arnab Das | Methods and apparatus related to determining, communicating, and/or using delay information |
| US20120036277A1 (en) * | 2009-03-16 | 2012-02-09 | Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno | Modified Stream Synchronization |
Family Cites Families (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5566208A (en) * | 1994-03-17 | 1996-10-15 | Philips Electronics North America Corp. | Encoder buffer having an effective size which varies automatically with the channel bit-rate |
| JPH10229429A (en) | 1997-02-13 | 1998-08-25 | Oki Electric Ind Co Ltd | Communication network system |
| US6577621B1 (en) | 1999-06-22 | 2003-06-10 | Ericsson Inc. | System and method for providing high-speed local telecommunications access |
| GB9929794D0 (en) | 1999-12-16 | 2000-02-09 | Nokia Networks Oy | Data transmission apparatus |
| EP1143671B1 (en) * | 2000-04-07 | 2004-07-21 | NTT DoCoMo, Inc. | Device and method for reducing delay jitter in data transmission |
| WO2002013095A2 (en) | 2000-08-03 | 2002-02-14 | Unicru, Inc. | Electronic employee selection systems and methods |
| JP3857533B2 (en) | 2001-03-21 | 2006-12-13 | 株式会社日立製作所 | Signal receiving apparatus and signal receiving method |
| AU2003249115A1 (en) * | 2002-07-16 | 2004-02-02 | Nokia Corporation | Method for enabling packet transfer delay compensation in multimedia streaming |
| US7787539B2 (en) * | 2002-07-17 | 2010-08-31 | Broadcom Corporation | Decoding and presentation time stamps for MPEG-4 advanced video coding |
| EP1553735A1 (en) | 2002-10-17 | 2005-07-13 | Matsushita Electric Industrial Co., Ltd. | Packet transmission/reception device |
| US20040117858A1 (en) * | 2002-12-12 | 2004-06-17 | Boudreau Paul A. | Data enhanced multi-media system for an external device |
| US7474624B2 (en) * | 2003-05-29 | 2009-01-06 | Motorola, Inc. | Method and apparatus for reducing delay jitter |
| JP2005136464A (en) | 2003-10-28 | 2005-05-26 | Pioneer Electronic Corp | Data output device, data transmitting device, data processing system, data output method, data transmitting method, data processing method, their programs and recording media with these programs recorded |
| JP2005184580A (en) | 2003-12-22 | 2005-07-07 | Sony Corp | Communication system, information processing apparatus and method thereof, program and recording medium |
| US7733919B2 (en) * | 2004-07-12 | 2010-06-08 | General Instrument Corporation | Method and apparatus for processing transport stream packets to compensate for jitter |
| IL163092A (en) | 2004-07-19 | 2010-11-30 | Veraz Networks Ltd | Processing of packets forwarded in communication networks |
| US7830900B2 (en) * | 2004-08-30 | 2010-11-09 | Qualcomm Incorporated | Method and apparatus for an adaptive de-jitter buffer |
| ATE511721T1 (en) * | 2004-10-06 | 2011-06-15 | Nokia Corp | COMPILE FORWARD ERROR CORRECTION FRAMEWORK |
| US7522528B2 (en) * | 2004-11-18 | 2009-04-21 | Qvidium Technologies, Inc. | Low-latency automatic repeat request packet recovery mechanism for media streams |
| AU2006231216A1 (en) * | 2005-04-07 | 2006-10-12 | Nokia Corporation | Buffering in streaming delivery |
| WO2007077739A1 (en) * | 2005-12-28 | 2007-07-12 | Matsushita Electric Industrial Co., Ltd. | Transmission device and reception device |
| US7746882B2 (en) * | 2006-08-22 | 2010-06-29 | Nokia Corporation | Method and device for assembling forward error correction frames in multimedia streaming |
| JP4943513B2 (en) * | 2006-12-20 | 2012-05-30 | トムソン リサーチ ファンディング コーポレイション | Video data loss recovery system using low bit rate stream of IPTV |
| US20080225838A1 (en) * | 2007-03-15 | 2008-09-18 | Nokia Corporation | Common Rate Matching Slot for Variable Bit Rate Services |
| JP4919890B2 (en) * | 2007-07-11 | 2012-04-18 | 株式会社日立製作所 | Wireless system, base station and mobile station |
| US8340121B2 (en) * | 2007-08-22 | 2012-12-25 | Qualcomm Incorporated | Method and apparatus for transmission of circuit switched voice over packet switched networks |
| KR101571145B1 (en) * | 2007-10-23 | 2015-11-23 | 톰슨 라이센싱 | Method and apparatus for adaptive forward error correction with merged automatic repeat request for reliable multicast in wireless local area networks |
| EP2099176A1 (en) * | 2007-12-18 | 2009-09-09 | Nokia Corporation | Method and device for adapting a buffer of a terminal and communication system comprising such device |
| US9143810B2 (en) * | 2008-03-13 | 2015-09-22 | Telefonaktiebolaget L M Ericsson (Publ) | Method for manually optimizing jitter, delay and synch levels in audio-video transmission |
| US20100011274A1 (en) | 2008-06-12 | 2010-01-14 | Qualcomm Incorporated | Hypothetical fec decoder and signalling for decoding control |
| US7920475B2 (en) * | 2008-12-15 | 2011-04-05 | Verizon Patent And Licensing Inc. | System and method for adaptive removal of delay jitter effect and low end-to-end delay |
| CN101656682B (en) * | 2009-06-12 | 2011-09-21 | 中兴通讯股份有限公司 | Method and system for processing mobile multimedia data broadcasting services |
| JP2011023992A (en) | 2009-07-16 | 2011-02-03 | Hitachi Consumer Electronics Co Ltd | Content distribution system, reproducing device, and distribution server |
| KR101286912B1 (en) * | 2009-12-18 | 2013-07-16 | 한국전자통신연구원 | Variable size packets fec encoding and fec decoding method based on 3 dimension buffer |
| EP2343845A3 (en) | 2009-12-31 | 2011-10-19 | Thomson Licensing | Precise compensation of video propagation duration |
| EP3627798A1 (en) * | 2010-01-27 | 2020-03-25 | Koninklijke KPN N.V. | Method, system and device for synchronization of media streams |
| JP5397700B2 (en) * | 2010-04-09 | 2014-01-22 | ソニー株式会社 | Information processing apparatus and method |
| JP2011223359A (en) | 2010-04-09 | 2011-11-04 | Sony Corp | Delay controller, control method and communication system |
| JP2012070322A (en) * | 2010-09-27 | 2012-04-05 | Hitachi Kokusai Electric Inc | Image signal ip transmission system |
| WO2012077353A1 (en) | 2010-12-10 | 2012-06-14 | パナソニック株式会社 | Transmitting device, receiving device, transmitting method and receiving method |
| KR20120084234A (en) | 2011-01-19 | 2012-07-27 | 삼성전자주식회사 | Method for delivering mmt access unit for mpeg media transport |
| US8599827B2 (en) * | 2011-10-21 | 2013-12-03 | Telefonaktiebolaget Lm Ericsson (Publ) | Methods and apparatuses for maintaining synchronization between a radio equipment controller and an item of radio equipment |
-
2013
- 2013-10-08 US US14/049,022 patent/US10356143B2/en active Active
- 2013-10-10 CN CN201910189779.9A patent/CN110049011B/en active Active
- 2013-10-10 MX MX2015004596A patent/MX341787B/en active IP Right Grant
- 2013-10-10 KR KR1020217037258A patent/KR102411983B1/en active IP Right Grant
- 2013-10-10 EP EP19177048.6A patent/EP3554086A1/en active Pending
- 2013-10-10 EP EP13845741.1A patent/EP2907312B1/en active Active
- 2013-10-10 CN CN201910189780.1A patent/CN109889535B/en active Active
- 2013-10-10 KR KR1020207037104A patent/KR102328556B1/en active IP Right Grant
- 2013-10-10 CA CA2887997A patent/CA2887997C/en active Active
- 2013-10-10 KR KR1020207012443A patent/KR102196710B1/en active IP Right Grant
- 2013-10-10 AU AU2013330649A patent/AU2013330649B2/en not_active Ceased
- 2013-10-10 JP JP2015536713A patent/JP6516674B2/en active Active
- 2013-10-10 KR KR1020157012135A patent/KR102107716B1/en active IP Right Grant
- 2013-10-10 RU RU2015117519A patent/RU2634908C2/en active
- 2013-10-10 WO PCT/KR2013/009049 patent/WO2014058237A1/en active Application Filing
- 2013-10-10 CN CN201380053098.0A patent/CN104782133B/en active Active
-
2016
- 2016-05-06 US US15/149,001 patent/US10382515B2/en active Active
-
2019
- 2019-08-12 US US16/538,735 patent/US11381622B2/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1669290A (en) * | 2002-07-19 | 2005-09-14 | 皇家飞利浦电子股份有限公司 | Jitter compensation method for systems having wall clocks |
| US20050254508A1 (en) * | 2004-05-13 | 2005-11-17 | Nokia Corporation | Cooperation between packetized data bit-rate adaptation and data packet re-transmission |
| US20060291386A1 (en) * | 2005-06-28 | 2006-12-28 | Nokia Corporation | Optimizing playback startup time of bursty real-time streams |
| US20070253449A1 (en) * | 2005-12-22 | 2007-11-01 | Arnab Das | Methods and apparatus related to determining, communicating, and/or using delay information |
| US20120036277A1 (en) * | 2009-03-16 | 2012-02-09 | Nederlandse Organisatie Voor Toegepast-Natuurwetenschappelijk Onderzoek Tno | Modified Stream Synchronization |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106572062A (en) * | 2015-10-10 | 2017-04-19 | 上海交通大学 | Resource dynamical requesting method under heterogeneous media transmission network |
| CN109417515A (en) * | 2016-07-04 | 2019-03-01 | 瑞典爱立信有限公司 | For handling the methods, devices and systems of internet protocol packets |
| CN110505494A (en) * | 2018-05-18 | 2019-11-26 | 杭州海康威视数字技术股份有限公司 | Remove the method and device of network jitter |
| WO2020147768A1 (en) * | 2019-01-17 | 2020-07-23 | 华为技术有限公司 | Data processing method and data processing apparatus |
Also Published As
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104782133A (en) | Method and apparatus for media data delivery control | |
| CN105409174A (en) | Method and apparatus for packet transmission supporting downloading and streaming | |
| CN109076025B (en) | Method and apparatus for managing data removal | |
| CN112637144B (en) | Apparatus and method for transmitting information related to media data according to MMT protocol | |
| CN109196839B (en) | Apparatus and method for managing buffer for rate pacing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |