US20030163815A1 - Method and system for personalized multimedia delivery service - Google Patents

Method and system for personalized multimedia delivery service Download PDF

Info

Publication number
US20030163815A1
US20030163815A1 US10/034,679 US3467901A US2003163815A1 US 20030163815 A1 US20030163815 A1 US 20030163815A1 US 3467901 A US3467901 A US 3467901A US 2003163815 A1 US2003163815 A1 US 2003163815A1
Authority
US
United States
Prior art keywords
user
video
customized
clip
clips
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/034,679
Inventor
Lee Begeja
David Gibbon
Kenneth Huber
Zhu Liu
Robert Markowitz
Bernard Renger
Behzad Shahraray
Gary Zamchick
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AT&T Corp
Original Assignee
AT&T Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Assigned to AT&T CORP. reassignment AT&T CORP. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GIBBON, DAVID CRAWFORD, SHAHRARAY, BEHZAD, LIU, ZHU, HUBER, KENNETH MERVIN, MARKOWITZ, ROBERT EDWARD, BEGEJA, LEE, RENGER, BERNARD S., ZAMCHICK, GARY L.
Priority to US10/034,679 priority Critical patent/US20030163815A1/en
Application filed by AT&T Corp filed Critical AT&T Corp
Priority to CA002380898A priority patent/CA2380898A1/en
Priority to US10/163,091 priority patent/US8151298B2/en
Priority to US10/303,045 priority patent/US20030120748A1/en
Priority to US10/325,830 priority patent/US20030088687A1/en
Priority to US10/455,790 priority patent/US8060906B2/en
Publication of US20030163815A1 publication Critical patent/US20030163815A1/en
Priority to US11/256,755 priority patent/US8924383B2/en
Priority to US11/513,459 priority patent/US8296811B1/en
Priority to US13/609,896 priority patent/US9253519B2/en
Priority to US14/966,747 priority patent/US10462510B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26603Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4828End-user interface for program selection for searching program descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/632Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/16Analogue secrecy systems; Analogue subscription systems
    • H04N7/173Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309Transmission or handling of upstream communications
    • H04N7/17318Direct or substantially direct transmission and handling of requests

Definitions

  • the present invention relates to the delivery of multimedia assets to a user. More specifically, the present invention relates to a method and system for personalizing the manner in which the user selects and receives, via a network, stored multimedia assets.
  • some services store multimedia assets such as video segments and simultaneously provide associated meta-tags for searching those assets.
  • multimedia assets such as video segments and simultaneously provide associated meta-tags for searching those assets.
  • a particular news broadcast might be tagged as including certain content, such as content relating to the President of the United States.
  • These conventional tagging services are limited in usefulness.
  • Such conventional services are not always capable of accurately defining a portion of a video segment that will be of interest to a user, particularly when the meta-tags are not sufficiently detailed.
  • a news broadcast may be tagged as including content relevant to the President; however, when the user requests that news broadcast, he or she may find that the tagged content deals with the President's tax agenda, whereas the user was seeking information on education reform.
  • the present invention relates to a method for delivering a customized video presentation to a user.
  • the method includes searching, based on a user criterion, at least one video file to thereby identify a subset of the video file containing portions corresponding to the user criteria.
  • the method further includes calculating segments of the video file, the segments comprising the corresponding portions and portions adjacent to the corresponding portions, where the adjacent portions are relevant to the corresponding portions and the user criteria. Once the search has been performed and the segments calculated, the segments may be accessed from the video file. Thereafter, the accessed segments may be combined into the customized video presentation, which can then be made available to the user.
  • the invention in another embodiment, relates to a system for delivering a customized video presentation comprising video clips to a user.
  • the system may include a video capture device operable to receive a plurality of video inputs, as well as a video database operable to store the plurality of video inputs and text associated with the video inputs.
  • the system may also include a video server operable to search the video inputs within the video database in accordance with a user criterion and based on the text.
  • the video server may be further operable to extract from the video inputs video clips corresponding to the user criterion and combine the video clips into a customized video presentation for delivery to the user.
  • the video server may determine a length of each video clip by including only portions corresponding to the user criterion and surrounding portions that relate to the corresponding portions.
  • the invention relates to a system for receiving a customized video presentation.
  • the system may include a software client installed on a device of a user, and an interface for interacting with the software client to input a user search criterion.
  • the user search criterion may be used to provide search parameters for searching a plurality of video files.
  • the user may receive the customized video presentation comprising portions of the video files corresponding to the search parameters, and related portions, combined and made available to the user.
  • the present invention relates to a method for providing a customized video presentation to a user.
  • This method includes identifying, in response to a request from the user, clip pointers that identify, based on text associated with video inputs, beginning and end portions of video clips within the video inputs.
  • the method also includes making the clip pointers available to a user, and thereafter accessing the video inputs for delivery to the user a video clip corresponding to a clip pointer selected by the user.
  • FIG. 1 demonstrates an exemplary methodology for media processing according to one embodiment of the invention.
  • FIG. 2 implements an architecture for implementing an exemplary embodiment of the present invention.
  • FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the present invention.
  • FIG. 4 is an exemplary page view of a page viewed by a user utilizing a client according to one embodiment of the invention.
  • FIG. 5 demonstrates a page view showing a content retrieval page according to the exemplary embodiment shown in FIG. 4.
  • the present invention solves the above-discussed problems and provides a personalized, customizable multimedia delivery service that is convenient and easy to use.
  • the service works by recording all of the video streams of appropriate source and interest to a target audience.
  • the service may record content from a collection of (or a particular one of) sports or news channels on television.
  • the service may record content related to training videos, presentations or executive meetings in a business, school or other particularized environment. Recording may occur as the content is originally being broadcast (i.e., live), afterwards from recorded media, or even before the content is broadcast to its intended audience.
  • the content can be segmented, analyzed and/or classified, and thereafter stored on a platform.
  • the content can be broken down into its component parts, such as video, audio and/or text.
  • the text can include, for example, closed-captioning text associated with the original transmission, text generated from an audio portion by speech recognition software, or a transcription of the audio portion created before or after the transmission. In the latter case, it becomes possible to utilize the invention in conjunction with executive speeches, conferences, corporate training, business TV, advertising, and many other sources of video which do not typically have available an associated textual basis for searching the video.
  • the text provides the basis for an exemplary methodology for overcoming the above-identified problems associated with searching video in the prior art. That is, if a user wishes to search the stored content for video segments relevant to the President of the United States discussing a particular topic, then the President's name and the associated topic can be searched for within the text associated with the video segments. Whenever the President's name and the associated topic are located, an algorithm can be used to determine which portion of an entire video file actually pertains to the desired content and should therefore be extracted for delivery to the user.
  • a video file comprises an entire news broadcast about a number of subjects
  • the user will receive only those portions of the broadcast, if any, that pertain to the President and the particular topic desired. For example, this could include segments in which the President talks about the topic, or segments in which another talks about the topic and the President's position.
  • the pertinent segments of the broadcast have been appropriately extracted, for a given user, they can be stitched together for continuous delivery to that user.
  • the segments can be streamed to the user as a means of providing an easy-to-use delivery methodology for the user, and as a means of conserving bandwidth.
  • Users can view the delivered multimedia asset in its entirety, skip between the assets, or view only portions of the assets, as they desire.
  • a user can have access to portions of the original video file that occurred immediately before or after the extracted segments; for example, the user could choose to watch the entire original video file. Such access can be granted by including a “more” or “complete” button in a user interface.
  • a profile of the user is stored which specifies criteria for searching available multimedia assets.
  • the criteria may include, for example, key words and/or phrases, a source(s) of the content, etc.
  • the profile can be set directly by the user via interaction with an appropriately designed graphical user interface (GUI).
  • GUI graphical user interface
  • the present invention is capable of automatically searching the available assets on a periodic basis, and thereafter extracting, combining and delivering the compiled assets (or segments thereof, regardless of their original source) to the user.
  • the invention can be utilized such that a service platform assisting in implementing the invention notifies the user whenever new multimedia assets consistent with the user's profile have been prepared.
  • the invention may automatically deliver multimedia assets in accordance with a user's profile according to a predetermined schedule, such as hourly or daily. Alternatively, the invention may notify the user of the presence of desired video clips, rather than actually deliver those clips.
  • the assets can be classified and indexed on-the-fly as they are received. In this way, the assets can be compared against the user's profile virtually in real-time, so that results can be provided to the user (and the user can be notified) whenever they become available. Furthermore, a user can provide criteria for a search or searches beyond those set in the user's profile.
  • the identified assets can be delivered to the user in a variety of manners. For example, delivery may occur via cable or satellite television, or directly to a personal computer.
  • the present invention can be practiced via a plurality of platforms and networks. For example, the invention may be practiced over the Internet to reach a large consumer audience, or it may be practiced over an intranet to reach a highly targeted business or industry target.
  • the present invention allows video streaming of identified video clips.
  • Video streaming i.e., allowing the viewing of a video clip as it is downloaded rather than only after it is downloaded, which speeds the viewing process and largely obviates the need for video storage at the user location
  • Video streaming is a communications technique that is growing in popularity with the increasing availability of both video players (especially for use with personal computers) and bandwidth to the average consumer.
  • no conventional service allows users to accurately and quickly find desired clips for playing, and do not provide a ready means for providers to profit from the video streams that are provided.
  • users may receive only those video clips identified by a search executed on the user's behalf. However, if a user desires, he or she may also choose to view an entire program from which the clip(s) was extracted. A user may also be allowed to choose some or all of the video clips for long-term storage, whereby the clip(s) can be archived for later use. In one embodiment, the user may store the clips at a local computer, and thereafter make the clips available to other users connected via a peer-to-peer network.
  • the present invention allows improved video-on-demand (VOD).
  • VOD is typically defined in the cable/satellite television arena as the ability to request programming at any time and to have VCR-like controls over the content being streamed to the TV.
  • the present invention adds value to conventional VOD by allowing the user to demand video more accurately and completely.
  • PVR personal video recorder
  • Current PVR implementations are offered by TiVo and ReplayTV, and allow users great flexibility in storing programs for later viewing and/or manipulation in viewing (e.g., skipping over commercials in a television program).
  • the present invention provides a searching tool for allowing users to find interesting programs, even from a variety of channel sources, to thereafter be recorded and viewed using PVR technology.
  • the present invention permits the recording of only those portions of programs that the user desires.
  • the present invention contemplates recording the desired portions either by doing so directly from the program, or by recording the entire program locally and then utilizing only those portions of the program desired by the user.
  • video file refers generically to any analog or digital video information, including any content associated therewith, such as multimedia content, closed-captioning text, etc.
  • clip should be understood to refer to any subsection of a video program that is selected based on a user search criterion.
  • extracting refers to the use of a selected portion of the video file. Such use may include literal removal (permanent or temporary) from the context of a larger file, copying of the selected portion for external use, or any other method for utilizing the selected portion.
  • a user may accurately, completely and promptly receive multimedia assets that he or she finds interesting, and may conveniently exploit the received assets in a manner best-suited to that user.
  • FIG. 1 demonstrates an exemplary methodology for media processing in a digital video library (DVL) according to one embodiment of the invention.
  • DVD digital video library
  • Such media processing is used in implementing the present invention at a user level, by capturing, segmenting and classifying multimedia assets for later use and manipulation.
  • FIG. 1 and discussion of associated concepts are provided in greater detail in the following documents, which are hereby incorporated herein by reference: Shahraray B., “Scene Change Detection and Content-Based Sampling of Video Sequences,” Proc. SPIE 2419, Digital Video Compression: Algorithms and Technologies , pp.
  • multimedia assets including video 105 , associated text captions 110 and corresponding audio portions 115 are imported into the system for processing.
  • Content-based sampling engine 135 receives the video and segments it into individual shots or video frames; this information will be combined with information extracted from the other components of the video program to enable the extraction of individual stories (i.e., video segments related to a particular topic or topics), as will be described. Additionally, this process allows a representative image for a particular story, segment or clip to be selected by engine 160 ; and second, the process allows boundaries around the story, segment or clip to be set by engine 155 .
  • a database 120 of linguistic rules is used by linguistic analysis engine 140 to combine the caption information 110 with the segmented video within engines 155 and 160 , to thereby assist in the functionality of those two engines.
  • information within model databases 125 and 130 is used by acoustic classification engine 145 and program identification engine 150 to provide segmentation/identification of commercials and programs, respectively.
  • All of the information from engines 135 - 150 is utilized in engines 155 and 160 to discern a length of a particular video story or clip that will be associated with each topic.
  • multimodal story segmentation algorithms such as those described in “Automated Generation of News Content Hierarchy By Integrating Audio, Video, and Text Information” (above) can be used to determine an appropriate length of a video clip to be associated with a particular topic.
  • the algorithm can be used in conjunction with the user profile to either compare the profile information to newly-acquired content on-the-fly, or to similarly determine an appropriate length for a video clip to be associated with a particular portion of the user profile.
  • textual information used to identify clips of interest can be derived, for example, from closed-captioned text that accompanies most television programs.
  • Real-time closed captioning typically lags behind the audio and video by a variable amount of time from about 1 to 10 seconds.
  • the embodiment of FIG. 1 is capable of using speech processing to generate very accurate word timestamps.
  • a large vocabulary automatic speech recognition system can be used to generate a transcript of the audio track. While the accuracy of the automatically generated transcripts is below that of closed captions, they provide a reasonable alternative for identifying clips of interest with reduced, but acceptable, accuracy.
  • a parallel text alignment algorithm can be used to import high quality off-line transcripts of the program when they are or become available.
  • FIG. 2 implements an architecture for implementing an exemplary embodiment of the present invention. It should be noted that the architectural elements discussed below can be deployed to a user and/or provider of multimedia assets in whole or in part, and therefore each element interfaces with one another and external components using standard, conventional interfaces.
  • Video Capture/Media Analysis component 205 records and compresses broadcast TV programming. Also at component 205 , various functions can be performed on the content such as scene change detection, audio analysis, and compression. These video files are shipped to the Video Storage database 210 from which they will be served when the video is streamed to the client 250 .
  • Associated metadata is shipped to the Metadata database 215 .
  • thumbnail images are included as part of the metadata, as well as terms and/or phrases associated with a clip(s) for categorizing the clip(s) within a topical subset.
  • this video capture/media analysis process need not occur in real time. However, there is no reason why it could not occur in real time if an operator so desires and wishes to devote sufficient computational resources. In any case, it is not necessary to wait until a show is completed before indexing and searching that show.
  • Video Server 220 responds to clip requests and makes the video content available to the client 250 .
  • the video server 220 may download the video clips in whole or in part, stream the clips (e.g., via MPEG4 ASF or MPEG2) to the client 250 or generate the clip metadata discussed above (such as terms and/or phrases associated with a clip for categorizing the clip within a topical subset).
  • DVL Server 225 handles query requests (such as how many clips are available, which shows have clips, etc.) and/or clip content requests (metadata that describes clip content including “clip pointer” to video content). Thus, it handles multimedia search (such as closed captioning text) and determines the start and stop times of the clips, which are designated with “clip pointers,” as just mentioned
  • eClips server 230 handles client requests for web pages related to a service for providing eClips.
  • eClips server 230 utilizes Perl Common Gateway Interface (CGI) scripts that the client navigates in order to perform the functions of the eClips service. For example, the scripts deal with login/registration related pages, home page, profile related pages, archive related pages, player pages, and administration related pages. Player scripts can be launched in a separate window.
  • CGI request from the client 250 will return HTML with HTML DIVs, JavaScript, and CSS style sheets. The DIVs and CSS style sheets are used to position the various elements of the page.
  • DHTML is used to dynamically load DIV content on the fly (for instance, a list of shows in an instant search pulldown performed by a user).
  • FIG. 2 three databases 235 , 240 and 245 are shown as Extensible Markup Language (XML) databases.
  • XML Extensible Markup Language
  • Perl scripts can be utilized to access (i.e., read from and/or write to) these databases via XML.
  • these three databases include show database 235 , which contains information about recorded broadcasts, Profile database 245 , which contains personal search terms and/or phrases, and Archive database 240 , which contains saved clip information (e.g., entire clips or simply clip pointers).
  • eClips Client 250 includes a JavaScript that each Perl script includes in the HTML that is returned from the eClips server 230 . It is through the JavaScript that the client 250 interacts with the DVL server to determine the desired content and through JavaScript that the client initiates the streaming content with the video server 220 . The JavaScript also accesses (reads) the Show and Profile XML files in those databases.
  • the Video Server 220 may have a separate IP host name, and should support HTTP streaming.
  • the DVL and eClips servers may have the same IP host name, and may be colocated within a single machine.
  • FIG. 2 the key interactions that cause video to be streamed to the client 250 are demonstrated.
  • a user has logged in already and should see a list of topics determined by their profile, as well as the number of clips for each topic.
  • An example of a topic could be “sports” and the keyword string associated with this topic could be football, baseball, hockey.
  • the keyword string is used to search the CC text (in this case, clips that have any of these terms will be valid).
  • JavaScript will send a CGI query to DVL server 225 , which generates an XML response.
  • the XML is parsed into JavaScript variables on the client using the XML document object model (DOM).
  • the CGI query and XML response is implemented as part of the DVL system and acts as a layer above an Index Server, which, as part of the DVL server 225 , performs text indexing of the video clips (as discussed above) that allows the user to locate a desired clip.
  • the XML response will include the number of clips found for each topic. It is with these query responses that the home page knows which topics have hits and can activate the links to play the content.
  • JavaScript links when clicked, can launch the player page in a separate window.
  • the JavaScript may also run a query to get the list of shows with clips for a particular topic.
  • the JavaScript then loops through all the shows with hits and queries the DVL server via the separate CGI script to get the clip information needed to play the clip. This information is also returned via XML and parsed via the JavaScript.
  • the JavaScript loads various DIVs that depend on this information, such as hit search term found in CC text, CC text, and thumbnail.
  • the player page JavaScript starts the media player with the first clip using a pointer (start time) to the video.
  • start time a pointer
  • eClips client 250 may reside on, for example, a user's home or business computer, a personal digital assistant (PDA), or a set-top box on a user's television set.
  • Client 250 interacts with eClips server 230 as discussed above to provide the user with an interface for viewing and utilizing the video clips.
  • Client 250 can be written to contain, for example, a JavaScript object that contains profile results (eClips object).
  • a user using eClips client 250 running on a PC may accesses stored clips through a network, such as the Internet or a locally-defined intranet.
  • the user defines a search criterion, either through an “instant search” feature or within a user profile. When multiple clips are found matching the user search, the clips can be stitched together and streamed to the user as one continuous program.
  • eClips server periodically searches for clips matching a given user's profile, and makes the clips available to the user, perhaps by notifying the user via email of the availability of the clips.
  • the architecture shown in FIG. 2 allows for video to be stored and displayed in several formats including MPEG2 (e.g., for digital television and video on demand) and MPEG4 (e.g., for streaming video on the Internet).
  • MPEG2 e.g., for digital television and video on demand
  • MPEG4 e.g., for streaming video on the Internet
  • the video may be stored for later use by the user; in particular, a user may archive some or all of the received video and thereafter permit searching and uploading of the video from storage by other members of a peer-to-peer computer network.
  • FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the present invention.
  • video feeds 310 are captured at video capture device 310 within a cable service digital media center 305 , and forwarded to video server 220 .
  • Video analysis can be performed at component 315 , whereupon the video is forwarded to DVL/eClips server 225 / 230 within cable Headend 325 .
  • the DVL/eClips servers 225 / 230 operate as described above in conjunction with FIG. 2 to deliver, using, for example, Hybrid Fiber Coax (HFC) connections, all or part of the video feeds to routing hub 330 , and then through fiber node 340 to cable modem 350 located within user home 355 .
  • Additional marketing and advertising could be tied into the video stream in one embodiment of the present invention at the Headend from providers 320 such as DoubleClick.
  • the feed is received at cable modem 350 via high speed data line (HSD) to a PC 360 running eClips client 250 .
  • HSD high speed data line
  • the feed could be sent to Settop box 370 atop TV 380 , where Settop box 370 runs eClips client 250 .
  • the service can be streamed as high speed data (HSD) through a cable modem as MPEG4 video.
  • HSD high speed data
  • MPEG4 video video on demand
  • FIG. 4 is an exemplary page view of a page viewed by a user utilizing an eClips client according to one embodiment of the invention.
  • the user might see page view 400 just after logging in to a system implementing the present invention.
  • section 405 demonstrates the results of a profile search performed for the user on a given day, or over some other pre-defined period, according to the previously stored profile of that user.
  • clips are listed both by topic and by number of clips related to that topic.
  • the user therefore has the option of viewing one or more of the clips related to a particular topic.
  • Section 405 also identifies a source for the criteria used to select the various topical clips. More specifically, on a profile page, a user can select default sources (shows) which will be searched based on the user's profile; this is referred to as a “Main” list, and would restrict any profile topic that has the Main option to search only those shows selected on the profile page. On a topic editor page, where a user is allowed to add or modify topics for searching, the user can specify this Main list, or can make Custom selections that are only valid for a particular search topic. In section 405 , the user has selected the latter option, and so a “source” is shown as Custom.
  • section 410 the user additionally has the option of entering new search terms and/or phrases not related to his or her current profile, whereby the present invention searches a clips database via DVL server as described above with respect to FIG. 2.
  • Section 415 indicates the media sources which will be searched for the terms or phrases entered in section 410 .
  • button 420 “Play all clips,” allows a user to view all currently available clips with one click.
  • the user can add a new topic using button 425 .
  • the user can return to a home page by clicking on button 430 (although this option is only valid when the user is on a page different from the home page 400 itself), access his profile via button 435 and access an archive of previously saved clips via button 440 .
  • a user can log out of the service using button 445 .
  • FIG. 5 demonstrates a page view 500 showing a content retrieval page according to the exemplary embodiment shown in FIG. 4.
  • section 505 still frames of the beginning of each clip (i.e., thumbnails) within a topic can be viewed by the user.
  • Section 505 can be controlled by section 515 , which allows the user to select a topic of clips to be shown, as well as section 520 , which allows a user to select a portion of the clips from that topic that will be played.
  • buttons 560 and 565 a user may clear or select all of the clips being shown within a particular topic.
  • Section 510 can be controlled by buttons 525 - 550 , which allow a user to skip to a previous clip with button 525 , stop the clip with button 530 , play the clip with button 535 , skip the clip with button 540 , switch to a new topic of clips with button 545 or view footage after the selected clip(s) with button 550 .
  • section 510 may also include advertisements 555 , and may display a time remaining for a currently playing clip, a source of the clip, and a date and time the clip was originally broadcast.
  • page 500 will play all of the clips currently available in a predetermined order (e.g., reverse chronological order, by source of content, etc.) if the user does not choose a specific topic or clip.
  • Button 570 is activated when a user wants to view the clip(s) available; i.e., as shown in view 500 .
  • Button 575 allows the user to send (e.g., email) the clip(s) to another user, and button 580 allows the user to save the clip(s) to an archive (i.e., the archive accessed by button 440 in FIG. 4).
  • the present invention can capture content from nearly any multimedia source and then use standard streaming media to deliver the appropriate associated clips, it is nearly limitless in the markets and industries that it can support.
  • the present invention can be packaged to address different market segments. Therefore, it should be assumed that the target markets and applications supported could fall into, for example, any or all of the Consumer, Business-to-Consumer or Business-to-Business Marketplaces. The following discussion summarizes some exemplary application categories.
  • the present invention can be provided as an extension to standard television programming.
  • an ISP may allow consumers to sign up for this service, or the set of features provided by the present invention can be provided as a premium subscription.
  • a consumer would enter a set of keywords and/or phrases in the profile.
  • the user may determine that only specific content sources should be monitored.
  • the user profile is created or changed it would be updated in the user profile database.
  • the user profile database is matched against the closed captioning/text.
  • a consumer may be interested in sports but only want to see the specific “play of the day.”
  • the consumer would enter the key words “play of the day” and then identify in the profile the specific content sources (channels or programs) that should be recorded/analyzed by the present invention. For example, the consumer could choose channels that play sports games or report on sports news.
  • the present invention can be provided as an extension to standard television programming.
  • both the programming and its sponsorship would be different from the consumer model above.
  • a corporate sponsor or numerous corporate sponsors may offer specific types of content, or may offer an assemblage of content overlaid with advertising sponsorship.
  • the sponsorship would be evident in the advertising that would be embedded in the player or in the content, since the design of the present invention is modular in design and allows for customization.
  • the Business-to-Consumer service model a consumer would enter a set of keywords in the profile. As the user profile is created or changed it would be updated in the user profile database. Because this model and the content provided would be underwritten by corporate sponsorship, the content provided may be limited to a proprietary set of content. As an example, if CNN were the sponsor of the service, all of the content provided may be limited to CNN's own broadcasts. In addition, it may be very evident to the consumer that the service is brought to them by CNN in that the CNN logo may be embedded in the user interface, or may be embedded in the content itself.
  • the present invention can be used in intra-company applications as well as extra-company applications.
  • the applications supported include, as just a few examples: Business TV, Advertising, Executive Announcements, Financial News, Training, Competitive Information Services, Industry Conferences, etc.
  • the present invention can be used as a tool to assist employees in retrieving and viewing specific portions of content on demand.
  • the user may wish to combine sources from within the business and sources outside of the business.
  • a user may wish to see all clips dealing with the category “Virtual Private Networks.”
  • a business may have planned a new advertising campaign talking about “Virtual Private Networks” and have an advertisement available to its internal personnel.
  • there may be an internal training class that has been recorded and is available internally in which a section talks about “Virtual Private Networks.” Again, this could be another content option captured by the present invention.
  • one of this company's competitors may have provided a talk at an industry conference the day before about their solution for the “Virtual Private Network” area.
  • the present invention can provide businesses, their suppliers, their best customers, and all other members of communities of interests with specific targeted content clips that strengthen the relationships. These may include (but not be limited to) product details, new announcements, public relations messages, etc.
  • financial information can be available for both professionals and potential clients to receive late-breaking information on stocks, companies and the global markets.
  • the information can be from a variety of sources such as Financial News Network, Bloomberg, CNN, etc. and allow users to identify key areas of interest and to continually be up to date.
  • the movie industry can use the present invention to easily scan through archives of old and new movie footage that can be digitized and stored in a central repository. Sports highlights can be made available for particular games or events. Networks could maintain a library of indexed TV shows (e.g., PBS) where users can search for a particular episode/topic.
  • indexed TV shows e.g., PBS
  • the present invention can be an information dissemination tool for finding the latest information quickly when videos are captured of talks and demonstrations in key events.
  • the content can include video clips as discussed primarily above, or can be limited to still frames and text (or just text) if bandwidth/storage does not permit full motion video with audio.
  • Hybrid schemes are also contemplated in which some of the content includes video, but other (e.g. perhaps older, or repeated similar stories from multiple sources) clips only include audio, or include only still images and/or text.
  • multimedia analysis techniques can be used to determine if stories are about the same topic, or contain the same video material. Because the present invention is capable of using standard access and delivery methods, it can be employed in virtually any home or industry application where delivery of multimedia assets is desired.

Abstract

A method and system for extracting multimedia content segments, such as electronic clips or “eClips,” from a source of video or other multimedia content. The extraction is based on individual preferences such as key terms and/or phrases as well as content source, which a user may identify in a profile. User profiles can be stored in a service platform and continually checked against new content in the system. When matches are found between a user profile and the content, the service platform can alert the user that segments have been identified and extracted. The user may then view/play these automatically provided segments (eClips). In addition, the eClips service is capable of stitching the clips of diverse sources together, providing an automatically generated multimedia experience that revolves around the user's provided profile.

Description

  • This application claims priority to provisional application No. 60/282,204, which was filed Apr. 6, 2001, and to provisional application No. 60/296,436, which was filed Jun. 6, 2001, and which are hereby incorporated by reference.[0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The present invention relates to the delivery of multimedia assets to a user. More specifically, the present invention relates to a method and system for personalizing the manner in which the user selects and receives, via a network, stored multimedia assets. [0003]
  • 2. Description of the Related Art [0004]
  • An ability to capture, store and transfer multimedia assets has recently grown in importance as businesses and consumers seek to take advantage of every aspect of their computers, televisions and associated networks. For example, where users were able to observe only the news brought to them by their local or national television news or newspapers, Internet users are now able to actively access information from any news source that has an Internet presence. Similarly, satellite television users are capable of receiving far more specialized channels than were available just a few years ago. Moreover, users who were used to merely reading about an event now wish to actually watch video footage of that event. [0005]
  • Unfortunately, the overabundance of information provided by the types and sources of information currently available can often be overwhelming to an individual, and that individual may become incapable of, or uninterested in, sorting through the information for items that he or she finds of interest. Therefore, what is needed is a service or ability to provide a user with only that information which the user will find of interest. [0006]
  • However, even once the user's interests have been identified, it can be difficult to locate and provide media associated with those interests. Particularly in the case of video segments, there is currently no suitable methodology for searching and delivering multimedia assets such that a user may obtain them in a personalized or customizable manner. For example, it is very difficult to apply traditional text-based searching techniques to the finding of a particular video segment from amongst a plurality of video segments. Some conventional services attempt to provide this ability; however, none currently does so in an acceptable manner. [0007]
  • For example, some services store multimedia assets such as video segments and simultaneously provide associated meta-tags for searching those assets. In this way, a particular news broadcast might be tagged as including certain content, such as content relating to the President of the United States. These conventional tagging services are limited in usefulness. [0008]
  • First, such conventional services are not always capable of accurately defining a portion of a video segment that will be of interest to a user, particularly when the meta-tags are not sufficiently detailed. In this example, a news broadcast may be tagged as including content relevant to the President; however, when the user requests that news broadcast, he or she may find that the tagged content deals with the President's tax agenda, whereas the user was seeking information on education reform. [0009]
  • Secondly, even when a broadcast is correctly identified as containing information sought by the user, the user may still be forced to sift through a fairly large amount of information to find the information sought. In the above example, even if a half-hour news broadcast was correctly tagged as containing information about the President's education reform agenda, the user may still have to view or skim virtually the entire broadcast to find that desired clip or segment of information. [0010]
  • Furthermore, even to the extent that conventional services can locate a desired multimedia asset, they are often incapable of both doing the search and thereafter delivering the asset to the user in a manner convenient to the user. That is, typically the user must perform the search himself, choose relevant results and then work to import the chosen assets. [0011]
  • Therefore, what is needed is a system and method for conveniently locating and delivering multimedia assets to a user such that the user receives only the assets (or portions thereof) that he or she desires, and such that the assets are received in an easy-to-use format. [0012]
  • SUMMARY OF THE INVENTION
  • In one exemplary embodiment, the present invention relates to a method for delivering a customized video presentation to a user. The method according to this embodiment includes searching, based on a user criterion, at least one video file to thereby identify a subset of the video file containing portions corresponding to the user criteria. The method further includes calculating segments of the video file, the segments comprising the corresponding portions and portions adjacent to the corresponding portions, where the adjacent portions are relevant to the corresponding portions and the user criteria. Once the search has been performed and the segments calculated, the segments may be accessed from the video file. Thereafter, the accessed segments may be combined into the customized video presentation, which can then be made available to the user. [0013]
  • In another embodiment, the invention relates to a system for delivering a customized video presentation comprising video clips to a user. The system may include a video capture device operable to receive a plurality of video inputs, as well as a video database operable to store the plurality of video inputs and text associated with the video inputs. The system may also include a video server operable to search the video inputs within the video database in accordance with a user criterion and based on the text. The video server may be further operable to extract from the video inputs video clips corresponding to the user criterion and combine the video clips into a customized video presentation for delivery to the user. The video server may determine a length of each video clip by including only portions corresponding to the user criterion and surrounding portions that relate to the corresponding portions. [0014]
  • In yet another embodiment, the invention relates to a system for receiving a customized video presentation. The system may include a software client installed on a device of a user, and an interface for interacting with the software client to input a user search criterion. The user search criterion may be used to provide search parameters for searching a plurality of video files. Further, the user may receive the customized video presentation comprising portions of the video files corresponding to the search parameters, and related portions, combined and made available to the user. [0015]
  • In a final exemplary embodiment, the present invention relates to a method for providing a customized video presentation to a user. This method includes identifying, in response to a request from the user, clip pointers that identify, based on text associated with video inputs, beginning and end portions of video clips within the video inputs. The method also includes making the clip pointers available to a user, and thereafter accessing the video inputs for delivery to the user a video clip corresponding to a clip pointer selected by the user. [0016]
  • The features and advantages of the invention will become apparent from the following drawings and description.[0017]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention is described with reference to the accompanying drawings. In the drawings, like reference numbers indicate identical or functionally similar elements. Additionally, the left-most digit of a reference number identifies the drawing in which the reference number first appears. [0018]
  • FIG. 1 demonstrates an exemplary methodology for media processing according to one embodiment of the invention. [0019]
  • FIG. 2 implements an architecture for implementing an exemplary embodiment of the present invention. [0020]
  • FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the present invention. [0021]
  • FIG. 4 is an exemplary page view of a page viewed by a user utilizing a client according to one embodiment of the invention. [0022]
  • FIG. 5 demonstrates a page view showing a content retrieval page according to the exemplary embodiment shown in FIG. 4.[0023]
  • DETAILED DESCRIPTION
  • While the present invention is described below with respect to various exemplary embodiments, the present invention is not limited to only those embodiments that are disclosed. Other embodiments can be implemented by those skilled in the art without departing from the spirit and scope of the present invention. [0024]
  • The present invention solves the above-discussed problems and provides a personalized, customizable multimedia delivery service that is convenient and easy to use. In one embodiment of the invention, the service works by recording all of the video streams of appropriate source and interest to a target audience. For example, the service may record content from a collection of (or a particular one of) sports or news channels on television. In another example, the service may record content related to training videos, presentations or executive meetings in a business, school or other particularized environment. Recording may occur as the content is originally being broadcast (i.e., live), afterwards from recorded media, or even before the content is broadcast to its intended audience. [0025]
  • Once the content is captured and recorded, it can be segmented, analyzed and/or classified, and thereafter stored on a platform. For example, the content can be broken down into its component parts, such as video, audio and/or text. The text can include, for example, closed-captioning text associated with the original transmission, text generated from an audio portion by speech recognition software, or a transcription of the audio portion created before or after the transmission. In the latter case, it becomes possible to utilize the invention in conjunction with executive speeches, conferences, corporate training, business TV, advertising, and many other sources of video which do not typically have available an associated textual basis for searching the video. [0026]
  • Having obtained or generated the text, it can then be used as a basis for searching the multimedia content. In particular, the text provides the basis for an exemplary methodology for overcoming the above-identified problems associated with searching video in the prior art. That is, if a user wishes to search the stored content for video segments relevant to the President of the United States discussing a particular topic, then the President's name and the associated topic can be searched for within the text associated with the video segments. Whenever the President's name and the associated topic are located, an algorithm can be used to determine which portion of an entire video file actually pertains to the desired content and should therefore be extracted for delivery to the user. Thus, if a video file comprises an entire news broadcast about a number of subjects, the user will receive only those portions of the broadcast, if any, that pertain to the President and the particular topic desired. For example, this could include segments in which the President talks about the topic, or segments in which another talks about the topic and the President's position. [0027]
  • Once the pertinent segments of the broadcast have been appropriately extracted, for a given user, they can be stitched together for continuous delivery to that user. In this way, for example, the segments can be streamed to the user as a means of providing an easy-to-use delivery methodology for the user, and as a means of conserving bandwidth. Users can view the delivered multimedia asset in its entirety, skip between the assets, or view only portions of the assets, as they desire. Moreover, a user can have access to portions of the original video file that occurred immediately before or after the extracted segments; for example, the user could choose to watch the entire original video file. Such access can be granted by including a “more” or “complete” button in a user interface. [0028]
  • In one embodiment of the invention, a profile of the user is stored which specifies criteria for searching available multimedia assets. The criteria may include, for example, key words and/or phrases, a source(s) of the content, etc. The profile can be set directly by the user via interaction with an appropriately designed graphical user interface (GUI). When such a profile is available, the present invention is capable of automatically searching the available assets on a periodic basis, and thereafter extracting, combining and delivering the compiled assets (or segments thereof, regardless of their original source) to the user. In one embodiment, the invention can be utilized such that a service platform assisting in implementing the invention notifies the user whenever new multimedia assets consistent with the user's profile have been prepared. In another embodiment, the invention may automatically deliver multimedia assets in accordance with a user's profile according to a predetermined schedule, such as hourly or daily. Alternatively, the invention may notify the user of the presence of desired video clips, rather than actually deliver those clips. [0029]
  • The assets can be classified and indexed on-the-fly as they are received. In this way, the assets can be compared against the user's profile virtually in real-time, so that results can be provided to the user (and the user can be notified) whenever they become available. Furthermore, a user can provide criteria for a search or searches beyond those set in the user's profile. [0030]
  • The identified assets can be delivered to the user in a variety of manners. For example, delivery may occur via cable or satellite television, or directly to a personal computer. The present invention can be practiced via a plurality of platforms and networks. For example, the invention may be practiced over the Internet to reach a large consumer audience, or it may be practiced over an intranet to reach a highly targeted business or industry target. [0031]
  • In one embodiment, the present invention allows video streaming of identified video clips. Video streaming (i.e., allowing the viewing of a video clip as it is downloaded rather than only after it is downloaded, which speeds the viewing process and largely obviates the need for video storage at the user location) is a communications technique that is growing in popularity with the increasing availability of both video players (especially for use with personal computers) and bandwidth to the average consumer. However, no conventional service allows users to accurately and quickly find desired clips for playing, and do not provide a ready means for providers to profit from the video streams that are provided. [0032]
  • When streaming the identified video clips, users may receive only those video clips identified by a search executed on the user's behalf. However, if a user desires, he or she may also choose to view an entire program from which the clip(s) was extracted. A user may also be allowed to choose some or all of the video clips for long-term storage, whereby the clip(s) can be archived for later use. In one embodiment, the user may store the clips at a local computer, and thereafter make the clips available to other users connected via a peer-to-peer network. [0033]
  • In another embodiment, the present invention allows improved video-on-demand (VOD). VOD is typically defined in the cable/satellite television arena as the ability to request programming at any time and to have VCR-like controls over the content being streamed to the TV. The present invention adds value to conventional VOD by allowing the user to demand video more accurately and completely. [0034]
  • An extension to VOD is personal video recorder (PVR) technology, which allows even more control over TV programs being viewed. Current PVR implementations are offered by TiVo and ReplayTV, and allow users great flexibility in storing programs for later viewing and/or manipulation in viewing (e.g., skipping over commercials in a television program). The present invention provides a searching tool for allowing users to find interesting programs, even from a variety of channel sources, to thereafter be recorded and viewed using PVR technology. [0035]
  • Moreover, whereas conventional PVR records only entire programs based on a user's directions, the present invention permits the recording of only those portions of programs that the user desires. In this regard, the present invention contemplates recording the desired portions either by doing so directly from the program, or by recording the entire program locally and then utilizing only those portions of the program desired by the user. [0036]
  • Having described various exemplary embodiments of the invention, it should be noted that the terms “video file,” “video input,” “video,” “video program” or any similar term refers generically to any analog or digital video information, including any content associated therewith, such as multimedia content, closed-captioning text, etc. The terms “clip,” “video clip,” “electronic clip” or “eClip” should be understood to refer to any subsection of a video program that is selected based on a user search criterion. Also, the terms “extracting,” “parsing,” “removing,” “accessing” or any similar term with respect to a video file refers to the use of a selected portion of the video file. Such use may include literal removal (permanent or temporary) from the context of a larger file, copying of the selected portion for external use, or any other method for utilizing the selected portion. [0037]
  • Based on the above-described features of the invention, a user may accurately, completely and promptly receive multimedia assets that he or she finds interesting, and may conveniently exploit the received assets in a manner best-suited to that user. [0038]
  • FIG. 1 demonstrates an exemplary methodology for media processing in a digital video library (DVL) according to one embodiment of the invention. Such media processing is used in implementing the present invention at a user level, by capturing, segmenting and classifying multimedia assets for later use and manipulation. It should be noted that the media processing implementation of FIG. 1 and discussion of associated concepts are provided in greater detail in the following documents, which are hereby incorporated herein by reference: Shahraray B., “Scene Change Detection and Content-Based Sampling of Video Sequences,” Proc. SPIE 2419, [0039] Digital Video Compression: Algorithms and Technologies, pp. 2-13, February 1995; Shahraray B., Cox R., Haskell B., LeCun Y., Rabiner L., “Multimedia Processing for Advanced Communications Services”, in Multimedia Communications, F. De Natale and S. Pupolin Editors, pp. 510-523, Springer-Verlag, 1999; Gibbon D., “Generating Hypermedia Documents from Transcriptions of Television Programs Using Parallel Text Alignment,” in Handbook of Internet and Multimedia Systems and Applications, Borko Furht Editor, CRC Press 1998; Shahraray B. “Multimedia Information Retrieval Using Pictorial Transcripts,” in Handbook of Multimedia Computing, Borko Furht Editor, CRC Press 1998; and Huang Q., Liu Z., Rosenberg A., Gibbon D., Shahraray B., “Automated Generation of News Content Hierarchy By Integrating Audio, Video, and Text Information,” Proc. IEEE International Conference On Acoustics, Speech, and Signal Processing ICASSP'99, pp. 3025-3028, Phoenix; Ariz., May 1999.
  • In FIG. 1, multimedia [0040] assets including video 105, associated text captions 110 and corresponding audio portions 115 are imported into the system for processing. Content-based sampling engine 135 receives the video and segments it into individual shots or video frames; this information will be combined with information extracted from the other components of the video program to enable the extraction of individual stories (i.e., video segments related to a particular topic or topics), as will be described. Additionally, this process allows a representative image for a particular story, segment or clip to be selected by engine 160; and second, the process allows boundaries around the story, segment or clip to be set by engine 155.
  • A database [0041] 120 of linguistic rules is used by linguistic analysis engine 140 to combine the caption information 110 with the segmented video within engines 155 and 160, to thereby assist in the functionality of those two engines. Similarly, information within model databases 125 and 130 is used by acoustic classification engine 145 and program identification engine 150 to provide segmentation/identification of commercials and programs, respectively. Once the multimedia asset(s) have been captured, segmented and classified as described above, they can be stored thereafter in DVL database 165.
  • All of the information from engines [0042] 135-150 is utilized in engines 155 and 160 to discern a length of a particular video story or clip that will be associated with each topic. In particular, for example, multimodal story segmentation algorithms such as those described in “Automated Generation of News Content Hierarchy By Integrating Audio, Video, and Text Information” (above) can be used to determine an appropriate length of a video clip to be associated with a particular topic. Similarly, the algorithm can be used in conjunction with the user profile to either compare the profile information to newly-acquired content on-the-fly, or to similarly determine an appropriate length for a video clip to be associated with a particular portion of the user profile.
  • As referred to above, textual information used to identify clips of interest can be derived, for example, from closed-captioned text that accompanies most television programs. Real-time closed captioning typically lags behind the audio and video by a variable amount of time from about 1 to 10 seconds. To take this factor into account, the embodiment of FIG. 1 is capable of using speech processing to generate very accurate word timestamps. [0043]
  • When closed-captioned text is not available, a large vocabulary automatic speech recognition system can be used to generate a transcript of the audio track. While the accuracy of the automatically generated transcripts is below that of closed captions, they provide a reasonable alternative for identifying clips of interest with reduced, but acceptable, accuracy. Alternatively, a parallel text alignment algorithm can be used to import high quality off-line transcripts of the program when they are or become available. [0044]
  • FIG. 2 implements an architecture for implementing an exemplary embodiment of the present invention. It should be noted that the architectural elements discussed below can be deployed to a user and/or provider of multimedia assets in whole or in part, and therefore each element interfaces with one another and external components using standard, conventional interfaces. [0045]
  • In FIG. 2, Video Capture/[0046] Media Analysis component 205 records and compresses broadcast TV programming. Also at component 205, various functions can be performed on the content such as scene change detection, audio analysis, and compression. These video files are shipped to the Video Storage database 210 from which they will be served when the video is streamed to the client 250.
  • Associated metadata is shipped to the [0047] Metadata database 215. Note that thumbnail images are included as part of the metadata, as well as terms and/or phrases associated with a clip(s) for categorizing the clip(s) within a topical subset. Typically, this video capture/media analysis process need not occur in real time. However, there is no reason why it could not occur in real time if an operator so desires and wishes to devote sufficient computational resources. In any case, it is not necessary to wait until a show is completed before indexing and searching that show.
  • [0048] Video Server 220 responds to clip requests and makes the video content available to the client 250. For example, the video server 220 may download the video clips in whole or in part, stream the clips (e.g., via MPEG4 ASF or MPEG2) to the client 250 or generate the clip metadata discussed above (such as terms and/or phrases associated with a clip for categorizing the clip within a topical subset).
  • [0049] DVL Server 225 handles query requests (such as how many clips are available, which shows have clips, etc.) and/or clip content requests (metadata that describes clip content including “clip pointer” to video content). Thus, it handles multimedia search (such as closed captioning text) and determines the start and stop times of the clips, which are designated with “clip pointers,” as just mentioned
  • [0050] eClips server 230 handles client requests for web pages related to a service for providing eClips. eClips server 230 utilizes Perl Common Gateway Interface (CGI) scripts that the client navigates in order to perform the functions of the eClips service. For example, the scripts deal with login/registration related pages, home page, profile related pages, archive related pages, player pages, and administration related pages. Player scripts can be launched in a separate window. Each CGI request from the client 250 will return HTML with HTML DIVs, JavaScript, and CSS style sheets. The DIVs and CSS style sheets are used to position the various elements of the page. DHTML is used to dynamically load DIV content on the fly (for instance, a list of shows in an instant search pulldown performed by a user).
  • In FIG. 2, three [0051] databases 235, 240 and 245 are shown as Extensible Markup Language (XML) databases. Thus, Perl scripts can be utilized to access (i.e., read from and/or write to) these databases via XML. Specifically, these three databases include show database 235, which contains information about recorded broadcasts, Profile database 245, which contains personal search terms and/or phrases, and Archive database 240, which contains saved clip information (e.g., entire clips or simply clip pointers).
  • [0052] eClips Client 250, in one embodiment, includes a JavaScript that each Perl script includes in the HTML that is returned from the eClips server 230. It is through the JavaScript that the client 250 interacts with the DVL server to determine the desired content and through JavaScript that the client initiates the streaming content with the video server 220. The JavaScript also accesses (reads) the Show and Profile XML files in those databases.
  • The [0053] Video Server 220 may have a separate IP host name, and should support HTTP streaming. The DVL and eClips servers may have the same IP host name, and may be colocated within a single machine.
  • In FIG. 2, the key interactions that cause video to be streamed to the [0054] client 250 are demonstrated. In a home page view, a user has logged in already and should see a list of topics determined by their profile, as well as the number of clips for each topic. An example of a topic could be “sports” and the keyword string associated with this topic could be football, baseball, hockey. The keyword string is used to search the CC text (in this case, clips that have any of these terms will be valid).
  • When the home page is loaded, JavaScript will send a CGI query to [0055] DVL server 225, which generates an XML response. The XML is parsed into JavaScript variables on the client using the XML document object model (DOM). The CGI query and XML response is implemented as part of the DVL system and acts as a layer above an Index Server, which, as part of the DVL server 225, performs text indexing of the video clips (as discussed above) that allows the user to locate a desired clip. The XML response will include the number of clips found for each topic. It is with these query responses that the home page knows which topics have hits and can activate the links to play the content.
  • These JavaScript links, when clicked, can launch the player page in a separate window. When the player page is loaded, essentially the same JavaScript can be used to recalculate the number of clips for each topic. In principle, this could be changed to calculate this only once and to pass this on to the player script thereafter. The JavaScript may also run a query to get the list of shows with clips for a particular topic. The JavaScript then loops through all the shows with hits and queries the DVL server via the separate CGI script to get the clip information needed to play the clip. This information is also returned via XML and parsed via the JavaScript. The JavaScript loads various DIVs that depend on this information, such as hit search term found in CC text, CC text, and thumbnail. Finally, the player page JavaScript starts the media player with the first clip using a pointer (start time) to the video. It should be noted that, in one embodiment of the invention, the just-described process is almost completely automated, so that dynamic clip extraction occurs when a clip is selected, and a show automatically starts and will play completely through if not interrupted by the user. [0056]
  • In the architecture shown in FIG. 2, [0057] eClips client 250 may reside on, for example, a user's home or business computer, a personal digital assistant (PDA), or a set-top box on a user's television set. Client 250 interacts with eClips server 230 as discussed above to provide the user with an interface for viewing and utilizing the video clips. Client 250 can be written to contain, for example, a JavaScript object that contains profile results (eClips object). A user using eClips client 250 running on a PC may accesses stored clips through a network, such as the Internet or a locally-defined intranet.
  • In one embodiment, the user defines a search criterion, either through an “instant search” feature or within a user profile. When multiple clips are found matching the user search, the clips can be stitched together and streamed to the user as one continuous program. In another embodiment, eClips server periodically searches for clips matching a given user's profile, and makes the clips available to the user, perhaps by notifying the user via email of the availability of the clips. [0058]
  • The architecture shown in FIG. 2 allows for video to be stored and displayed in several formats including MPEG2 (e.g., for digital television and video on demand) and MPEG4 (e.g., for streaming video on the Internet). As mentioned above, the video may be stored for later use by the user; in particular, a user may archive some or all of the received video and thereafter permit searching and uploading of the video from storage by other members of a peer-to-peer computer network. [0059]
  • FIG. 3 demonstrates a more specific hardware architecture according to another exemplary embodiment of the present invention. In FIG. 3, video feeds [0060] 310 are captured at video capture device 310 within a cable service digital media center 305, and forwarded to video server 220. Video analysis can be performed at component 315, whereupon the video is forwarded to DVL/eClips server 225/230 within cable Headend 325. The DVL/eClips servers 225/230 operate as described above in conjunction with FIG. 2 to deliver, using, for example, Hybrid Fiber Coax (HFC) connections, all or part of the video feeds to routing hub 330, and then through fiber node 340 to cable modem 350 located within user home 355. Additional marketing and advertising (such as a commercial placed between every third clip stitched together) could be tied into the video stream in one embodiment of the present invention at the Headend from providers 320 such as DoubleClick.
  • Within [0061] user home 355 the feed is received at cable modem 350 via high speed data line (HSD) to a PC 360 running eClips client 250. Alternatively, the feed could be sent to Settop box 370 atop TV 380, where Settop box 370 runs eClips client 250. In the example where the video clips are received via cable modem 350, the service can be streamed as high speed data (HSD) through a cable modem as MPEG4 video. When the video is received via Settop box 370, it can be delivered as MPEG2 over video on demand (VOD) channels that could be set up in advance for a service providing the present invention.
  • FIG. 4 is an exemplary page view of a page viewed by a user utilizing an eClips client according to one embodiment of the invention. In FIG. 4, for example, the user might see [0062] page view 400 just after logging in to a system implementing the present invention. In page view 400, section 405 demonstrates the results of a profile search performed for the user on a given day, or over some other pre-defined period, according to the previously stored profile of that user. In section 405, clips are listed both by topic and by number of clips related to that topic. In section 405, the user therefore has the option of viewing one or more of the clips related to a particular topic.
  • [0063] Section 405 also identifies a source for the criteria used to select the various topical clips. More specifically, on a profile page, a user can select default sources (shows) which will be searched based on the user's profile; this is referred to as a “Main” list, and would restrict any profile topic that has the Main option to search only those shows selected on the profile page. On a topic editor page, where a user is allowed to add or modify topics for searching, the user can specify this Main list, or can make Custom selections that are only valid for a particular search topic. In section 405, the user has selected the latter option, and so a “source” is shown as Custom.
  • In [0064] section 410, the user additionally has the option of entering new search terms and/or phrases not related to his or her current profile, whereby the present invention searches a clips database via DVL server as described above with respect to FIG. 2. Section 415 indicates the media sources which will be searched for the terms or phrases entered in section 410.
  • Also, in [0065] page view 400, button 420, “Play all clips,” allows a user to view all currently available clips with one click. The user can add a new topic using button 425. The user can return to a home page by clicking on button 430 (although this option is only valid when the user is on a page different from the home page 400 itself), access his profile via button 435 and access an archive of previously saved clips via button 440. Finally, a user can log out of the service using button 445.
  • FIG. 5 demonstrates a page view [0066] 500 showing a content retrieval page according to the exemplary embodiment shown in FIG. 4. In section 505, still frames of the beginning of each clip (i.e., thumbnails) within a topic can be viewed by the user. Section 505 can be controlled by section 515, which allows the user to select a topic of clips to be shown, as well as section 520, which allows a user to select a portion of the clips from that topic that will be played. With buttons 560 and 565, a user may clear or select all of the clips being shown within a particular topic.
  • When one or more of these clips is chosen for viewing by the user, that clip is shown in [0067] section 510. Section 510 can be controlled by buttons 525-550, which allow a user to skip to a previous clip with button 525, stop the clip with button 530, play the clip with button 535, skip the clip with button 540, switch to a new topic of clips with button 545 or view footage after the selected clip(s) with button 550. Note that section 510 may also include advertisements 555, and may display a time remaining for a currently playing clip, a source of the clip, and a date and time the clip was originally broadcast.
  • In one exemplary embodiment of the invention, page [0068] 500 will play all of the clips currently available in a predetermined order (e.g., reverse chronological order, by source of content, etc.) if the user does not choose a specific topic or clip. Button 570 is activated when a user wants to view the clip(s) available; i.e., as shown in view 500. Button 575 allows the user to send (e.g., email) the clip(s) to another user, and button 580 allows the user to save the clip(s) to an archive (i.e., the archive accessed by button 440 in FIG. 4).
  • Having discussed various exemplary embodiments of the invention and associated features thereof, as well as potential uses of the present invention, the following provides a more detailed summary of application categories in which the present invention is of use. [0069]
  • Generally speaking, because the present invention can capture content from nearly any multimedia source and then use standard streaming media to deliver the appropriate associated clips, it is nearly limitless in the markets and industries that it can support. [0070]
  • As a practical matter, the present invention can be packaged to address different market segments. Therefore, it should be assumed that the target markets and applications supported could fall into, for example, any or all of the Consumer, Business-to-Consumer or Business-to-Business Marketplaces. The following discussion summarizes some exemplary application categories. [0071]
  • First, as a consumer offering, the present invention can be provided as an extension to standard television programming. In this model, an ISP, Cable Programming Provider, Web Portal Provider, etc., may allow consumers to sign up for this service, or the set of features provided by the present invention can be provided as a premium subscription. [0072]
  • In the consumer service model, a consumer would enter a set of keywords and/or phrases in the profile. In addition, as part of the preferences selected in the profile the user may determine that only specific content sources should be monitored. As the user profile is created or changed it would be updated in the user profile database. As video content is captured in the system, the user profile database is matched against the closed captioning/text. As an example, a consumer may be interested in sports but only want to see the specific “play of the day.” In this scenario, the consumer would enter the key words “play of the day” and then identify in the profile the specific content sources (channels or programs) that should be recorded/analyzed by the present invention. For example, the consumer could choose channels that play sports games or report on sports news. When the consumer returns from work that evening, a site or channel for accessing the present invention would be accessed. This consumer would then see all of the clips of programs that matched the keywords “play of the day,” meaning that this consumer would see in one session all of the content and clips matching that set of words. [0073]
  • As another example, in a Business-to-Consumer offering, the present invention can be provided as an extension to standard television programming. In this case, both the programming and its sponsorship would be different from the consumer model above. For example, a corporate sponsor or numerous corporate sponsors may offer specific types of content, or may offer an assemblage of content overlaid with advertising sponsorship. The sponsorship would be evident in the advertising that would be embedded in the player or in the content, since the design of the present invention is modular in design and allows for customization. [0074]
  • In the Business-to-Consumer service model, a consumer would enter a set of keywords in the profile. As the user profile is created or changed it would be updated in the user profile database. Because this model and the content provided would be underwritten by corporate sponsorship, the content provided may be limited to a proprietary set of content. As an example, if CNN were the sponsor of the service, all of the content provided may be limited to CNN's own broadcasts. In addition, it may be very evident to the consumer that the service is brought to them by CNN in that the CNN logo may be embedded in the user interface, or may be embedded in the content itself. [0075]
  • Next, as a Business-to-Business offering, the present invention can be used in intra-company applications as well as extra-company applications. The applications supported include, as just a few examples: Business TV, Advertising, Executive Announcements, Financial News, Training, Competitive Information Services, Industry Conferences, etc. In essence, the present invention can be used as a tool to assist employees in retrieving and viewing specific portions of content on demand. [0076]
  • In this Business-to-Business service model, a user would enter a set of keywords in the profile that would be updated in the user profile database. In this case, the content captured will be dependent upon the business audience using the service. [0077]
  • In an intra-business application, the user may wish to combine sources from within the business and sources outside of the business. As an example a user may wish to see all clips dealing with the category “Virtual Private Networks.” In this example, a business may have planned a new advertising campaign talking about “Virtual Private Networks” and have an advertisement available to its internal personnel. At the same time, there may be an internal training class that has been recorded and is available internally in which a section talks about “Virtual Private Networks.” Again, this could be another content option captured by the present invention. Also, one of this company's competitors may have provided a talk at an industry conference the day before about their solution for the “Virtual Private Network” area. As with the other content options, this too could be captured and available as a content option through the present invention. Therefore, when our user begins a session using the present invention and looks under the term “Virtual Private Networks,” there could be numerous clips available from multiple sources (internal and external) to provide this user with a complete multimedia view of “Virtual Private Networks”. [0078]
  • As an extra-business tool, the present invention can provide businesses, their suppliers, their best customers, and all other members of communities of interests with specific targeted content clips that strengthen the relationships. These may include (but not be limited to) product details, new announcements, public relations messages, etc. [0079]
  • As further examples of applications of the present invention, the following represent industry applications which may benefit from use of the present invention. [0080]
  • In the financial industry, financial information can be available for both professionals and potential clients to receive late-breaking information on stocks, companies and the global markets. The information can be from a variety of sources such as Financial News Network, Bloomberg, CNN, etc. and allow users to identify key areas of interest and to continually be up to date. [0081]
  • In the advertising/announcements industry, advertisers would be able to target their ads to consumers based on peoples' preferences as expressed in their profiles. This is potentially a win/win situation because people would not be getting any more ads but they would be seeing more things that interest them. Advertisers could charge more for this targeted approach and thereby pay for any costs associated with the present invention. [0082]
  • Similarly, large companies run TV advertisements for a multitude of products, services, target markets, etc. These companies could benefit by housing these commercials on an on-line database that can be accessible to their marketing staff, the advertising agencies, and clients interested in seeing particular commercials that used specific words or product names. The present invention can then allow these commercials to be easily searched and accessed. [0083]
  • In the entertainment industry, the movie industry can use the present invention to easily scan through archives of old and new movie footage that can be digitized and stored in a central repository. Sports highlights can be made available for particular games or events. Networks could maintain a library of indexed TV shows (e.g., PBS) where users can search for a particular episode/topic. [0084]
  • In the travel industry, searches can be done on new information in the travel industry such as airlines, causes of delays, etc. In addition, the present invention can be used to provide key clips from specific resorts and other potential vacation destinations. [0085]
  • In the distance learning/education industry, a large variety of courses could be stored on-line. In many circumstances, a user may want to only see the salient points on a specific topic of interest. The present invention can then play a key role in providing support to the user for access and retrieval of the key needed information. [0086]
  • Finally, for conferences and trade events, the present invention can be an information dissemination tool for finding the latest information quickly when videos are captured of talks and demonstrations in key events. [0087]
  • In conclusion, a service for providing personalized multimedia assets such as electronic clips from video programs, based upon personal profiles, has been presented. In one embodiment, it uses text to ascertain the appropriate clips to extract and then assembles these clips into a single session. Thus, users only see the specific portions of videos that they desire. Therefore, users do not have to undertake the arduous task of manually finding desired video segments, and further don't have to manually select the specified videos one at a time. Rather, the present invention generates all of the desired content automatically. [0088]
  • While this invention has been described in various explanatory embodiments, other embodiments and variations can be effected by a person of ordinary skill in the art without departing from the scope of the invention. [0089]
  • For example, although large multimedia files often must be delivered via broadband communication links, the fact that the present invention extracts exactly what the user is interested in makes it possible to deliver downloadable content to portable devices efficiently. The content can include video clips as discussed primarily above, or can be limited to still frames and text (or just text) if bandwidth/storage does not permit full motion video with audio. Hybrid schemes are also contemplated in which some of the content includes video, but other (e.g. perhaps older, or repeated similar stories from multiple sources) clips only include audio, or include only still images and/or text. In this regard, multimedia analysis techniques can be used to determine if stories are about the same topic, or contain the same video material. Because the present invention is capable of using standard access and delivery methods, it can be employed in virtually any home or industry application where delivery of multimedia assets is desired. [0090]

Claims (51)

What is claimed is:
1. A method for delivering a customized video presentation to a user, the method comprising:
searching, based on a user criterion, at least one video asset to thereby identify a subset of the video asset containing portions corresponding to the user criterion;
calculating segments of the video asset, the segments comprising the corresponding portions and portions adjacent to the corresponding portions, where the adjacent portions are relevant to the corresponding portions and the user criterion;
accessing the segments within the video asset to thereby form the customized video presentation; and
making contents of the customized video presentation available to the user for viewing.
2. The method of claim 1, wherein said searching includes forwarding a segment request to a database storing the at least one video asset, and further wherein said calculating includes designating pointers that identify beginning and end portions of the segments.
3. The method of claim 2, wherein said making contents of the customized video presentation available to the user for viewing further comprises making the pointers available to the user for selection.
4. The method of claim 3, wherein video segments are streamed to the user upon selection of at least one clip pointer by the user.
5. The method of claim 3, wherein the segments are combined for continuous delivery of the customized video presentation to the user.
6. The method of claim 1, wherein the user criterion includes search terms or phrases input by the user.
7. The method of claim 1, wherein the user criterion is included in a pre-defined user profile.
8. The method of claim 7, further comprising periodically notifying the user when the customized video presentation becomes available.
9. The method of claim 7, wherein the customized video presentation is assembled and delivered automatically at periodic intervals.
10. The method of claim 1, further comprising:
providing the user with the ability to negotiate among and between the segments.
11. The method of claim 10, wherein searching the video asset comprises searching the video asset based on text corresponding to an audio portion associated with the video asset.
12. The method of claim 11, wherein the text is either closed-captioning text associated with the video asset, speech-recognition text generated by speech recognition software operating on the audio portion, or a manually-generated transcription of the audio portion.
13. The method of claim 11, wherein said calculating segments of the video asset is based on the text.
14. The method of claim 11, wherein said calculating segments of the video asset is performed using multimodal story segmentation algorithms.
15. The method of claim 1, wherein the customized video presentation is streamed to the user over a network.
16. The method of claim 1, wherein the customized video presentation is downloaded to the user's local computer.
17. The method of claim 1, further comprising interlacing advertisements in between at least some of the combined video segments in the customized video presentation.
18. The method of claim 1, wherein the customized video presentation is delivered to a television of the user via a set top box.
19. The method of claim 1, wherein the searching is performed on a plurality of video assets of different sources.
20. The method of claim 1, wherein the video asset is a video file, a live broadcast, a video stream or a video tape.
21. A system for delivering a customized video presentation comprising video clips to a user, comprising:
a video capture device operable to receive a plurality of video inputs;
a video database operable to store the plurality of video inputs and text associated with the video inputs;
a video server operable to search the video inputs within the video database in accordance with a user criterion and based on the text, the video server being further operable to extract from the video inputs video clips corresponding to the user criterion and combine the video clips into a customized video presentation to be made available for delivery to the user in whole or in part,
wherein the video server determines a length of each video clip by including only portions corresponding to the user criteria and surrounding portions that relate to the corresponding portions.
22. The system of claim 21, wherein the video server determines clip pointers designating beginning and end portions of the video clips, and further wherein the clip pointers are made available to the user to thereby select at least one of the video clips for viewing.
23. The system of claim 22, wherein a video clip corresponding to a clip pointer is streamed to the user upon selection of the clip pointer by the user.
24. The system of claim 21, further comprising:
a multimedia delivery server to interface with the video server and a multimedia delivery client accessed by the user; and
a profile database for storing the user criterion.
25. The system of claim 21, wherein said profile database serves as a basis for searches performed by the video server on behalf of the user.
26. The system of claim 21, wherein the video server search the video inputs based on text corresponding to an audio portion associated with the video inputs.
27. The system of claim 21, wherein the text is either closed-captioning text associated with the video inputs, speech-recognition text generated by speech recognition software operating on the audio portion, or a manually-generated transcription of the audio portion.
28. The system of claim 21, wherein the video server determines a length of each video clip based on multimodal story segmentation algorithms.
29. The system of claim 21, further comprising a set top box for receiving the customized video presentation from the video server and thereafter displaying all or part of the customized video presentation on a television of the user.
30. The system of claim 21, wherein the customized video presentation is created and delivered to the user periodically according to a pre-determined schedule.
31. The system of claim 21, wherein the video server periodically notifies the user when the customized video presentation becomes available.
32. The method of claim 21, wherein the customized video presentation is downloaded to the user's local computer.
33. A system for receiving a customized video show, comprising:
a software client installed on a device of a user; and
an interface for interacting with the software client to input a user search criterion, thereby providing search parameters for searching a plurality of video inputs and accessing at least a portion of the video inputs that comprises the customized video show,
wherein the user selects, via the software client, at least a portion of the customized video show for viewing.
34. The system of claim 33, wherein the software client presents identifying portions of subtopics of the video show, whereby the user selects at least one of the subtopics for viewing.
35. The system of claim 33, wherein the user requests that discrete components of the customized video show be automatically combined for continuous streaming to the user.
36. The system of claim 33, wherein the user interface is a web page.
37. The system of claim 33, wherein the user device is a set top box attached to a television of the user.
38. The system of claim 33, wherein the user archives the at least a portion of the customized video show, whereby the at least a portion of the customized video show is made available to other users of a peer-to-peer network of which the user is a member.
39. The system of claim 33, wherein the user downloads, via the software client, the customized video show for at least temporary storage on a local computer.
40. The system of claim 33, wherein the customized video show is streamed to the user via the software client.
41. The system of claim 33, wherein the search criterion is a predetermined user profile.
42. The system of claim 41, wherein the user requests, via the software client, notification of availability of the customized video show.
43. The system of claim 41, wherein the user requests, via the software client, periodic delivery of customized video shows as they become available.
44. The system of claim 33, wherein the user receives, via email, pointers identifying beginning and end portions of subsections of the customized video show.
45. The system of claim 44, wherein the user receives an email attachment linked to the entire customized video show.
46. A method for providing a customized video presentation to a user, comprising:
identifying, in response to a request from the user, clip pointers that identify, based on text associated with video inputs, beginning and end portions of video clips within the video inputs;
making the clip pointers available to the user; and
accessing the video inputs for delivery to the user a video clip corresponding to a clip pointer selected by the user.
47. The method of claim 46, wherein the user request is received as a portion of an individualized user profile stored within a database.
48. The method of claim 47, wherein the clip pointers are identified based on the user profile as the video inputs are received.
49. The method of claim 47, wherein the clip pointers are periodically identified to the user according to a predetermined schedule.
50. The method of claim 47, wherein the clip pointers are made available to the user upon a demand by the user.
51. The method of claim 46, wherein all of the identified video clips are automatically combined and continuously streamed to the user.
US10/034,679 2001-04-06 2001-12-28 Method and system for personalized multimedia delivery service Abandoned US20030163815A1 (en)

Priority Applications (10)

Application Number Priority Date Filing Date Title
US10/034,679 US20030163815A1 (en) 2001-04-06 2001-12-28 Method and system for personalized multimedia delivery service
CA002380898A CA2380898A1 (en) 2001-04-06 2002-04-05 Method and system for personalized multimedia delivery service
US10/163,091 US8151298B2 (en) 2001-04-06 2002-06-06 Method and system for embedding information into streaming media
US10/303,045 US20030120748A1 (en) 2001-04-06 2002-11-25 Alternate delivery mechanisms of customized video streaming content to devices not meant for receiving video
US10/325,830 US20030088687A1 (en) 2001-12-28 2002-12-23 Method and apparatus for automatically converting source video into electronic mail messages
US10/455,790 US8060906B2 (en) 2001-04-06 2003-06-06 Method and apparatus for interactively retrieving content related to previous query results
US11/256,755 US8924383B2 (en) 2001-04-06 2005-10-24 Broadcast video monitoring and alerting system
US11/513,459 US8296811B1 (en) 2001-04-06 2006-08-31 Method and apparatus for automatically converting source video into electronic mail messages
US13/609,896 US9253519B2 (en) 2001-04-06 2012-09-11 Method and apparatus for automatically converting source video into electronic mail messages
US14/966,747 US10462510B2 (en) 2001-04-06 2015-12-11 Method and apparatus for automatically converting source video into electronic mail messages

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US28220401P 2001-04-06 2001-04-06
US29643601P 2001-06-06 2001-06-06
US10/034,679 US20030163815A1 (en) 2001-04-06 2001-12-28 Method and system for personalized multimedia delivery service

Related Child Applications (5)

Application Number Title Priority Date Filing Date
US10/163,091 Continuation-In-Part US8151298B2 (en) 2001-04-06 2002-06-06 Method and system for embedding information into streaming media
US10/303,045 Continuation-In-Part US20030120748A1 (en) 2001-04-06 2002-11-25 Alternate delivery mechanisms of customized video streaming content to devices not meant for receiving video
US10/325,830 Continuation-In-Part US20030088687A1 (en) 2001-04-06 2002-12-23 Method and apparatus for automatically converting source video into electronic mail messages
US10/455,790 Continuation-In-Part US8060906B2 (en) 2001-04-06 2003-06-06 Method and apparatus for interactively retrieving content related to previous query results
US11/256,755 Continuation-In-Part US8924383B2 (en) 2001-04-06 2005-10-24 Broadcast video monitoring and alerting system

Publications (1)

Publication Number Publication Date
US20030163815A1 true US20030163815A1 (en) 2003-08-28

Family

ID=27364714

Family Applications (3)

Application Number Title Priority Date Filing Date
US10/034,679 Abandoned US20030163815A1 (en) 2001-04-06 2001-12-28 Method and system for personalized multimedia delivery service
US10/163,091 Active 2027-11-10 US8151298B2 (en) 2001-04-06 2002-06-06 Method and system for embedding information into streaming media
US10/303,045 Abandoned US20030120748A1 (en) 2001-04-06 2002-11-25 Alternate delivery mechanisms of customized video streaming content to devices not meant for receiving video

Family Applications After (2)

Application Number Title Priority Date Filing Date
US10/163,091 Active 2027-11-10 US8151298B2 (en) 2001-04-06 2002-06-06 Method and system for embedding information into streaming media
US10/303,045 Abandoned US20030120748A1 (en) 2001-04-06 2002-11-25 Alternate delivery mechanisms of customized video streaming content to devices not meant for receiving video

Country Status (2)

Country Link
US (3) US20030163815A1 (en)
CA (1) CA2380898A1 (en)

Cited By (69)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030093814A1 (en) * 2001-11-09 2003-05-15 Birmingham Blair B.A. System and method for generating user-specific television content based on closed captioning content
US20030122966A1 (en) * 2001-12-06 2003-07-03 Digeo, Inc. System and method for meta data distribution to customize media content playback
US20030192045A1 (en) * 2002-04-04 2003-10-09 International Business Machines Corporation Apparatus and method for blocking television commercials and displaying alternative programming
US20030226151A1 (en) * 2002-05-30 2003-12-04 International Business Machines Corporation Content reproduction controller, data management device, storage-type content distribution system, content distribution method, content distribution server,control data transmission server, and program product therefor
US20030233441A1 (en) * 2002-05-08 2003-12-18 Yoko Nishiyama Information distribution system
US20040025191A1 (en) * 2002-07-31 2004-02-05 B. Popular, Inc. System and method for creating and presenting content packages
US20040243627A1 (en) * 2003-05-28 2004-12-02 Integrated Data Control, Inc. Chat stream information capturing and indexing system
US20050010950A1 (en) * 2003-07-11 2005-01-13 John Carney System and method for automatically generating a composite video-on-demand content
US20050010953A1 (en) * 2003-07-11 2005-01-13 John Carney System and method for creating and presenting composite video-on-demand content
US20050044569A1 (en) * 2003-06-24 2005-02-24 Dwight Marcus Method and apparatus for efficient, entertaining information delivery
US20050129252A1 (en) * 2003-12-12 2005-06-16 International Business Machines Corporation Audio presentations based on environmental context and user preferences
US20050128192A1 (en) * 2003-12-12 2005-06-16 International Business Machines Corporation Modifying visual presentations based on environmental context and user preferences
US20050144305A1 (en) * 2003-10-21 2005-06-30 The Board Of Trustees Operating Michigan State University Systems and methods for identifying, segmenting, collecting, annotating, and publishing multimedia materials
US20050198014A1 (en) * 2004-02-06 2005-09-08 Barbara De Lury Systems, methods and apparatus of a whole/part search engine
US20050216443A1 (en) * 2000-07-06 2005-09-29 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US20060010472A1 (en) * 2004-07-06 2006-01-12 Balazs Godeny System, method, and apparatus for creating searchable media files from streamed media
US20060085731A1 (en) * 2004-09-28 2006-04-20 Yahoo! Inc. Method for providing a clip for viewing at a remote device
US20060117040A1 (en) * 2001-04-06 2006-06-01 Lee Begeja Broadcast video monitoring and alerting system
US20060174278A1 (en) * 2004-11-22 2006-08-03 Lg Electronics Inc. Program searching in digital multimedia terminal
US20060224757A1 (en) * 2005-03-15 2006-10-05 Han Fang System and method for streaming service replication a in peer-to-peer network
WO2007001247A2 (en) * 2004-06-02 2007-01-04 Yahoo! Inc. Content-management system for user behavior targeting
US20070027844A1 (en) * 2005-07-28 2007-02-01 Microsoft Corporation Navigating recorded multimedia content using keywords or phrases
US20070088844A1 (en) * 2005-06-07 2007-04-19 Meta Interfaces, Llc System for and method of extracting a time-based portion of media and serving it over the Web
US20070130585A1 (en) * 2005-12-05 2007-06-07 Perret Pierre A Virtual Store Management Method and System for Operating an Interactive Audio/Video Entertainment System According to Viewers Tastes and Preferences
US20070233674A1 (en) * 2004-02-06 2007-10-04 Barbara De Lury Systems, methods and apparatus to determine relevance of search results in whole/part search
US20070282954A1 (en) * 2006-06-06 2007-12-06 Yahoo! Inc. Providing an actionable event in an intercepted text message for a mobile device based on customized user information
US20080016092A1 (en) * 2003-05-27 2008-01-17 Sony Corporation Information processing apparatus and method, program, and recording medium
US20080036917A1 (en) * 2006-04-07 2008-02-14 Mark Pascarella Methods and systems for generating and delivering navigatable composite videos
US20080086754A1 (en) * 2006-09-14 2008-04-10 Sbc Knowledge Ventures, Lp Peer to peer media distribution system and method
US20080132215A1 (en) * 2006-12-01 2008-06-05 Yahoo! Inc. User initiated invite for automatic conference participation by invitee
US20080147636A1 (en) * 2006-12-14 2008-06-19 Yahoo! Inc. Video distribution systems and methods
US20080155627A1 (en) * 2006-12-04 2008-06-26 O'connor Daniel Systems and methods of searching for and presenting video and audio
US20080168499A1 (en) * 2007-01-05 2008-07-10 Sony Corporation Information processing apparatus and method, and program
US20080178219A1 (en) * 2007-01-23 2008-07-24 At&T Knowledge Ventures, Lp System and method for providing video content
US20090007202A1 (en) * 2007-06-29 2009-01-01 Microsoft Corporation Forming a Representation of a Video Item and Use Thereof
US20090031337A1 (en) * 2002-07-25 2009-01-29 International Business Machines Corporation Apparatus and Method for Blocking Television Commercials and Providing an Archive Interrogation Program
US20090150784A1 (en) * 2007-12-07 2009-06-11 Microsoft Corporation User interface for previewing video items
US20100161580A1 (en) * 2008-12-24 2010-06-24 Comcast Interactive Media, Llc Method and apparatus for organizing segments of media assets and determining relevance of segments to a query
US20100158470A1 (en) * 2008-12-24 2010-06-24 Comcast Interactive Media, Llc Identification of segments within audio, video, and multimedia items
US20100332497A1 (en) * 2009-06-26 2010-12-30 Microsoft Corporation Presenting an assembled sequence of preview videos
US8015167B1 (en) * 2007-09-05 2011-09-06 Adobe Systems Incorporated Media players and download manager functionality
US20110239119A1 (en) * 2010-03-29 2011-09-29 Phillips Michael E Spot dialog editor
US8046803B1 (en) 2006-12-28 2011-10-25 Sprint Communications Company L.P. Contextual multimedia metatagging
US8060407B1 (en) 2007-09-04 2011-11-15 Sprint Communications Company L.P. Method for providing personalized, targeted advertisements during playback of media
WO2011146898A2 (en) * 2010-05-21 2011-11-24 Bologh Mark J Internet system for ultra high video quality
US20120246240A1 (en) * 2011-03-24 2012-09-27 Apple Inc. Providing Context Information Relating To Media Content That Is Being Presented
US8423555B2 (en) 2010-07-09 2013-04-16 Comcast Cable Communications, Llc Automatic segmentation of video
TWI400933B (en) * 2004-10-27 2013-07-01 Ericsson Telefon Ab L M Terminal for receiving transmissions in a form of a media stream and method of operating the same
US8533223B2 (en) 2009-05-12 2013-09-10 Comcast Interactive Media, LLC. Disambiguation and tagging of entities
US8689269B2 (en) * 2011-01-27 2014-04-01 Netflix, Inc. Insertion points for streaming video autoplay
US20140101551A1 (en) * 2012-10-05 2014-04-10 Google Inc. Stitching videos into an aggregate video
WO2014047337A3 (en) * 2012-09-19 2014-06-19 Google Inc. Systems and methods for live media content matching
US8806530B1 (en) 2008-04-22 2014-08-12 Sprint Communications Company L.P. Dual channel presence detection and content delivery system and method
US8886753B2 (en) 2007-06-13 2014-11-11 NTECH Propertie, Inc. Method and system for providing media programming
US8990104B1 (en) 2009-10-27 2015-03-24 Sprint Communications Company L.P. Multimedia product placement marketplace
US9099152B2 (en) 2000-09-08 2015-08-04 Ntech Properties, Inc. Method and apparatus for creation, distribution, assembly and verification of media
US9113203B2 (en) 2012-06-28 2015-08-18 Google Inc. Generating a sequence of audio fingerprints at a set top box
US9226034B1 (en) * 2011-05-10 2015-12-29 Google Inc. Apparatus and methods for generating clips using recipes with slice definitions
US9348915B2 (en) 2009-03-12 2016-05-24 Comcast Interactive Media, Llc Ranking search results
US9419844B2 (en) 2001-09-11 2016-08-16 Ntech Properties, Inc. Method and system for generation of media
US9560103B2 (en) 2013-06-26 2017-01-31 Echostar Technologies L.L.C. Custom video content
US9602884B1 (en) 2006-05-19 2017-03-21 Universal Innovation Counsel, Inc. Creating customized programming content
US9892730B2 (en) 2009-07-01 2018-02-13 Comcast Interactive Media, Llc Generating topic-specific language models
US10063610B1 (en) * 2006-11-08 2018-08-28 Open Invention Network, Llc Apparatus and method for dynamically providing web-based multimedia to a mobile phone
US10462510B2 (en) 2001-04-06 2019-10-29 At&T Intellectual Property Ii, L.P. Method and apparatus for automatically converting source video into electronic mail messages
US10467289B2 (en) 2011-08-02 2019-11-05 Comcast Cable Communications, Llc Segmentation of video according to narrative theme
US11363347B1 (en) 2006-05-19 2022-06-14 Universal Innovation Council, LLC Creating customized programming content
US11531668B2 (en) 2008-12-29 2022-12-20 Comcast Interactive Media, Llc Merging of multiple data sets
US11558650B2 (en) * 2020-07-30 2023-01-17 At&T Intellectual Property I, L.P. Automated, user-driven, and personalized curation of short-form media segments

Families Citing this family (123)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8266657B2 (en) 2001-03-15 2012-09-11 Sling Media Inc. Method for effectively implementing a multi-room television system
US6263503B1 (en) 1999-05-26 2001-07-17 Neal Margulis Method for effectively implementing a wireless television system
JP2003037834A (en) * 2001-05-16 2003-02-07 Sony Corp Content distribution system, content distribution controller, content distribution control method, content distribution control program and content distribution control program-stored medium
US7054939B2 (en) * 2001-06-28 2006-05-30 Bellsouth Intellectual Property Corportion Simultaneous visual and telephonic access to interactive information delivery
US20030101267A1 (en) * 2001-11-28 2003-05-29 Thompson Mark R. Peer-to-peer caching network
KR20030059403A (en) * 2001-12-29 2003-07-10 엘지전자 주식회사 Apparatus and method for searching of multimedia object based on server and client system
GB0205410D0 (en) * 2002-03-07 2002-04-24 Nokia Corp Method of digital recording
US20030202504A1 (en) * 2002-04-30 2003-10-30 Avaya Technology Corp. Method of implementing a VXML application into an IP device and an IP device having VXML capability
US20070245247A1 (en) * 2002-05-14 2007-10-18 Kaleidescape, Inc. Grid-like guided user interface for video selection and display
US7231607B2 (en) * 2002-07-09 2007-06-12 Kaleidescope, Inc. Mosaic-like user interface for video selection and display
US7246322B2 (en) 2002-07-09 2007-07-17 Kaleidescope, Inc. Grid-like guided user interface for video selection and display
US20040083487A1 (en) * 2002-07-09 2004-04-29 Kaleidescape, A Corporation Content and key distribution system for digital content representing media streams
US7111171B2 (en) * 2002-07-09 2006-09-19 Kaleidescope, Inc. Parallel distribution and fingerprinting of digital content
US7003131B2 (en) * 2002-07-09 2006-02-21 Kaleidescape, Inc. Watermarking and fingerprinting digital content using alternative blocks to embed information
JP2005533416A (en) 2002-07-09 2005-11-04 カレイドスケイプ・インコーポレイテッド How to securely present encrypted digital content
KR20050057289A (en) * 2002-09-09 2005-06-16 코닌클리케 필립스 일렉트로닉스 엔.브이. A data network, user terminal and method for providing recommendations
US8225194B2 (en) * 2003-01-09 2012-07-17 Kaleidescape, Inc. Bookmarks and watchpoints for selection and presentation of media streams
WO2004070998A2 (en) 2003-01-31 2004-08-19 Kaleidescape, Inc. Recovering from de-synchronization attacks against watermarking and fingerprinting
US20040172650A1 (en) * 2003-02-28 2004-09-02 Hawkins William J. Targeted content delivery system in an interactive television network
US20040177317A1 (en) * 2003-03-07 2004-09-09 John Bradstreet Closed caption navigation
JP2004287699A (en) * 2003-03-20 2004-10-14 Tama Tlo Kk Image composition device and method
US20050086069A1 (en) * 2003-07-15 2005-04-21 Kaleidescape, Inc. Separable presentation control rules with distinct control effects
US8572104B2 (en) 2003-04-18 2013-10-29 Kaleidescape, Inc. Sales of collections excluding those already purchased
US20050044105A1 (en) * 2003-08-19 2005-02-24 Kelly Terrell System and method for delivery of content-specific video clips
US7571235B2 (en) * 2003-12-19 2009-08-04 Nortel Networks Limited Computer telephone integration over a network
US20050229048A1 (en) * 2004-03-30 2005-10-13 International Business Machines Corporation Caching operational code in a voice markup interpreter
US9396212B2 (en) * 2004-04-07 2016-07-19 Visible World, Inc. System and method for enhanced video selection
US8495089B2 (en) * 2004-05-14 2013-07-23 Google Inc. System and method for optimizing media play transactions
US7975062B2 (en) 2004-06-07 2011-07-05 Sling Media, Inc. Capturing and sharing media content
US7917932B2 (en) 2005-06-07 2011-03-29 Sling Media, Inc. Personal video recorder functionality for placeshifting systems
US9998802B2 (en) 2004-06-07 2018-06-12 Sling Media LLC Systems and methods for creating variable length clips from a media stream
CN101243688A (en) 2004-06-07 2008-08-13 斯灵媒体公司 Personal media broadcasting system
US7769756B2 (en) * 2004-06-07 2010-08-03 Sling Media, Inc. Selection and presentation of context-relevant supplemental content and advertising
US7564955B2 (en) * 2004-06-30 2009-07-21 Glenayre Electronics, Inc. System and method for outbound calling from a distributed telecommunications platform
US7627824B2 (en) * 2004-07-12 2009-12-01 Alcatel Lucent Personalized video entertainment system
US8065604B2 (en) * 2004-12-30 2011-11-22 Massachusetts Institute Of Technology Techniques for relating arbitrary metadata to media files
US20070016930A1 (en) * 2005-03-08 2007-01-18 Podfitness, Inc. Creation and navigation of media content with chaptering elements
US20060218226A1 (en) * 2005-03-23 2006-09-28 Matsushita Electric Industrial Co., Ltd. Automatic recording based on preferences
US8316301B2 (en) * 2005-08-04 2012-11-20 Samsung Electronics Co., Ltd. Apparatus, medium, and method segmenting video sequences based on topic
US7382933B2 (en) * 2005-08-24 2008-06-03 International Business Machines Corporation System and method for semantic video segmentation based on joint audiovisual and text analysis
US20070157228A1 (en) 2005-12-30 2007-07-05 Jason Bayer Advertising with video ad creatives
US20070203945A1 (en) * 2006-02-28 2007-08-30 Gert Hercules Louw Method for integrated media preview, analysis, purchase, and display
US20070204285A1 (en) * 2006-02-28 2007-08-30 Gert Hercules Louw Method for integrated media monitoring, purchase, and display
US8261300B2 (en) * 2006-06-23 2012-09-04 Tivo Inc. Method and apparatus for advertisement placement in a user dialog on a set-top box
US20080005266A1 (en) * 2006-06-30 2008-01-03 Gene Fein Multimedia delivery system
US20080091513A1 (en) * 2006-09-13 2008-04-17 Video Monitoring Services Of America, L.P. System and method for assessing marketing data
US20090319365A1 (en) * 2006-09-13 2009-12-24 James Hallowell Waggoner System and method for assessing marketing data
US9015172B2 (en) 2006-09-22 2015-04-21 Limelight Networks, Inc. Method and subsystem for searching media content within a content-search service system
US8396878B2 (en) 2006-09-22 2013-03-12 Limelight Networks, Inc. Methods and systems for generating automated tags for video files
US8214374B1 (en) * 2011-09-26 2012-07-03 Limelight Networks, Inc. Methods and systems for abridging video files
US8966389B2 (en) 2006-09-22 2015-02-24 Limelight Networks, Inc. Visual interface for identifying positions of interest within a sequentially ordered information encoding
US20080207233A1 (en) * 2007-02-28 2008-08-28 Waytena William L Method and System For Centralized Storage of Media and for Communication of Such Media Activated By Real-Time Messaging
US7921221B2 (en) * 2007-01-22 2011-04-05 Minborg Invent I Goteborg Ab Method and apparatus for obtaining digital objects in a communication network
US8843989B2 (en) * 2007-02-09 2014-09-23 At&T Intellectual Property I, L.P. Method and system to provide interactive television content
US20090024049A1 (en) 2007-03-29 2009-01-22 Neurofocus, Inc. Cross-modality synthesis of central nervous system, autonomic nervous system, and effector data
US20080270913A1 (en) * 2007-04-26 2008-10-30 Howard Singer Methods, Media, and Devices for Providing a Package of Assets
WO2008137581A1 (en) 2007-05-01 2008-11-13 Neurofocus, Inc. Neuro-feedback based stimulus compression device
EP2156316A4 (en) * 2007-05-07 2013-03-06 Fourthwall Media Inc Providing personalized resources on-demand over a broadband network to consumer device applications
US8392253B2 (en) 2007-05-16 2013-03-05 The Nielsen Company (Us), Llc Neuro-physiology and neuro-behavioral based stimulus targeting system
JP5542051B2 (en) 2007-07-30 2014-07-09 ニューロフォーカス・インコーポレーテッド System, method, and apparatus for performing neural response stimulation and stimulation attribute resonance estimation
US8744118B2 (en) * 2007-08-03 2014-06-03 At&T Intellectual Property I, L.P. Methods, systems, and products for indexing scenes in digital media
US8386313B2 (en) 2007-08-28 2013-02-26 The Nielsen Company (Us), Llc Stimulus placement system using subject neuro-response measurements
US8392255B2 (en) 2007-08-29 2013-03-05 The Nielsen Company (Us), Llc Content based selection and meta tagging of advertisement breaks
US20090083129A1 (en) 2007-09-20 2009-03-26 Neurofocus, Inc. Personalized content delivery using neuro-response priming data
US8327395B2 (en) 2007-10-02 2012-12-04 The Nielsen Company (Us), Llc System providing actionable insights based on physiological responses from viewers of media
US8739200B2 (en) 2007-10-11 2014-05-27 At&T Intellectual Property I, L.P. Methods, systems, and products for distributing digital media
CN101917898A (en) 2007-10-31 2010-12-15 埃姆申塞公司 Physiological responses from spectators is provided the system and method for distributed collection and centralized processing
US8169916B1 (en) * 2007-11-23 2012-05-01 Media Melon, Inc. Multi-platform video delivery configuration
US20090182712A1 (en) * 2008-01-15 2009-07-16 Kamal Faiza H Systems and methods for rapid delivery of media content
WO2009099919A1 (en) * 2008-01-31 2009-08-13 Horizon Capital Securities Limited Distribution and targeting of advertising for mobile devices
US8645822B2 (en) * 2008-09-25 2014-02-04 Microsoft Corporation Multi-platform presentation system
US20100153848A1 (en) * 2008-10-09 2010-06-17 Pinaki Saha Integrated branding, social bookmarking, and aggregation system for media content
US10419541B2 (en) 2008-11-26 2019-09-17 Free Stream Media Corp. Remotely control devices over a network without authentication or registration
US9961388B2 (en) 2008-11-26 2018-05-01 David Harrison Exposure of public internet protocol addresses in an advertising exchange server to improve relevancy of advertisements
US9154942B2 (en) 2008-11-26 2015-10-06 Free Stream Media Corp. Zero configuration communication between a browser and a networked media device
US9026668B2 (en) 2012-05-26 2015-05-05 Free Stream Media Corp. Real-time and retargeted advertising on multiple screens of a user watching television
US9519772B2 (en) 2008-11-26 2016-12-13 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US10334324B2 (en) 2008-11-26 2019-06-25 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US10977693B2 (en) 2008-11-26 2021-04-13 Free Stream Media Corp. Association of content identifier of audio-visual data with additional data through capture infrastructure
US9386356B2 (en) 2008-11-26 2016-07-05 Free Stream Media Corp. Targeting with television audience data across multiple screens
US10631068B2 (en) 2008-11-26 2020-04-21 Free Stream Media Corp. Content exposure attribution based on renderings of related content across multiple devices
US9986279B2 (en) 2008-11-26 2018-05-29 Free Stream Media Corp. Discovery, access control, and communication with networked services
US8180891B1 (en) 2008-11-26 2012-05-15 Free Stream Media Corp. Discovery, access control, and communication with networked services from within a security sandbox
US10567823B2 (en) 2008-11-26 2020-02-18 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US10880340B2 (en) 2008-11-26 2020-12-29 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US7996566B1 (en) * 2008-12-23 2011-08-09 Genband Us Llc Media sharing
US20100250325A1 (en) 2009-03-24 2010-09-30 Neurofocus, Inc. Neurological profiles for market matching and stimulus presentation
US8655437B2 (en) * 2009-08-21 2014-02-18 The Nielsen Company (Us), Llc Analysis of the mirror neuron system for evaluation of stimulus
US10987015B2 (en) 2009-08-24 2021-04-27 Nielsen Consumer Llc Dry electrodes for electroencephalography
US8209224B2 (en) 2009-10-29 2012-06-26 The Nielsen Company (Us), Llc Intracluster content management using neuro-response priming data
US20110107215A1 (en) * 2009-10-29 2011-05-05 Rovi Technologies Corporation Systems and methods for presenting media asset clips on a media equipment device
US9560984B2 (en) 2009-10-29 2017-02-07 The Nielsen Company (Us), Llc Analysis of controlled and automatic attention for introduction of stimulus material
US20110106750A1 (en) * 2009-10-29 2011-05-05 Neurofocus, Inc. Generating ratings predictions using neuro-response data
US20110106536A1 (en) * 2009-10-29 2011-05-05 Rovi Technologies Corporation Systems and methods for simulating dialog between a user and media equipment device
WO2011133548A2 (en) 2010-04-19 2011-10-27 Innerscope Research, Inc. Short imagery task (sit) research method
US8655428B2 (en) 2010-05-12 2014-02-18 The Nielsen Company (Us), Llc Neuro-response data synchronization
US9544528B2 (en) * 2010-08-17 2017-01-10 Verizon Patent And Licensing Inc. Matrix search of video using closed caption information
US8396744B2 (en) 2010-08-25 2013-03-12 The Nielsen Company (Us), Llc Effective virtual reality environments for presentation of marketing materials
US9001886B2 (en) 2010-11-22 2015-04-07 Cisco Technology, Inc. Dynamic time synchronization
US8683013B2 (en) 2011-04-18 2014-03-25 Cisco Technology, Inc. System and method for data streaming in a computer network
WO2012153284A1 (en) * 2011-05-10 2012-11-15 Nds Limited Customized zapping
US20120290409A1 (en) * 2011-05-11 2012-11-15 Neurofocus, Inc. Marketing material enhanced wait states
US8832729B2 (en) * 2011-07-05 2014-09-09 Yahoo! Inc. Methods and systems for grabbing video surfers' attention while awaiting download
US8898717B1 (en) * 2012-01-11 2014-11-25 Cisco Technology, Inc. System and method for obfuscating start-up delay in a linear media service environment
US9591098B2 (en) 2012-02-01 2017-03-07 Cisco Technology, Inc. System and method to reduce stream start-up delay for adaptive streaming
US9569986B2 (en) 2012-02-27 2017-02-14 The Nielsen Company (Us), Llc System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications
US20130226983A1 (en) * 2012-02-29 2013-08-29 Jeffrey Martin Beining Collaborative Video Highlights
US8989835B2 (en) 2012-08-17 2015-03-24 The Nielsen Company (Us), Llc Systems and methods to gather and analyze electroencephalographic data
US9320450B2 (en) 2013-03-14 2016-04-26 The Nielsen Company (Us), Llc Methods and apparatus to gather and analyze electroencephalographic data
US9923945B2 (en) 2013-10-10 2018-03-20 Cisco Technology, Inc. Virtual assets for on-demand content generation
US10331661B2 (en) 2013-10-23 2019-06-25 At&T Intellectual Property I, L.P. Video content search using captioning data
US9622702B2 (en) 2014-04-03 2017-04-18 The Nielsen Company (Us), Llc Methods and apparatus to gather and analyze electroencephalographic data
CN105407384A (en) * 2014-09-15 2016-03-16 上海天脉聚源文化传媒有限公司 Method, device and system for identifying media player content by using two-dimensional code
US9936250B2 (en) 2015-05-19 2018-04-03 The Nielsen Company (Us), Llc Methods and apparatus to adjust content presented to an individual
US10277953B2 (en) * 2016-12-06 2019-04-30 The Directv Group, Inc. Search for content data in content
US9858943B1 (en) 2017-05-09 2018-01-02 Sony Corporation Accessibility for the hearing impaired using measurement and object based audio
KR101924634B1 (en) * 2017-06-07 2018-12-04 네이버 주식회사 Content providing server, content providing terminal and content providing method
US10650702B2 (en) 2017-07-10 2020-05-12 Sony Corporation Modifying display region for people with loss of peripheral vision
US10805676B2 (en) 2017-07-10 2020-10-13 Sony Corporation Modifying display region for people with macular degeneration
US10303427B2 (en) 2017-07-11 2019-05-28 Sony Corporation Moving audio from center speaker to peripheral speaker of display device for macular degeneration accessibility
US10051331B1 (en) * 2017-07-11 2018-08-14 Sony Corporation Quick accessibility profiles
US10845954B2 (en) 2017-07-11 2020-11-24 Sony Corporation Presenting audio video display options as list or matrix
CN116233472B (en) * 2023-05-08 2023-07-18 湖南马栏山视频先进技术研究院有限公司 Audio and video synchronization method and cloud processing system

Citations (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5614940A (en) * 1994-10-21 1997-03-25 Intel Corporation Method and apparatus for providing broadcast information with indexing
US5664227A (en) * 1994-10-14 1997-09-02 Carnegie Mellon University System and method for skimming digital audio/video data
US5708767A (en) * 1995-02-03 1998-01-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5710591A (en) * 1995-06-27 1998-01-20 At&T Method and apparatus for recording and indexing an audio and multimedia conference
US5805763A (en) * 1995-05-05 1998-09-08 Microsoft Corporation System and method for automatically recording programs in an interactive viewing system
US5821945A (en) * 1995-02-03 1998-10-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5835087A (en) * 1994-11-29 1998-11-10 Herz; Frederick S. M. System for generation of object profiles for a system for customized electronic identification of desirable objects
US5835667A (en) * 1994-10-14 1998-11-10 Carnegie Mellon University Method and apparatus for creating a searchable digital video library and a system and method of using such a library
US5864366A (en) * 1997-02-05 1999-01-26 International Business Machines Corporation System and method for selecting video information with intensity difference
US5874986A (en) * 1996-06-26 1999-02-23 At&T Corp Method for communicating audiovisual programs over a communications network
US5956026A (en) * 1997-12-19 1999-09-21 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
US5999985A (en) * 1995-04-13 1999-12-07 Siemens Aktiengesellschaft Method and apparatus for storing, searching and playback of items of information of a multimedia electronic mail system
US6038296A (en) * 1997-10-07 2000-03-14 Lucent Technologies Inc. Internet/intranet user interface to a multimedia messaging system
US6061056A (en) * 1996-03-04 2000-05-09 Telexis Corporation Television monitoring system with automatic selection of program material of interest and subsequent display under user control
US6092107A (en) * 1997-04-07 2000-07-18 At&T Corp System and method for interfacing MPEG-coded audiovisual objects permitting adaptive control
US6098082A (en) * 1996-07-15 2000-08-01 At&T Corp Method for automatically providing a compressed rendition of a video program in a format suitable for electronic searching and retrieval
US6166735A (en) * 1997-12-03 2000-12-26 International Business Machines Corporation Video story board user interface for selective downloading and displaying of desired portions of remote-stored video data objects
US6233389B1 (en) * 1998-07-30 2001-05-15 Tivo, Inc. Multimedia time warping system
US6236395B1 (en) * 1999-02-01 2001-05-22 Sharp Laboratories Of America, Inc. Audiovisual information management system
US6243676B1 (en) * 1998-12-23 2001-06-05 Openwave Systems Inc. Searching and retrieving multimedia information
US20010013123A1 (en) * 1991-11-25 2001-08-09 Freeman Michael J. Customized program creation by splicing server based video, audio, or graphical segments
US6282549B1 (en) * 1996-05-24 2001-08-28 Magnifi, Inc. Indexing of media content on a network
US6289346B1 (en) * 1998-03-12 2001-09-11 At&T Corp. Apparatus and method for a bookmarking system
US6304898B1 (en) * 1999-10-13 2001-10-16 Datahouse, Inc. Method and system for creating and sending graphical email
US6324388B1 (en) * 1998-09-08 2001-11-27 Mitel Semiconductor Limited Image reject mixer circuit arrangements
US6324512B1 (en) * 1999-08-26 2001-11-27 Matsushita Electric Industrial Co., Ltd. System and method for allowing family members to access TV contents and program media recorder over telephone or internet
US6324338B1 (en) * 1998-08-07 2001-11-27 Replaytv, Inc. Video data recorder with integrated channel guides
US20010049826A1 (en) * 2000-01-19 2001-12-06 Itzhak Wilf Method of searching video channels by content
US20010052019A1 (en) * 2000-02-04 2001-12-13 Ovt, Inc. Video mail delivery system
US6345279B1 (en) * 1999-04-23 2002-02-05 International Business Machines Corporation Methods and apparatus for adapting multimedia content for client devices
US6363380B1 (en) * 1998-01-13 2002-03-26 U.S. Philips Corporation Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser
US20020052747A1 (en) * 2000-08-21 2002-05-02 Sarukkai Ramesh R. Method and system of interpreting and presenting web content using a voice browser
US6385306B1 (en) * 2000-03-02 2002-05-07 John Francis Baxter, Jr. Audio file transmission method
US6415327B1 (en) * 1998-03-09 2002-07-02 Microsoft Corporation Automatic protocol rollover in streaming multimedia data delivery systems
US20020093591A1 (en) * 2000-12-12 2002-07-18 Nec Usa, Inc. Creating audio-centric, imagecentric, and integrated audio visual summaries
US20020100046A1 (en) * 2000-11-16 2002-07-25 Dudkiewicz Gil Gavriel System and method for determining the desirability of video programming events
US6453355B1 (en) * 1998-01-15 2002-09-17 Apple Computer, Inc. Method and apparatus for media data transmission
US20020138843A1 (en) * 2000-05-19 2002-09-26 Andrew Samaan Video distribution method and system
US6460075B2 (en) * 1998-07-31 2002-10-01 Webtv Networks, Inc. Browser-based email system with user interface for audio/video capture
US20020152477A1 (en) * 1998-05-29 2002-10-17 Opentv, Inc. Module manager for interactive television system
US20020152464A1 (en) * 2001-04-13 2002-10-17 Sony Corporation System and method for pushing internet content onto interactive television
US6477707B1 (en) * 1998-03-24 2002-11-05 Fantastic Corporation Method and system for broadcast transmission of media objects
US6477565B1 (en) * 1999-06-01 2002-11-05 Yodlee.Com, Inc. Method and apparatus for restructuring of personalized data for transmission from a data network to connected and portable network appliances
US20020173964A1 (en) * 2001-03-30 2002-11-21 International Business Machines Corporation Speech driven data selection in a voice-enabled program
US6496857B1 (en) * 2000-02-08 2002-12-17 Mirror Worlds Technologies, Inc. Delivering targeted, enhanced advertisements across electronic networks
US6564263B1 (en) * 1998-12-04 2003-05-13 International Business Machines Corporation Multimedia content description framework
US6671715B1 (en) * 2000-01-21 2003-12-30 Microstrategy, Inc. System and method for automatic, real-time delivery of personalized informational and transactional data to users via high throughput content delivery device
US6678890B1 (en) * 1999-03-10 2004-01-13 Sony Corporation Bidirectional transmission/reception system and method and transmission apparatus
US6748421B1 (en) * 1998-12-23 2004-06-08 Canon Kabushiki Kaisha Method and system for conveying video messages
US20040117831A1 (en) * 1999-06-28 2004-06-17 United Video Properties, Inc. Interactive television program guide system and method with niche hubs
US6810526B1 (en) * 1996-08-14 2004-10-26 March Networks Corporation Centralized broadcast channel real-time search system
US20040261095A1 (en) * 2000-04-07 2004-12-23 Sezan Muhammed Ibrahim Audiovisual information management system
US20050028194A1 (en) * 1998-01-13 2005-02-03 Elenbaas Jan Hermanus Personalized news retrieval system
US20050076357A1 (en) * 1999-10-28 2005-04-07 Fenne Adam Michael Dynamic insertion of targeted sponsored video messages into Internet multimedia broadcasts
US20050076378A1 (en) * 1999-12-16 2005-04-07 Microsoft Corporation Live presentation searching
US20050223408A1 (en) * 1999-09-13 2005-10-06 Microstrategy, Incorporated System and method for real-time, personalized, dynamic, interactive voice services for entertainment-related information
US6956573B1 (en) * 1996-11-15 2005-10-18 Sarnoff Corporation Method and apparatus for efficiently representing storing and accessing video information
US6961954B1 (en) * 1997-10-27 2005-11-01 The Mitre Corporation Automated segmentation, information extraction, summarization, and presentation of broadcast news
US6970915B1 (en) * 1999-11-01 2005-11-29 Tellme Networks, Inc. Streaming content over a telephone interface
US20050278741A1 (en) * 1997-03-31 2005-12-15 Microsoft Corporation Query-based electronic program guide
US7130790B1 (en) * 2000-10-24 2006-10-31 Global Translations, Inc. System and method for closed caption data translation
US7178107B2 (en) * 1999-09-16 2007-02-13 Sharp Laboratories Of America, Inc. Audiovisual information management system with identification prescriptions

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5481296A (en) * 1993-08-06 1996-01-02 International Business Machines Corporation Apparatus and method for selectively viewing video information
US5532735A (en) * 1994-04-29 1996-07-02 At&T Corp. Method of advertisement selection for interactive service
GB9504376D0 (en) 1995-03-04 1995-04-26 Televitesse Systems Inc Automatic broadcast monitoring system
US5734893A (en) * 1995-09-28 1998-03-31 Ibm Corporation Progressive content-based retrieval of image and video with adaptive and iterative refinement
EP0852880A1 (en) * 1995-09-29 1998-07-15 Boston Technology Inc. Multimedia architecture for interactive advertising
US5996007A (en) * 1997-06-16 1999-11-30 John Klug Method for providing selected content during waiting time of an internet session
US6637032B1 (en) * 1997-01-06 2003-10-21 Microsoft Corporation System and method for synchronizing enhancing content with a video program using closed captioning
US5924105A (en) * 1997-01-27 1999-07-13 Michigan State University Method and product for determining salient features for use in information searching
US6298482B1 (en) * 1997-11-12 2001-10-02 International Business Machines Corporation System for two-way digital multimedia broadcast and interactive services
US6698020B1 (en) * 1998-06-15 2004-02-24 Webtv Networks, Inc. Techniques for intelligent video ad insertion
US6411952B1 (en) * 1998-06-24 2002-06-25 Compaq Information Technologies Group, Lp Method for learning character patterns to interactively control the scope of a web crawler
US6229524B1 (en) * 1998-07-17 2001-05-08 International Business Machines Corporation User interface for interaction with video
US6338094B1 (en) * 1998-09-08 2002-01-08 Webtv Networks, Inc. Method, device and system for playing a video file in response to selecting a web page link
US20020087973A1 (en) * 2000-12-28 2002-07-04 Hamilton Jeffrey S. Inserting local signals during MPEG channel changes
US20020026638A1 (en) * 2000-08-31 2002-02-28 Eldering Charles A. Internet-based electronic program guide advertisement insertion method and apparatus
US6385619B1 (en) * 1999-01-08 2002-05-07 International Business Machines Corporation Automatic user interest profile generation from structured document access information
US7051351B2 (en) * 1999-03-08 2006-05-23 Microsoft Corporation System and method of inserting advertisements into an information retrieval system display
US6526580B2 (en) * 1999-04-16 2003-02-25 Digeo, Inc. Broadband data broadcasting service
US6507941B1 (en) * 1999-04-28 2003-01-14 Magma Design Automation, Inc. Subgrid detailed routing
JP2002544609A (en) * 1999-05-10 2002-12-24 エクスパンス ネットワークス インコーポレイティッド Advertising subgroup for digital streams
US6188398B1 (en) * 1999-06-02 2001-02-13 Mark Collins-Rector Targeting advertising using web pages with video
US6604239B1 (en) * 1999-06-25 2003-08-05 Eyescene Inc. System and method for virtual television program rating
US6415438B1 (en) * 1999-10-05 2002-07-02 Webtv Networks, Inc. Trigger having a time attribute
US6353825B1 (en) * 1999-07-30 2002-03-05 Verizon Laboratories Inc. Method and device for classification using iterative information retrieval techniques
US6349410B1 (en) * 1999-08-04 2002-02-19 Intel Corporation Integrating broadcast television pause and web browsing
US6751776B1 (en) * 1999-08-06 2004-06-15 Nec Corporation Method and apparatus for personalized multimedia summarization based upon user specified theme
KR100350787B1 (en) 1999-09-22 2002-08-28 엘지전자 주식회사 Multimedia browser based on user profile having ordering preference of searching item of multimedia data
US7159232B1 (en) * 1999-11-16 2007-01-02 Microsoft Corporation Scheduling the recording of television programs
US6434747B1 (en) * 2000-01-19 2002-08-13 Individual Network, Inc. Method and system for providing a customized media list
US6434550B1 (en) * 2000-04-14 2002-08-13 Rightnow Technologies, Inc. Temporal updates of relevancy rating of retrieved information in an information search system
US7000242B1 (en) * 2000-07-31 2006-02-14 Jeff Haber Directing internet shopping traffic and tracking revenues generated as a result thereof

Patent Citations (62)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010013123A1 (en) * 1991-11-25 2001-08-09 Freeman Michael J. Customized program creation by splicing server based video, audio, or graphical segments
US5664227A (en) * 1994-10-14 1997-09-02 Carnegie Mellon University System and method for skimming digital audio/video data
US5835667A (en) * 1994-10-14 1998-11-10 Carnegie Mellon University Method and apparatus for creating a searchable digital video library and a system and method of using such a library
US5614940A (en) * 1994-10-21 1997-03-25 Intel Corporation Method and apparatus for providing broadcast information with indexing
US5835087A (en) * 1994-11-29 1998-11-10 Herz; Frederick S. M. System for generation of object profiles for a system for customized electronic identification of desirable objects
US5708767A (en) * 1995-02-03 1998-01-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5821945A (en) * 1995-02-03 1998-10-13 The Trustees Of Princeton University Method and apparatus for video browsing based on content and structure
US5999985A (en) * 1995-04-13 1999-12-07 Siemens Aktiengesellschaft Method and apparatus for storing, searching and playback of items of information of a multimedia electronic mail system
US5805763A (en) * 1995-05-05 1998-09-08 Microsoft Corporation System and method for automatically recording programs in an interactive viewing system
US5710591A (en) * 1995-06-27 1998-01-20 At&T Method and apparatus for recording and indexing an audio and multimedia conference
US6061056A (en) * 1996-03-04 2000-05-09 Telexis Corporation Television monitoring system with automatic selection of program material of interest and subsequent display under user control
US6282549B1 (en) * 1996-05-24 2001-08-28 Magnifi, Inc. Indexing of media content on a network
US5874986A (en) * 1996-06-26 1999-02-23 At&T Corp Method for communicating audiovisual programs over a communications network
US6098082A (en) * 1996-07-15 2000-08-01 At&T Corp Method for automatically providing a compressed rendition of a video program in a format suitable for electronic searching and retrieval
US6810526B1 (en) * 1996-08-14 2004-10-26 March Networks Corporation Centralized broadcast channel real-time search system
US6956573B1 (en) * 1996-11-15 2005-10-18 Sarnoff Corporation Method and apparatus for efficiently representing storing and accessing video information
US5864366A (en) * 1997-02-05 1999-01-26 International Business Machines Corporation System and method for selecting video information with intensity difference
US20050278741A1 (en) * 1997-03-31 2005-12-15 Microsoft Corporation Query-based electronic program guide
US6092107A (en) * 1997-04-07 2000-07-18 At&T Corp System and method for interfacing MPEG-coded audiovisual objects permitting adaptive control
US6038296A (en) * 1997-10-07 2000-03-14 Lucent Technologies Inc. Internet/intranet user interface to a multimedia messaging system
US6961954B1 (en) * 1997-10-27 2005-11-01 The Mitre Corporation Automated segmentation, information extraction, summarization, and presentation of broadcast news
US6166735A (en) * 1997-12-03 2000-12-26 International Business Machines Corporation Video story board user interface for selective downloading and displaying of desired portions of remote-stored video data objects
US5956026A (en) * 1997-12-19 1999-09-21 Sharp Laboratories Of America, Inc. Method for hierarchical summarization and browsing of digital video
US20050028194A1 (en) * 1998-01-13 2005-02-03 Elenbaas Jan Hermanus Personalized news retrieval system
US6363380B1 (en) * 1998-01-13 2002-03-26 U.S. Philips Corporation Multimedia computer system with story segmentation capability and operating program therefor including finite automation video parser
US6453355B1 (en) * 1998-01-15 2002-09-17 Apple Computer, Inc. Method and apparatus for media data transmission
US6415327B1 (en) * 1998-03-09 2002-07-02 Microsoft Corporation Automatic protocol rollover in streaming multimedia data delivery systems
US6289346B1 (en) * 1998-03-12 2001-09-11 At&T Corp. Apparatus and method for a bookmarking system
US6477707B1 (en) * 1998-03-24 2002-11-05 Fantastic Corporation Method and system for broadcast transmission of media objects
US20020152477A1 (en) * 1998-05-29 2002-10-17 Opentv, Inc. Module manager for interactive television system
US6233389B1 (en) * 1998-07-30 2001-05-15 Tivo, Inc. Multimedia time warping system
US6460075B2 (en) * 1998-07-31 2002-10-01 Webtv Networks, Inc. Browser-based email system with user interface for audio/video capture
US6324338B1 (en) * 1998-08-07 2001-11-27 Replaytv, Inc. Video data recorder with integrated channel guides
US6324388B1 (en) * 1998-09-08 2001-11-27 Mitel Semiconductor Limited Image reject mixer circuit arrangements
US6564263B1 (en) * 1998-12-04 2003-05-13 International Business Machines Corporation Multimedia content description framework
US6748421B1 (en) * 1998-12-23 2004-06-08 Canon Kabushiki Kaisha Method and system for conveying video messages
US6243676B1 (en) * 1998-12-23 2001-06-05 Openwave Systems Inc. Searching and retrieving multimedia information
US6236395B1 (en) * 1999-02-01 2001-05-22 Sharp Laboratories Of America, Inc. Audiovisual information management system
US6678890B1 (en) * 1999-03-10 2004-01-13 Sony Corporation Bidirectional transmission/reception system and method and transmission apparatus
US6345279B1 (en) * 1999-04-23 2002-02-05 International Business Machines Corporation Methods and apparatus for adapting multimedia content for client devices
US6477565B1 (en) * 1999-06-01 2002-11-05 Yodlee.Com, Inc. Method and apparatus for restructuring of personalized data for transmission from a data network to connected and portable network appliances
US20040117831A1 (en) * 1999-06-28 2004-06-17 United Video Properties, Inc. Interactive television program guide system and method with niche hubs
US6324512B1 (en) * 1999-08-26 2001-11-27 Matsushita Electric Industrial Co., Ltd. System and method for allowing family members to access TV contents and program media recorder over telephone or internet
US20050223408A1 (en) * 1999-09-13 2005-10-06 Microstrategy, Incorporated System and method for real-time, personalized, dynamic, interactive voice services for entertainment-related information
US7178107B2 (en) * 1999-09-16 2007-02-13 Sharp Laboratories Of America, Inc. Audiovisual information management system with identification prescriptions
US6304898B1 (en) * 1999-10-13 2001-10-16 Datahouse, Inc. Method and system for creating and sending graphical email
US20050076357A1 (en) * 1999-10-28 2005-04-07 Fenne Adam Michael Dynamic insertion of targeted sponsored video messages into Internet multimedia broadcasts
US6970915B1 (en) * 1999-11-01 2005-11-29 Tellme Networks, Inc. Streaming content over a telephone interface
US20050076378A1 (en) * 1999-12-16 2005-04-07 Microsoft Corporation Live presentation searching
US20010049826A1 (en) * 2000-01-19 2001-12-06 Itzhak Wilf Method of searching video channels by content
US6671715B1 (en) * 2000-01-21 2003-12-30 Microstrategy, Inc. System and method for automatic, real-time delivery of personalized informational and transactional data to users via high throughput content delivery device
US20010052019A1 (en) * 2000-02-04 2001-12-13 Ovt, Inc. Video mail delivery system
US6496857B1 (en) * 2000-02-08 2002-12-17 Mirror Worlds Technologies, Inc. Delivering targeted, enhanced advertisements across electronic networks
US6385306B1 (en) * 2000-03-02 2002-05-07 John Francis Baxter, Jr. Audio file transmission method
US20040261095A1 (en) * 2000-04-07 2004-12-23 Sezan Muhammed Ibrahim Audiovisual information management system
US20020138843A1 (en) * 2000-05-19 2002-09-26 Andrew Samaan Video distribution method and system
US20020052747A1 (en) * 2000-08-21 2002-05-02 Sarukkai Ramesh R. Method and system of interpreting and presenting web content using a voice browser
US7130790B1 (en) * 2000-10-24 2006-10-31 Global Translations, Inc. System and method for closed caption data translation
US20020100046A1 (en) * 2000-11-16 2002-07-25 Dudkiewicz Gil Gavriel System and method for determining the desirability of video programming events
US20020093591A1 (en) * 2000-12-12 2002-07-18 Nec Usa, Inc. Creating audio-centric, imagecentric, and integrated audio visual summaries
US20020173964A1 (en) * 2001-03-30 2002-11-21 International Business Machines Corporation Speech driven data selection in a voice-enabled program
US20020152464A1 (en) * 2001-04-13 2002-10-17 Sony Corporation System and method for pushing internet content onto interactive television

Cited By (132)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8706735B2 (en) * 2000-07-06 2014-04-22 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US20090125534A1 (en) * 2000-07-06 2009-05-14 Michael Scott Morton Method and System for Indexing and Searching Timed Media Information Based Upon Relevance Intervals
US7490092B2 (en) * 2000-07-06 2009-02-10 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US8117206B2 (en) 2000-07-06 2012-02-14 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US9542393B2 (en) 2000-07-06 2017-01-10 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US9244973B2 (en) 2000-07-06 2016-01-26 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US20050216443A1 (en) * 2000-07-06 2005-09-29 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US8527520B2 (en) 2000-07-06 2013-09-03 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevant intervals
US20130318121A1 (en) * 2000-07-06 2013-11-28 Streamsage, Inc. Method and System for Indexing and Searching Timed Media Information Based Upon Relevance Intervals
US9099152B2 (en) 2000-09-08 2015-08-04 Ntech Properties, Inc. Method and apparatus for creation, distribution, assembly and verification of media
US8924383B2 (en) * 2001-04-06 2014-12-30 At&T Intellectual Property Ii, L.P. Broadcast video monitoring and alerting system
US20090234862A9 (en) * 2001-04-06 2009-09-17 Lee Begeja Broadcast video monitoring and alerting system
US10462510B2 (en) 2001-04-06 2019-10-29 At&T Intellectual Property Ii, L.P. Method and apparatus for automatically converting source video into electronic mail messages
US20060117040A1 (en) * 2001-04-06 2006-06-01 Lee Begeja Broadcast video monitoring and alerting system
US10749924B2 (en) 2001-09-11 2020-08-18 Ntech Properties, Inc. Method and system for generation of media
US9419844B2 (en) 2001-09-11 2016-08-16 Ntech Properties, Inc. Method and system for generation of media
US20030093814A1 (en) * 2001-11-09 2003-05-15 Birmingham Blair B.A. System and method for generating user-specific television content based on closed captioning content
US20030122966A1 (en) * 2001-12-06 2003-07-03 Digeo, Inc. System and method for meta data distribution to customize media content playback
US20030192045A1 (en) * 2002-04-04 2003-10-09 International Business Machines Corporation Apparatus and method for blocking television commercials and displaying alternative programming
US7403990B2 (en) * 2002-05-08 2008-07-22 Ricoh Company, Ltd. Information distribution system
US20030233441A1 (en) * 2002-05-08 2003-12-18 Yoko Nishiyama Information distribution system
US20030226151A1 (en) * 2002-05-30 2003-12-04 International Business Machines Corporation Content reproduction controller, data management device, storage-type content distribution system, content distribution method, content distribution server,control data transmission server, and program product therefor
US8839283B2 (en) 2002-07-25 2014-09-16 International Business Machines Corporation Blocking television commercials and providing an archive interrogation program
US8359613B2 (en) 2002-07-25 2013-01-22 International Business Machines Corporation Blocking television commercials and providing an archive interrogation program
US20090031337A1 (en) * 2002-07-25 2009-01-29 International Business Machines Corporation Apparatus and Method for Blocking Television Commercials and Providing an Archive Interrogation Program
US20040025191A1 (en) * 2002-07-31 2004-02-05 B. Popular, Inc. System and method for creating and presenting content packages
US9495438B2 (en) 2003-05-27 2016-11-15 Sony Corporation Information processing apparatus and method, program, and recording medium
US8549017B2 (en) * 2003-05-27 2013-10-01 Sony Corporation Information processing apparatus and method, program, and recording medium
US20080016092A1 (en) * 2003-05-27 2008-01-17 Sony Corporation Information processing apparatus and method, program, and recording medium
US20040243627A1 (en) * 2003-05-28 2004-12-02 Integrated Data Control, Inc. Chat stream information capturing and indexing system
US8875185B2 (en) 2003-06-24 2014-10-28 Ntech Properties, Inc. Method and apparatus for efficient, entertaining information delivery
US20050044569A1 (en) * 2003-06-24 2005-02-24 Dwight Marcus Method and apparatus for efficient, entertaining information delivery
US20050010953A1 (en) * 2003-07-11 2005-01-13 John Carney System and method for creating and presenting composite video-on-demand content
US20050010950A1 (en) * 2003-07-11 2005-01-13 John Carney System and method for automatically generating a composite video-on-demand content
US9615061B2 (en) 2003-07-11 2017-04-04 Tvworks, Llc System and method for creating and presenting composite video-on-demand content
US20050144305A1 (en) * 2003-10-21 2005-06-30 The Board Of Trustees Operating Michigan State University Systems and methods for identifying, segmenting, collecting, annotating, and publishing multimedia materials
US20050128192A1 (en) * 2003-12-12 2005-06-16 International Business Machines Corporation Modifying visual presentations based on environmental context and user preferences
US20050129252A1 (en) * 2003-12-12 2005-06-16 International Business Machines Corporation Audio presentations based on environmental context and user preferences
US20070233674A1 (en) * 2004-02-06 2007-10-04 Barbara De Lury Systems, methods and apparatus to determine relevance of search results in whole/part search
US20050198014A1 (en) * 2004-02-06 2005-09-08 Barbara De Lury Systems, methods and apparatus of a whole/part search engine
WO2007001247A3 (en) * 2004-06-02 2007-08-09 Yahoo Inc Content-management system for user behavior targeting
WO2005119521A3 (en) * 2004-06-02 2007-06-07 Yahoo Inc Content-management system for user behavior targeting
WO2007001247A2 (en) * 2004-06-02 2007-01-04 Yahoo! Inc. Content-management system for user behavior targeting
US20060010472A1 (en) * 2004-07-06 2006-01-12 Balazs Godeny System, method, and apparatus for creating searchable media files from streamed media
US20060085731A1 (en) * 2004-09-28 2006-04-20 Yahoo! Inc. Method for providing a clip for viewing at a remote device
US8112548B2 (en) 2004-09-28 2012-02-07 Yahoo! Inc. Method for providing a clip for viewing at a remote device
TWI400933B (en) * 2004-10-27 2013-07-01 Ericsson Telefon Ab L M Terminal for receiving transmissions in a form of a media stream and method of operating the same
US8136137B2 (en) * 2004-11-22 2012-03-13 Lg Electronics Inc. Program searching in digital multimedia terminal
US20070204306A1 (en) * 2004-11-22 2007-08-30 Ha-Yun Kim Program searching in digital multimedia terminal
US8181202B2 (en) 2004-11-22 2012-05-15 Lg Electronics Inc. Program searching in digital multimedia terminal
US20060174278A1 (en) * 2004-11-22 2006-08-03 Lg Electronics Inc. Program searching in digital multimedia terminal
US20060224757A1 (en) * 2005-03-15 2006-10-05 Han Fang System and method for streaming service replication a in peer-to-peer network
US20070088844A1 (en) * 2005-06-07 2007-04-19 Meta Interfaces, Llc System for and method of extracting a time-based portion of media and serving it over the Web
US20070027844A1 (en) * 2005-07-28 2007-02-01 Microsoft Corporation Navigating recorded multimedia content using keywords or phrases
US20070130585A1 (en) * 2005-12-05 2007-06-07 Perret Pierre A Virtual Store Management Method and System for Operating an Interactive Audio/Video Entertainment System According to Viewers Tastes and Preferences
US20080036917A1 (en) * 2006-04-07 2008-02-14 Mark Pascarella Methods and systems for generating and delivering navigatable composite videos
US11166074B1 (en) 2006-05-19 2021-11-02 Universal Innovation Council, LLC Creating customized programming content
US11363347B1 (en) 2006-05-19 2022-06-14 Universal Innovation Council, LLC Creating customized programming content
US11678026B1 (en) 2006-05-19 2023-06-13 Universal Innovation Council, LLC Creating customized programming content
US9602884B1 (en) 2006-05-19 2017-03-21 Universal Innovation Counsel, Inc. Creating customized programming content
US10616643B1 (en) 2006-05-19 2020-04-07 Universal Innovation Counsel, Llc Creating customized programming content
WO2007146525A1 (en) * 2006-06-06 2007-12-21 Yahoo! Inc. Providing an actionable event in an intercepted text massage for a mobile device based on customized user information
US8170584B2 (en) 2006-06-06 2012-05-01 Yahoo! Inc. Providing an actionable event in an intercepted text message for a mobile device based on customized user information
US20070282954A1 (en) * 2006-06-06 2007-12-06 Yahoo! Inc. Providing an actionable event in an intercepted text message for a mobile device based on customized user information
US20080086754A1 (en) * 2006-09-14 2008-04-10 Sbc Knowledge Ventures, Lp Peer to peer media distribution system and method
US8589973B2 (en) 2006-09-14 2013-11-19 At&T Intellectual Property I, L.P. Peer to peer media distribution system and method
US10063610B1 (en) * 2006-11-08 2018-08-28 Open Invention Network, Llc Apparatus and method for dynamically providing web-based multimedia to a mobile phone
US20080132215A1 (en) * 2006-12-01 2008-06-05 Yahoo! Inc. User initiated invite for automatic conference participation by invitee
US8396461B2 (en) 2006-12-01 2013-03-12 Yahoo! Inc. User initiated invite for automatic conference participation by invitee
US8081958B2 (en) 2006-12-01 2011-12-20 Yahoo! Inc. User initiated invite for automatic conference participation by invitee
US20110167462A1 (en) * 2006-12-04 2011-07-07 Digitalsmiths Systems and methods of searching for and presenting video and audio
US20080155627A1 (en) * 2006-12-04 2008-06-26 O'connor Daniel Systems and methods of searching for and presenting video and audio
US20080147636A1 (en) * 2006-12-14 2008-06-19 Yahoo! Inc. Video distribution systems and methods
US8046803B1 (en) 2006-12-28 2011-10-25 Sprint Communications Company L.P. Contextual multimedia metatagging
US20080168499A1 (en) * 2007-01-05 2008-07-10 Sony Corporation Information processing apparatus and method, and program
US8316395B2 (en) * 2007-01-05 2012-11-20 Sony Corporation Information processing apparatus and method, and program
US20080178219A1 (en) * 2007-01-23 2008-07-24 At&T Knowledge Ventures, Lp System and method for providing video content
US9923947B2 (en) 2007-06-13 2018-03-20 Ntech Properties, Inc. Method and system for providing media programming
US8886753B2 (en) 2007-06-13 2014-11-11 NTECH Propertie, Inc. Method and system for providing media programming
US8503523B2 (en) 2007-06-29 2013-08-06 Microsoft Corporation Forming a representation of a video item and use thereof
US20090007202A1 (en) * 2007-06-29 2009-01-01 Microsoft Corporation Forming a Representation of a Video Item and Use Thereof
US8060407B1 (en) 2007-09-04 2011-11-15 Sprint Communications Company L.P. Method for providing personalized, targeted advertisements during playback of media
US10181132B1 (en) 2007-09-04 2019-01-15 Sprint Communications Company L.P. Method for providing personalized, targeted advertisements during playback of media
US8606637B1 (en) 2007-09-04 2013-12-10 Sprint Communications Company L.P. Method for providing personalized, targeted advertisements during playback of media
US8589368B1 (en) 2007-09-05 2013-11-19 Adobe Systems Incorporated Media players and download manager functionality
US8015167B1 (en) * 2007-09-05 2011-09-06 Adobe Systems Incorporated Media players and download manager functionality
US20090150784A1 (en) * 2007-12-07 2009-06-11 Microsoft Corporation User interface for previewing video items
US8806530B1 (en) 2008-04-22 2014-08-12 Sprint Communications Company L.P. Dual channel presence detection and content delivery system and method
US20100158470A1 (en) * 2008-12-24 2010-06-24 Comcast Interactive Media, Llc Identification of segments within audio, video, and multimedia items
US9442933B2 (en) 2008-12-24 2016-09-13 Comcast Interactive Media, Llc Identification of segments within audio, video, and multimedia items
US11468109B2 (en) 2008-12-24 2022-10-11 Comcast Interactive Media, Llc Searching for segments based on an ontology
US20100161580A1 (en) * 2008-12-24 2010-06-24 Comcast Interactive Media, Llc Method and apparatus for organizing segments of media assets and determining relevance of segments to a query
US9477712B2 (en) 2008-12-24 2016-10-25 Comcast Interactive Media, Llc Searching for segments based on an ontology
US8713016B2 (en) 2008-12-24 2014-04-29 Comcast Interactive Media, Llc Method and apparatus for organizing segments of media assets and determining relevance of segments to a query
US10635709B2 (en) 2008-12-24 2020-04-28 Comcast Interactive Media, Llc Searching for segments based on an ontology
US11531668B2 (en) 2008-12-29 2022-12-20 Comcast Interactive Media, Llc Merging of multiple data sets
US9348915B2 (en) 2009-03-12 2016-05-24 Comcast Interactive Media, Llc Ranking search results
US10025832B2 (en) 2009-03-12 2018-07-17 Comcast Interactive Media, Llc Ranking search results
US8533223B2 (en) 2009-05-12 2013-09-10 Comcast Interactive Media, LLC. Disambiguation and tagging of entities
US9626424B2 (en) 2009-05-12 2017-04-18 Comcast Interactive Media, Llc Disambiguation and tagging of entities
US20100332497A1 (en) * 2009-06-26 2010-12-30 Microsoft Corporation Presenting an assembled sequence of preview videos
US8799253B2 (en) * 2009-06-26 2014-08-05 Microsoft Corporation Presenting an assembled sequence of preview videos
US9892730B2 (en) 2009-07-01 2018-02-13 Comcast Interactive Media, Llc Generating topic-specific language models
US10559301B2 (en) 2009-07-01 2020-02-11 Comcast Interactive Media, Llc Generating topic-specific language models
US11562737B2 (en) 2009-07-01 2023-01-24 Tivo Corporation Generating topic-specific language models
US8990104B1 (en) 2009-10-27 2015-03-24 Sprint Communications Company L.P. Multimedia product placement marketplace
US9940644B1 (en) 2009-10-27 2018-04-10 Sprint Communications Company L.P. Multimedia product placement marketplace
US8572488B2 (en) * 2010-03-29 2013-10-29 Avid Technology, Inc. Spot dialog editor
US20110239119A1 (en) * 2010-03-29 2011-09-29 Phillips Michael E Spot dialog editor
US9749376B2 (en) 2010-05-21 2017-08-29 Mark J. Bologh Video delivery expedition apparatuses, methods and systems
WO2011146898A2 (en) * 2010-05-21 2011-11-24 Bologh Mark J Internet system for ultra high video quality
WO2011146898A3 (en) * 2010-05-21 2012-03-29 Bologh Mark J Internet system for ultra high video quality
US8423555B2 (en) 2010-07-09 2013-04-16 Comcast Cable Communications, Llc Automatic segmentation of video
US9177080B2 (en) 2010-07-09 2015-11-03 Comcast Cable Communications, Llc Automatic segmentation of video
USRE46114E1 (en) * 2011-01-27 2016-08-16 NETFLIX Inc. Insertion points for streaming video autoplay
US8689269B2 (en) * 2011-01-27 2014-04-01 Netflix, Inc. Insertion points for streaming video autoplay
US20120246240A1 (en) * 2011-03-24 2012-09-27 Apple Inc. Providing Context Information Relating To Media Content That Is Being Presented
US9510026B1 (en) * 2011-05-10 2016-11-29 Google Inc. Apparatus and methods for generating clips using recipes with slice definitions
US9226034B1 (en) * 2011-05-10 2015-12-29 Google Inc. Apparatus and methods for generating clips using recipes with slice definitions
US9998768B1 (en) 2011-05-10 2018-06-12 Google Llc Apparatus and methods for generating clips using recipes with slice definitions
US10467289B2 (en) 2011-08-02 2019-11-05 Comcast Cable Communications, Llc Segmentation of video according to narrative theme
US9113203B2 (en) 2012-06-28 2015-08-18 Google Inc. Generating a sequence of audio fingerprints at a set top box
US10536733B2 (en) 2012-09-19 2020-01-14 Google Llc Systems and methods for live media content matching
WO2014047337A3 (en) * 2012-09-19 2014-06-19 Google Inc. Systems and methods for live media content matching
US11677995B2 (en) 2012-09-19 2023-06-13 Google Llc Systems and methods for live media content matching
US11064227B2 (en) 2012-09-19 2021-07-13 Google Llc Systems and methods for live media content matching
US9661361B2 (en) 2012-09-19 2017-05-23 Google Inc. Systems and methods for live media content matching
US20140101551A1 (en) * 2012-10-05 2014-04-10 Google Inc. Stitching videos into an aggregate video
WO2014055831A1 (en) * 2012-10-05 2014-04-10 Google Inc. Stitching videos into an aggregate video
US9560103B2 (en) 2013-06-26 2017-01-31 Echostar Technologies L.L.C. Custom video content
US20230156261A1 (en) * 2020-07-30 2023-05-18 At&T Intellectual Property I, L.P. Automated, user-driven, and personalized curation of short-form media segments
US11558650B2 (en) * 2020-07-30 2023-01-17 At&T Intellectual Property I, L.P. Automated, user-driven, and personalized curation of short-form media segments

Also Published As

Publication number Publication date
US8151298B2 (en) 2012-04-03
US20030030752A1 (en) 2003-02-13
CA2380898A1 (en) 2002-10-06
US20030120748A1 (en) 2003-06-26

Similar Documents

Publication Publication Date Title
US8151298B2 (en) Method and system for embedding information into streaming media
US10462510B2 (en) Method and apparatus for automatically converting source video into electronic mail messages
US8060906B2 (en) Method and apparatus for interactively retrieving content related to previous query results
US20240007696A1 (en) Systems and methods for using video metadata to associate advertisements therewith
US8230343B2 (en) Audio and video program recording, editing and playback systems using metadata
US10313714B2 (en) Audiovisual content presentation dependent on metadata
US6760916B2 (en) Method, system and computer program product for producing and distributing enhanced media downstreams
US11832024B2 (en) Method and apparatus for delivering video and video-related content at sub-asset level
EP1421792B1 (en) Audio and video program recording, editing and playback systems using metadata
US7281260B2 (en) Streaming media publishing system and method
US20030093794A1 (en) Method and system for personal information retrieval, update and presentation
BR112016006860B1 (en) APPARATUS AND METHOD FOR CREATING A SINGLE DATA FLOW OF COMBINED INFORMATION FOR RENDERING ON A CUSTOMER COMPUTING DEVICE
JP2005512233A (en) System and method for retrieving information about a person in a video program
WO2003014949A9 (en) Method, system, and computer program product for producing and distributing enhanced media
IES20030840A2 (en) Multimedia management
US9635400B1 (en) Subscribing to video clips by source
Begeja et al. eClips: A new personalized multimedia delivery service
US20240098221A1 (en) Method and apparatus for delivering video and video-related content at sub-asset level
Wales et al. IPTV-The revolution is here
US20190182517A1 (en) Providing Enrichment Data That is a Video Segment
IE20030840U1 (en) Multimedia management
IES83424Y1 (en) Multimedia management

Legal Events

Date Code Title Description
AS Assignment

Owner name: AT&T CORP., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEGEJA, LEE;GIBBON, DAVID CRAWFORD;HUBER, KENNETH MERVIN;AND OTHERS;REEL/FRAME:012452/0286;SIGNING DATES FROM 20011212 TO 20011221

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION