US3846826A - Direct television drawing and image manipulating system - Google Patents

Direct television drawing and image manipulating system Download PDF

Info

Publication number
US3846826A
US3846826A US00323874A US32387473A US3846826A US 3846826 A US3846826 A US 3846826A US 00323874 A US00323874 A US 00323874A US 32387473 A US32387473 A US 32387473A US 3846826 A US3846826 A US 3846826A
Authority
US
United States
Prior art keywords
signals
television
scanning
points
color
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US00323874A
Inventor
R Mueller
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US00323874A priority Critical patent/US3846826A/en
Application granted granted Critical
Publication of US3846826A publication Critical patent/US3846826A/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus

Definitions

  • Cited output graphic processing systems for visualizing mathematical transformations, or for use with scan- 2 I68 049 $555 ZZ IT PATENTS 178/20 ning lasers or electron microscopes that etch or score.
  • My invention is a first step toward channelling video image manipulation, allowing a person the necessary freedom of control to keep the human imagination in a free interaction with the medium as unrestrained as possible. It eliminates the need for special styluses or probes, and allows an artist or designer to use the most subtle of his tools directly: the paint brush or a fine steel penpoint. Thus a person can draw or paint directly into the medium of color television in full color without the use of pigments, dyes or inks.
  • the invention operates when a person places any type of a drawing or painting instrument on a special paintscreen. Marks appear on the color television monitor at points or areas corresponding to the shape of the drawing object tip. One by one, as they are introduced by hand, these marks are made any desired color by controls. The marks can remain where they are placed for a short or a long time, or they can be made to disappear electronically. Color mixing between successively placed forms is either additive or subtractive, or the new color can dominate the old, accomplished electronically and under control of the persons free hand.
  • the invention enables a person to exert a wide range of automatic visual controls to synthesize images from those actually drawn. For example, by switching on a circuit when a key is pressed it is possible to cause instant size changes in all images drawn in.
  • Other systems allow a person to create the letters of the alphabet, so that he can set them down into the television screen, in any desired color, and move them about at will until he has composed his image.
  • This new medium will obviously make it an important artistic medium for commercial or fine art applications.
  • the results of using this invention can be experienced by looking at the color television monitor at the same moment images are made, or they can be broadcast live over a television station.
  • the pictures can also be recorded on video tape or moving picture film for later viewing.
  • the painting can also be a collaborative effort in which two or more of the instruments are connected together electronically.
  • My invention is in fact a device that turns the visual arts into performing arts so that duets or trios, or even orchestras of visual productions, are possible.
  • my invention has four main areas of application.
  • background scenes or previously drawn pictures can be applied from conventional television inputs, appearing under the drawn images on the output monitor.
  • the invention serves as a new computer input device, having certain abilities to pre-process forms so that less analysis will be required by the computer, simplifying the problems of pattern recognition and assimilation by the computer.
  • the invention leads to a simple way for mathematicians to visualize and experiment with electronic symbols, or symbols that immediately manifest mathematical properties such as visual transformations, as for example in transformations that occur when passing from the real to the complex number plane.
  • the output of the invention can be used to control a scanning laser or microscope system employing scanning electrons, for the purposes of etching or burning, allowing a person to perform delicate manual burning or scoring over areas, even down to microscopic dimensions.
  • the images can be created by means of musical notes, filtered from an audio circuit and made to activate the manipulating circuits automatically.
  • Various types of image synthesis can also be achieved by differing circuit arrangements, using various types of feedback, for example.
  • Depth can be simulated by causing successively memorized images to be of differing sizes.
  • Depth can also be created by doubling the circuits, providing a means to draw in a volume, and providing dual monitors with appropriate optical systems that allow the right and left eyes to differentiate the images created.
  • the resolution or detail of all images created in the invention can be made as sharp as desired since it is a closed-circuit color television system. If it is desired to convert the output into standard interlaced 525-line images, they can be derived from a scan converter connected to the output system, or by imaging the visual output directly with a studio television camera.
  • FIG. I shows the optical system whereby handplaced marks on a prism cause an interruption of a flying-spot scanner raster image and create a paintpulse gating signal.
  • FIG. 2 shows a block diagram of a system for utilizing the paintpulse gating signal to introduce and retain any arbitrary color on the screen of a closed-circuit color television system.
  • FIG. 3 indicates the system whereby movements or distortions can be introduced into the raster to affect the final image.
  • FIG. 4 shows the details of a key on a piano-type keyboard used to activate and control manipulative image changes through a potentiometer and microswitch arrangement.
  • My system enables an artist to use conventional brushes or pens for painting or drawing into color television signals. He can also use his fingers, any type of rubber or plastic form or design, like a rubber stamp, or any stylus whatsoever, which he touches to a special draw or paintscreen, that is one surface of a polished glass or plastic prism or the like.
  • a single stylus can produce a wide variety of line qualities, as for example when its tip is flat so that it can be turned by hand as it is moved, like a flat pen point turned to draw both thick and thin lines. Or if a brush is used, it can cause a very tinydot or line when only the tip is engaged, or a very broad line when it is pressed down.
  • every point touched on the draw or paintscreen is introduced, so that multiple tipped styluses can introduce large shapes, or rubber stamp-like shapes can introduce symbols or letters, instantly positioned by hand anywhere on the paintscreen and therefore on the output area.
  • FIG. 1 shows the optical system for causing handintroduced marks to generate a paintpulse gating signal.
  • the raster l of a flying-spot cathode ray tube (CRT) 2 whose sweep is derived from a standard set of vertical and horizontal deflection generators of any line definition desired, is focussed by means of lens 3 through wedge 4 onto the internal totally-reflective undersurface of prism 5.
  • the principal focus of the lens is indicated in the figure by the dashed lines ab to cd, of which only the side portion ae is used.
  • the wedge 4 compensates for the prism refraction in order to bring the entire raster 1 into sharp focus and undistorted at the internal totally reflective surface of prism 5.
  • FIG. 2 is a block diagram showing how the paintpulse causes any desired color to be generated on the output screen of a color television system.
  • the paintpulse is first amplified in video amp 10, and clipped in the clipper. Clipping is not necessary of course if the paintpulse is of the correct amplitude to drive the gates, as determined by the video amp. 10.
  • Clipper 11 is a voltage-limited diode circuit.
  • the paintpulse serves then as a gating signal to activate three gates 12, 13 and 14. They are each pentode-type keying gates, biased so that when a paintpulse signal is sent to their screen grids they will pass all signals applied to their control grids respectively.
  • the control grids each receive signals from the color generator 15.
  • Color generator 15 produces voltages corresponding to red, green and blue color television signals as they would be required for application directly to the control grids of a color television tri-beam CRT. Since the system is closed circuit, these signals can be dc. The signals necessary to cause white to appear on a color CRT. for example, must have the correct proportionality so that the color phosphors generate the necessary light components that add up to white, namely, equal voltages on each grid. When the three outputs from the color generator 15 maintain this relationship they will produce from black through the grays to white, depending upon their voltage amplitudes.
  • the color generator 15 generates these various voltages from a potentiometer-controlled resistive matrixing circuit which generates the R, G and B (Red, Green and Blue) signal voltages under controls 17.
  • This matrix is arranged so that a single control element can be used to introduce the necessary voltage combinations to result in any desired color hue in the output tube.
  • This embodiment of my invention does not require the generation and control of the NTSC composite color television signal since it is closed circuit.
  • color gen 15 is a colorizer or color encoder, and the remaining output circuits are designed to operate from this signal, as in a standard color television receiver.
  • the color controls of color gen 15 can be hand set; they can be attached to the piano-like keyboard described below; or they can be mounted on the stylus or brush 8 so that a person can control the color as he paints.
  • the three gates for red 12, green 13 and blue 14 are triggered only when a paintpulse is sent from clipper 11. When they are triggered, they pass the various components of the color signals from color gen 15, set by the controls 17, to three double-ended storage tubes 18, 19 and 20.
  • the signals at this pont are now video signals due to the paintpulse gating actions through the gates, and they are stored by means of the write portion of the storage tubes, deflected across their internal storage surface by the horizontal and vertical deflection portions of scan gen 21, synchronized to the raster 1 of the original flying-spot scanner CRT 2.
  • the various levels of the color signals establish various levels of charge across the storage surface of the storage tubes 18, 19 and 20. This storage is necessary to preserve various signals as the person paints in images across the paintscreen.
  • Other images can be introduced into the system through a conventional video resistance network matrix which accepts and combines various video inputs, without their influencing one another.
  • the other images may be background images or other information to be combined with the newly painted inputs, or they may be the input of another similar system controlled by another or by more people.
  • the images appearing on color CRT 16 can be photographed, or viewed by the person making the color video image.
  • the tri-color output can be replaced by three blackand-white CRTs each therefore giving the red, green and blue images, that lend themselves to be photographed for creating the separation images required for the standard three-color printing process.
  • the entire color output can also be replaced with a scanning laser, scanning electron, iron, X-ray or other scanning system, as described below.
  • This system of point-by-point painting into color television lends itself to the creation of many automatic alterations on the points as they are introduced on the paint screen.
  • My system inherently provides two general manipulative potentials, first one caused by altering, moving or distorting the original raster ground; and second one caused when the gating system introduces information in addition to the color signals, as for instance images derived and generated by vidicon cam eras trained on real images or designs.
  • Raster Ground Manipulation Considering the first raster ground manipulation, it is clear that the original raster 1 must be in exact focus on the prism 5 totally reflective undersurface, which was the purpose of the correcting wedge 4; that it must not be distorted; and that its shading must be uniform; or otherwise the output signal will not be correct with respect to the drawing or painting laid down. on the paintsurface. This fact can be exploited to cause variations. For example, size variations in the raster 1 will be reflected as size changes in the output. If the raster 1 is made very small with respect to the paint surface of the prism, all movements of the brush or stylus will be written large in the output since small hand movements will encompass the small raster area very easily.
  • FIG. 3 shows how the various control elements of the vertical 23 and horizontal 24 deflection generators that generate raster 1 on CRT 2, can be brought out and controlled by a piane-type keyboard 25.
  • the purpose of this piano of typewriter-like control 25 is to create a versatile and subtle means whereby a person can, with skill and training, be able to synthesize a broad variety of abstract or realistic designs or images everywhere that the painting stylus or brush is placed.
  • the effects of three controls in the vertical circuits and three controls in the horizontal circuits, or six keys on 25, are illustrated in this embodiment of my invention. It is to be understood that the raster can also be altered, distorted, moved or otherwise controlled by means of anaspherical, anamorphic or other types of lenses or mirror systems.
  • the raster can also be computer controlled to create many very complex variations in its geometry and image synthesizing abilities. It can also be controlled by electronic circuits to create symbols, simply by causing it to be moved about in toto by signals that form these symbols and are applied to the centering voltages of the CRT 2, under keyboard or other control. Additionally, the raster can be variously blanked, defocussed or othewise radically altered, as for example if it is turned into a spiral sweep, and so on, all having predetermined effects on the output image and the manner in which the system will break up or distort any drawing or painting laid down by hand point-by-point, but only so long as any particular image manipulating circuit is turned on. The raster can also be distorted or wiggled or moved electronically or optically with acoustical, mechanical-optical or the like systems.
  • FIG. 4 shows the keys, highlighting the detailed operation of one.
  • the key 26 is pivoted near its rear at 27.
  • An extension of spring metal 28 is engaged with microswitch 29 such that the slightest touch of a finger of hand 30 onto the key will activate it and switch in the appropriate circuit action.
  • movement of key 26 will slightly rotate cam 31, and cause it to turn potentiometer 32 by means of the gear surfaces on 31 and 33.
  • Potentiometer 32 is the control element in the same circuit switched on by microswitch 29.
  • the vertical deflection generator, vert def gen 23, is a sawtooth relaxation oscillator
  • the horizontal deflection generator, horiz def gen 24 is a flyback-type oscillator, generating a current sawtooth in the deflection yoke of CRT 2.
  • the linearity, height or width, and centering resistive controls of these two circuits are brought out as shown (numbers 37 through 42.)
  • Each of these controls are shunted with six of the variable potentiometer-switch key controls on keyboard 25. The following effects are therefore introduced, and magnitude controlled, as each key is depressed:
  • Vertical Linearity 37 affects length of small vertical lines, altering the length as they appear in the output, as a function of where they are drawn on the paintscreen along the vertical axis.
  • Horizontal Linearity 40 same affect as above, only in the horizontal direction.
  • Vertical Size 38 distorts the vertical size of all lines or shapes drawn on the paintscreen, distorting them along the vertical axis.
  • Horizontal Size 44 same affect as above, only in the horizontal direction.
  • Vertical Centering 39 affects position of all points introduced, changing where they will appear along the vertical axis of the output screen.
  • FIG. 3 enables a person to play one hand over the keyboard and manipulate dot-by-dot, or point-by-point, as he draws or paints with his free hand. While the particular manipulations are limited, the potential exists for introducing very comprehensive alterations in the points as they are introduced. It is obvious that a systematic organization of potential manipulations must be made, perhaps under the control of a plug-board type switching system for various different types of image-handling problems.
  • This system can also cause non-linear coordinate transformations between differing geomemtries of sweep. If, for example, the raster 1 is shifted completely from a rectangular coordinate system to a spiral sweep, and the output monitor maintains a conventional sweep scan, very drastic alterations will occur in all the geometries hand-drawn on the paintscreen, as viewed in the output monitor.
  • the geometric relationships of the scans of raster l and CRT 16 raster must be such that they begin to scan their respective areas from a given point, generating lines and circles with a consistent relationship, and terminate in synchronism at another given point.
  • Both rasters must be initiated in synchronism, and as the spiral raster is traced out, by a deflection system conventional to the radar art, it must turn one loop of its circle per line of the output raster, terminating at the center when the rectangular raster terminates at its end. All drawn images will therefore be transformed into a distorted, circular image, immediately visible as it is drawn, In another arrangement the invention can be used to manifest visually the discontinuities that occur when complex variables are graphed.
  • the paintscreen raster l is overlapped by reflecting it off a broken mirror before it is focussed from 3 to the wedge 4, introducing a discontinuity along a discrete line in the original paintscreen area, when a person draws across this line domain as reflected across the paint surface, the discontinuity will occur as a jump in the output at the same line domain.
  • Discontinuities can also be introduced into the raster l by means of a computer, automatically predistorting it according to any given complex equation, such that any hand-drawn image geometry will be visualized immediately on the output screen in the act of the drawing.
  • the invention therefore becomes a potential adjunct for a mathematician desiring an instantaneous view of transformations of given hand-drawn geometries or shapes transformed from one coordinate system to another.
  • Paintpulse Gating Manipulation In FIG. 2, the gates are turned on in time corresponding to points within the raster l timing, according to where stylus or brush 8 is positioned, generating the paintpulse. If the paintpulse is used to activate signals coming from other sources, those signals will be introduced into the output screen at these points.
  • the desired signals can be derived from a series of small vidicons, whose sweeps are synchronized by the gating paintpulse, trained on a series of specific symbols or images that a person might desire to introduce into the visual output, each switched in by additional keys on keyboard 25.
  • a series of small vidicons whose sweeps are synchronized by the gating paintpulse, trained on a series of specific symbols or images that a person might desire to introduce into the visual output, each switched in by additional keys on keyboard 25.
  • Another large body of images can be brought into play with the keyboard, placed down anywhere within the visual output by means of the stylus or brush 8 touching the paintscreen the moment that a particular key is depressed.
  • the above inputs provide another large group of image manipulations which, in combination with the raster ground manipulation described above, makes the invention a versatile device for graphic creation.
  • multi-colored images created are all accumulated withint he storage tubes 18, 19 and 20, unless overdrawn with another images, or erased in total by turning off the storage tubes. 7
  • Music can be introduced by means of coupling a piano to the switching system of keyboard 25, or the switches of keyboard 25 can control the elements of a music synthesizer or electric organ.
  • the image of a given scene or drawing can be derived from a vidicon, applied to the grid of CRT 1, intensity modulating this scene on the raster 1, and with the above feedback, this scene or drawing will be distorted as the person places the brush or stylus over corresponding points, and manipulates them too if desired, allvisible on the monitor output CRT 16, and preserved in the storage tubes or not, as desired.
  • Another variation introduces paintpulses electronically, eliminating the prism flying-spot painting capability, these pulses being under control of keys on keyboard 25.
  • single pulses are generated at the raster 1 frame rate in multivibrator circuits, delayed from each other so as not to introduce coincident pulses, each turned on by keys of keyboard 25.
  • a person plays the keyboard, and also plays circuits that activate manipulation, he can cause images to come and go at various spots across the screen, varied as desired according to the repertory of symbols or images introduced by means of the small vidicons in the system described above.
  • musical switching signals derived from a source of music whose frequencies are filtered and connected to trigger switching voltages as a function of audio frequencies, as in astandard multichannel color organ, are used to turn on the 10 pulses generated above, in a predetermined order across the screen, also switching in designed images from vidicons as described above, according to a random or prearranged musical scheme.
  • Musical audio frequencies would therefore cause images to appear over the visual area of the output screen as a function of the music itself, creating designs and color variations over a color television screen of a pleasing and interesting nature.
  • Another important variation of my invention replaces the television output with a microscopic laser or electron scanning system for the purpose of scoring, burning, etching or brasing or otherwise influencing areas or objects down to microscopic dimensions.
  • the paintpulse in this etching system for microscopic dimensions is generated by the means outlined above, but it also can be derived from a system identical to that of the Harper invention mentioned above, which is a video-drawing system; or as described in the Hendrick patent, which is a telautographic system.
  • the paintpulse output from clipper 11 controls the beam by deflecting it on and off the axis of the electron microscope column with electrostatic deflection plates.
  • the scanning rate of the microscope is synced to the sync generator 22, and blanking is derived from the same source.
  • the laser beam is blocked by a modulating cell to which the video signal containing the potential paintpulses from clipper 11 are applied.
  • the modulator is a Pockels Cell, Kerr Cell or the like, also conventional to the laser art, that is capable of responding to pulse signal inputs.
  • the surface or microscopic object to be influenced by this laser beam is also televised by conventional techniques for observation purposes.
  • a.real-time television drawing system comprismg means to scan over a given area in synchronism with a television timing signal
  • means including a display system synchronized to said television timing signals responsive to the electrical signals, for producing at points corresponding to said image points the pattern selected during the time of each produced image points.
  • said means for superimposing said voltages on said scanning means includes a manually operated piano type keyboard.
  • An image producing system comprising an optical device, such as a prism, having a totally re flective surface with an internal side and an exposed outer side; means for contacting the exposed outer side of said totally reflective surface for breaking the total reflectivity thereof at every point of contact; scanning and light detecting means for illuminating and scanning and light detecting means for illuminating and scanning the internal side of said reflective surface and producing electrical output signals in response to diminution of reflected light in accordance with a pattern on said reflective surface during each complete scan of said surface;
  • an optical device such as a prism
  • output means responsive to said electrical signals for causing said energy beam to produce animage of each contacted point of said reflective surface.
  • for producing an energy beam includes a microscope wherein said scanning beam physically changes points within the microscopic area.

Abstract

This invention enables a person to paint or draw directly into color television. No special probe or stylus is required since a person can use brushes or pens, fingertips, rubber stamps, or any drawing or painting object whatsoever. At the same time, a person can play his free hand over a piano-like keyboard to synthesize images by manipulating or altering the images or forms as they are introduced. It is applicable to graphic productions of all sorts, computer input-output graphic processing systems, for visualizing mathematical transformations, or for use with scanning lasers or electron microscopes that etch or score.

Description

United States Patent 1191 Mueller Nov. 5, 1974 1 DIRECT TELEVISION DRAWING AND 3,340,401 9/1967 Young 340/365 P IMAGE MANIPULATING SYSTEM 3,539,717 H/1970 3,651,509 3/1972 [76] Inventor: Robert E. Mueller, Britton House, 3,753,712 9/1973 Roosevelt, NJ. 08558 [22] Filed; Jan, 15, 1973 Primary ExaminerRichard Murray [21] Appl. No.2 323,874 57 ABSTRA T Related US. Application Data C [63] Continuation-impart of Ser. No. 171,155 Aug. 12 Thls l Person to P or draw 197], abandoned. rectly into color television. No special probe or stylus is required since a person can use brushes or pens, fin- 52 us. c1. ass/s1 P rubber Stamps or any drawing of Painting [51] Int. Cl. H04n 9/02 ject whatsoever- At the same time a Person can play 58 Field of Search l78/7.6 7.7 5.2 5.4 his free hand Over P keyboard to synthesize 178/D[G 6 7 5SE.179/1M images by manipulating or altering the images or 365 P 324 324 AD 3241 324 35 forms as they are il'ltl'OdUCCd. II iS applicable t0 graphic productions of all sorts, computer input- [56] keferences Cited output graphic processing systems, for visualizing mathematical transformations, or for use with scan- 2 I68 049 $555 ZZ IT PATENTS 178/20 ning lasers or electron microscopes that etch or score.
e it .Q 2,734,100 2/1956 Kendall 179/1 M 11 Claims, 4 Drawing Figures DIRECT TELEVISION DRAWING AND IMAGE MANIPULATING SYSTEM This application is a continuation-in-part of US. application Ser. No. 171,155 filed Aug. 12, 1971, now abandoned.
BACKGROUND Ever since television was invented artists and designers have been trying to discover exactly what qualities are unique to it as an artistic medium. Recent experimentalists have begun to create images directly in the video medium by electronic circuit manipulation. My invention is a first step toward channelling video image manipulation, allowing a person the necessary freedom of control to keep the human imagination in a free interaction with the medium as unrestrained as possible. It eliminates the need for special styluses or probes, and allows an artist or designer to use the most subtle of his tools directly: the paint brush or a fine steel penpoint. Thus a person can draw or paint directly into the medium of color television in full color without the use of pigments, dyes or inks.
The invention operates when a person places any type of a drawing or painting instrument on a special paintscreen. Marks appear on the color television monitor at points or areas corresponding to the shape of the drawing object tip. One by one, as they are introduced by hand, these marks are made any desired color by controls. The marks can remain where they are placed for a short or a long time, or they can be made to disappear electronically. Color mixing between successively placed forms is either additive or subtractive, or the new color can dominate the old, accomplished electronically and under control of the persons free hand.
Further, the invention enables a person to exert a wide range of automatic visual controls to synthesize images from those actually drawn. For example, by switching on a circuit when a key is pressed it is possible to cause instant size changes in all images drawn in. Other systems allow a person to create the letters of the alphabet, so that he can set them down into the television screen, in any desired color, and move them about at will until he has composed his image.
The versatility of this new medium will obviously make it an important artistic medium for commercial or fine art applications. The results of using this invention can be experienced by looking at the color television monitor at the same moment images are made, or they can be broadcast live over a television station. The pictures can also be recorded on video tape or moving picture film for later viewing. The painting can also be a collaborative effort in which two or more of the instruments are connected together electronically. My invention is in fact a device that turns the visual arts into performing arts so that duets or trios, or even orchestras of visual productions, are possible.
It is clear that my invention has four main areas of application. First, as mentioned above, it is an extremely useful tool for art studios or creative artists, for making pictures for advertising or other printed media, or making animated motion pictures. When used for film animation, background scenes or previously drawn pictures can be applied from conventional television inputs, appearing under the drawn images on the output monitor.
Secondly, the invention serves as a new computer input device, having certain abilities to pre-process forms so that less analysis will be required by the computer, simplifying the problems of pattern recognition and assimilation by the computer.
Third, the invention leads to a simple way for mathematicians to visualize and experiment with electronic symbols, or symbols that immediately manifest mathematical properties such as visual transformations, as for example in transformations that occur when passing from the real to the complex number plane.
Fourth, the output of the invention can be used to control a scanning laser or microscope system employing scanning electrons, for the purposes of etching or burning, allowing a person to perform delicate manual burning or scoring over areas, even down to microscopic dimensions.
Other objects will become obvious as the details of my invention are described. For example, the images can be created by means of musical notes, filtered from an audio circuit and made to activate the manipulating circuits automatically. Various types of image synthesis can also be achieved by differing circuit arrangements, using various types of feedback, for example. Depth can be simulated by causing successively memorized images to be of differing sizes. Depth can also be created by doubling the circuits, providing a means to draw in a volume, and providing dual monitors with appropriate optical systems that allow the right and left eyes to differentiate the images created.
The resolution or detail of all images created in the invention can be made as sharp as desired since it is a closed-circuit color television system. If it is desired to convert the output into standard interlaced 525-line images, they can be derived from a scan converter connected to the output system, or by imaging the visual output directly with a studio television camera.
These are only some of the ideas and applications of my invention that come to mind, but the spirit of my idea as related in detail here naturally include many more.
BRIEF DESCRIPTION OF THE DRAWINGS Other objectives will be apparent from the following detailed description of a preferred embodiment of my invention, taken in conjunction with the accompanying drawings. In the drawings:
FIG. I shows the optical system whereby handplaced marks on a prism cause an interruption of a flying-spot scanner raster image and create a paintpulse gating signal.
FIG. 2 shows a block diagram of a system for utilizing the paintpulse gating signal to introduce and retain any arbitrary color on the screen of a closed-circuit color television system.
FIG. 3 indicates the system whereby movements or distortions can be introduced into the raster to affect the final image.
FIG. 4 shows the details of a key on a piano-type keyboard used to activate and control manipulative image changes through a potentiometer and microswitch arrangement.
DESCRIPTION OF ONE EMBODIMENT Painting or Drawing in Color Television There are many ways to convert a manual movement into an electronic signal suitable for use with a television system to uniquely establish points over the picture area. Most conventional systems use a special probe that a person places onto a television screen, either a probe that detects a position signal from the television raster light itself, as in U.S. Pat. No. 3,271,515 by T. P. Harper, or a probe that causes a position signal to be generated from an overlay or a deformable surface placed over the television screen, as in U.S. Pat. No. 2,227,083 by E. Hendrick. In general a probe has two major disadvantages: it has an inflexible point without variety, and it defines only single points at a time. This limits its usefulness as a source of manual graphic inputs for visual ideas of the complexity required for art productions.
My system, however, enables an artist to use conventional brushes or pens for painting or drawing into color television signals. He can also use his fingers, any type of rubber or plastic form or design, like a rubber stamp, or any stylus whatsoever, which he touches to a special draw or paintscreen, that is one surface of a polished glass or plastic prism or the like. A single stylus can produce a wide variety of line qualities, as for example when its tip is flat so that it can be turned by hand as it is moved, like a flat pen point turned to draw both thick and thin lines. Or if a brush is used, it can cause a very tinydot or line when only the tip is engaged, or a very broad line when it is pressed down. In addition, every point touched on the draw or paintscreen is introduced, so that multiple tipped styluses can introduce large shapes, or rubber stamp-like shapes can introduce symbols or letters, instantly positioned by hand anywhere on the paintscreen and therefore on the output area.
FIG. 1 shows the optical system for causing handintroduced marks to generate a paintpulse gating signal. The raster l of a flying-spot cathode ray tube (CRT) 2, whose sweep is derived from a standard set of vertical and horizontal deflection generators of any line definition desired, is focussed by means of lens 3 through wedge 4 onto the internal totally-reflective undersurface of prism 5. The principal focus of the lens is indicated in the figure by the dashed lines ab to cd, of which only the side portion ae is used. The wedge 4 compensates for the prism refraction in order to bring the entire raster 1 into sharp focus and undistorted at the internal totally reflective surface of prism 5. Normally the entire light from raster 1 is reflected through the prism 5 to condensing lense 6, which gathers all the light and passes it to photo multiplier 7. When some object, like a hand-held brush or stylus 8, touches the top surface outside the totally reflective surface, called here the paintscreen, it causes light at that point to be trapped and not reflected out. For this moment, corresponding to point A of line L in raster 1, there is no, or less signal detected by photo multiplier 7. The signal 9 will appear to dip down from white to black, corresponding to this point, as shown for that line, or for as many points in the lines that the brush or stylus 8 interrupts the raster 1 light. The pulse generated by an arbitrary point A is called the paintpulse." The prism 5 obviously must be highly polished. A slight amount of optically pure oil on the brush or stylus will aid this effeet, but there is sufficient natural oils on brushes that this is unnecessary unless a person is trying to achieve unusual painting effects, in which case he might want to charge a brush highly with water or oil and let it flow over the prism pointscreen as in water-color painting.
FIG. 2 is a block diagram showing how the paintpulse causes any desired color to be generated on the output screen of a color television system. The paintpulse is first amplified in video amp 10, and clipped in the clipper. Clipping is not necessary of course if the paintpulse is of the correct amplitude to drive the gates, as determined by the video amp. 10. Clipper 11 is a voltage-limited diode circuit. The paintpulse serves then as a gating signal to activate three gates 12, 13 and 14. They are each pentode-type keying gates, biased so that when a paintpulse signal is sent to their screen grids they will pass all signals applied to their control grids respectively. The control grids each receive signals from the color generator 15. Color generator 15 produces voltages corresponding to red, green and blue color television signals as they would be required for application directly to the control grids of a color television tri-beam CRT. Since the system is closed circuit, these signals can be dc. The signals necessary to cause white to appear on a color CRT. for example, must have the correct proportionality so that the color phosphors generate the necessary light components that add up to white, namely, equal voltages on each grid. When the three outputs from the color generator 15 maintain this relationship they will produce from black through the grays to white, depending upon their voltage amplitudes. Now if one or the other color signal voltage predominates, that color will predominate in the CRT output; and various combinations of the signals will produce all the colors in the rainbow, at all intensities and saturations, as is well known in the art. The color generator 15 generates these various voltages from a potentiometer-controlled resistive matrixing circuit which generates the R, G and B (Red, Green and Blue) signal voltages under controls 17. This matrix is arranged so that a single control element can be used to introduce the necessary voltage combinations to result in any desired color hue in the output tube. This embodiment of my invention does not require the generation and control of the NTSC composite color television signal since it is closed circuit. If it is desired to use this signal, color gen 15 is a colorizer or color encoder, and the remaining output circuits are designed to operate from this signal, as in a standard color television receiver. The color controls of color gen 15 can be hand set; they can be attached to the piano-like keyboard described below; or they can be mounted on the stylus or brush 8 so that a person can control the color as he paints. The three gates for red 12, green 13 and blue 14 are triggered only when a paintpulse is sent from clipper 11. When they are triggered, they pass the various components of the color signals from color gen 15, set by the controls 17, to three double-ended storage tubes 18, 19 and 20. The signals at this pont are now video signals due to the paintpulse gating actions through the gates, and they are stored by means of the write portion of the storage tubes, deflected across their internal storage surface by the horizontal and vertical deflection portions of scan gen 21, synchronized to the raster 1 of the original flying-spot scanner CRT 2. The various levels of the color signals establish various levels of charge across the storage surface of the storage tubes 18, 19 and 20. This storage is necessary to preserve various signals as the person paints in images across the paintscreen. The read sections of the storage tubes,
also deflected by scan gen 21, detects the various levels of charge across the storage surface, and passes them from a collector element to the color control grids of the color CRT 16. The sweep circuits of the color CRT 16 are also controlled by the scan gen 21. synced to raster 1 through sync 22 in FIG. 3. Blanking signals for the color CRT 16 are generated in 43, also in sync with raster 1.
Therefore, in sum, when a person sets a brush or stylus 8 on the paintscreen of prism 5, he interrupts the raster light 1, causing a lack of light at this point A, which is detected by the photo multiplier 7, amplified in 10, and clipped in 11, and passed to gate in the color signals set by controls 17 in color gen 15, and passed to control the color grids of color CRT 16 through the storage tubes 18, 19 and 20, becomming visible and cumulatively disposed in the correct chosen color at the correctchosen spot corresponding to the original mark position on the visible output screen.
Other images can be introduced into the system through a conventional video resistance network matrix which accepts and combines various video inputs, without their influencing one another. The other images may be background images or other information to be combined with the newly painted inputs, or they may be the input of another similar system controlled by another or by more people. Finally, the images appearing on color CRT 16 can be photographed, or viewed by the person making the color video image. The tri-color output can be replaced by three blackand-white CRTs each therefore giving the red, green and blue images, that lend themselves to be photographed for creating the separation images required for the standard three-color printing process. The entire color output can also be replaced with a scanning laser, scanning electron, iron, X-ray or other scanning system, as described below.
Manipulative Potential This system of point-by-point painting into color television lends itself to the creation of many automatic alterations on the points as they are introduced on the paint screen. My system inherently provides two general manipulative potentials, first one caused by altering, moving or distorting the original raster ground; and second one caused when the gating system introduces information in addition to the color signals, as for instance images derived and generated by vidicon cam eras trained on real images or designs.
Raster Ground Manipulation Considering the first raster ground manipulation, it is clear that the original raster 1 must be in exact focus on the prism 5 totally reflective undersurface, which was the purpose of the correcting wedge 4; that it must not be distorted; and that its shading must be uniform; or otherwise the output signal will not be correct with respect to the drawing or painting laid down. on the paintsurface. This fact can be exploited to cause variations. For example, size variations in the raster 1 will be reflected as size changes in the output. If the raster 1 is made very small with respect to the paint surface of the prism, all movements of the brush or stylus will be written large in the output since small hand movements will encompass the small raster area very easily. And vice versa, if the raster 1 is made to overscan the paint surface, and only a small portion of it covers the paintscreen, all movements of the brush or stylus will only intersect a small portion of the raster, and all movemerits will appear as very small movements in the output since only that portion of the raster scan under the paint surface will be affected by the stylus or brush movements.
FIG. 3 shows how the various control elements of the vertical 23 and horizontal 24 deflection generators that generate raster 1 on CRT 2, can be brought out and controlled by a piane-type keyboard 25. The purpose of this piano of typewriter-like control 25 is to create a versatile and subtle means whereby a person can, with skill and training, be able to synthesize a broad variety of abstract or realistic designs or images everywhere that the painting stylus or brush is placed. The effects of three controls in the vertical circuits and three controls in the horizontal circuits, or six keys on 25, are illustrated in this embodiment of my invention. It is to be understood that the raster can also be altered, distorted, moved or otherwise controlled by means of anaspherical, anamorphic or other types of lenses or mirror systems. The raster can also be computer controlled to create many very complex variations in its geometry and image synthesizing abilities. It can also be controlled by electronic circuits to create symbols, simply by causing it to be moved about in toto by signals that form these symbols and are applied to the centering voltages of the CRT 2, under keyboard or other control. Additionally, the raster can be variously blanked, defocussed or othewise radically altered, as for example if it is turned into a spiral sweep, and so on, all having predetermined effects on the output image and the manner in which the system will break up or distort any drawing or painting laid down by hand point-by-point, but only so long as any particular image manipulating circuit is turned on. The raster can also be distorted or wiggled or moved electronically or optically with acoustical, mechanical-optical or the like systems.
Before describing each of the manipulative functions in this embodiment of my invention it must be understood that they are activated and varied by means of individual keys on a piano keyboard 25 or typewriter-like keyboard not shown. FIG. 4 shows the keys, highlighting the detailed operation of one. The key 26 is pivoted near its rear at 27. An extension of spring metal 28 is engaged with microswitch 29 such that the slightest touch of a finger of hand 30 onto the key will activate it and switch in the appropriate circuit action. At the same time, movement of key 26 will slightly rotate cam 31, and cause it to turn potentiometer 32 by means of the gear surfaces on 31 and 33. Potentiometer 32 is the control element in the same circuit switched on by microswitch 29. Thus a persons touch will activate a circuit and finger pressure will vary its magnitude, springing back off when the finger is lifted. Symbolic representation of this system, its key, microswitch and potentiometer, are shown at 34, 35 and 36 respectively. When no keys are activated, the system operates in the normal, undistorted or unaltered raster position, as described above.
Returning to FIG. 3, the vertical deflection generator, vert def gen 23, is a sawtooth relaxation oscillator, and the horizontal deflection generator, horiz def gen 24, is a flyback-type oscillator, generating a current sawtooth in the deflection yoke of CRT 2. The linearity, height or width, and centering resistive controls of these two circuits are brought out as shown (numbers 37 through 42.) Each of these controls are shunted with six of the variable potentiometer-switch key controls on keyboard 25. The following effects are therefore introduced, and magnitude controlled, as each key is depressed:
Vertical Linearity 37: affects length of small vertical lines, altering the length as they appear in the output, as a function of where they are drawn on the paintscreen along the vertical axis.
Horizontal Linearity 40: same affect as above, only in the horizontal direction.
Vertical Size 38: distorts the vertical size of all lines or shapes drawn on the paintscreen, distorting them along the vertical axis.
Horizontal Size 44: same affect as above, only in the horizontal direction.
Vertical Centering 39: affects position of all points introduced, changing where they will appear along the vertical axis of the output screen.
Horizontal Centering 42: same effect as above, only in the horizontal direction.
In general the system shown in FIG. 3 enables a person to play one hand over the keyboard and manipulate dot-by-dot, or point-by-point, as he draws or paints with his free hand. While the particular manipulations are limited, the potential exists for introducing very comprehensive alterations in the points as they are introduced. It is obvious that a systematic organization of potential manipulations must be made, perhaps under the control of a plug-board type switching system for various different types of image-handling problems.
This system can also cause non-linear coordinate transformations between differing geomemtries of sweep. If, for example, the raster 1 is shifted completely from a rectangular coordinate system to a spiral sweep, and the output monitor maintains a conventional sweep scan, very drastic alterations will occur in all the geometries hand-drawn on the paintscreen, as viewed in the output monitor. In a spiral scan system, the geometric relationships of the scans of raster l and CRT 16 raster, must be such that they begin to scan their respective areas from a given point, generating lines and circles with a consistent relationship, and terminate in synchronism at another given point. Both rasters must be initiated in synchronism, and as the spiral raster is traced out, by a deflection system conventional to the radar art, it must turn one loop of its circle per line of the output raster, terminating at the center when the rectangular raster terminates at its end. All drawn images will therefore be transformed into a distorted, circular image, immediately visible as it is drawn, In another arrangement the invention can be used to manifest visually the discontinuities that occur when complex variables are graphed. If, for example, the paintscreen raster l is overlapped by reflecting it off a broken mirror before it is focussed from 3 to the wedge 4, introducing a discontinuity along a discrete line in the original paintscreen area, when a person draws across this line domain as reflected across the paint surface, the discontinuity will occur as a jump in the output at the same line domain. Discontinuities can also be introduced into the raster l by means of a computer, automatically predistorting it according to any given complex equation, such that any hand-drawn image geometry will be visualized immediately on the output screen in the act of the drawing. The invention therefore becomes a potential adjunct for a mathematician desiring an instantaneous view of transformations of given hand-drawn geometries or shapes transformed from one coordinate system to another. Paintpulse Gating Manipulation In FIG. 2, the gates are turned on in time corresponding to points within the raster l timing, according to where stylus or brush 8 is positioned, generating the paintpulse. If the paintpulse is used to activate signals coming from other sources, those signals will be introduced into the output screen at these points. The desired signals can be derived from a series of small vidicons, whose sweeps are synchronized by the gating paintpulse, trained on a series of specific symbols or images that a person might desire to introduce into the visual output, each switched in by additional keys on keyboard 25. Thus another large body of images can be brought into play with the keyboard, placed down anywhere within the visual output by means of the stylus or brush 8 touching the paintscreen the moment that a particular key is depressed.
The above inputs provide another large group of image manipulations which, in combination with the raster ground manipulation described above, makes the invention a versatile device for graphic creation. The
multi-colored images created are all accumulated withint he storage tubes 18, 19 and 20, unless overdrawn with another images, or erased in total by turning off the storage tubes. 7
Music can be introduced by means of coupling a piano to the switching system of keyboard 25, or the switches of keyboard 25 can control the elements of a music synthesizer or electric organ.
Many variations are also possible, as for example if i the original video derived from the video amp 7 is used to influence the raster l, for example by means of deflection modulating it slightly, or by means of intensity modulating the beam of CRT 2. Thus all images will be distorted according to where the brush or stylus is located, much as if it were a magnet influencing the beam directly. In addition, the image of a given scene or drawing can be derived from a vidicon, applied to the grid of CRT 1, intensity modulating this scene on the raster 1, and with the above feedback, this scene or drawing will be distorted as the person places the brush or stylus over corresponding points, and manipulates them too if desired, allvisible on the monitor output CRT 16, and preserved in the storage tubes or not, as desired.
Another variation introduces paintpulses electronically, eliminating the prism flying-spot painting capability, these pulses being under control of keys on keyboard 25. In such a system single pulses are generated at the raster 1 frame rate in multivibrator circuits, delayed from each other so as not to introduce coincident pulses, each turned on by keys of keyboard 25. When a person plays the keyboard, and also plays circuits that activate manipulation, he can cause images to come and go at various spots across the screen, varied as desired according to the repertory of symbols or images introduced by means of the small vidicons in the system described above.
In another variation musical switching signals, derived from a source of music whose frequencies are filtered and connected to trigger switching voltages as a function of audio frequencies, as in astandard multichannel color organ, are used to turn on the 10 pulses generated above, in a predetermined order across the screen, also switching in designed images from vidicons as described above, according to a random or prearranged musical scheme. Musical audio frequencies would therefore cause images to appear over the visual area of the output screen as a function of the music itself, creating designs and color variations over a color television screen of a pleasing and interesting nature.
Another important variation of my invention replaces the television output with a microscopic laser or electron scanning system for the purpose of scoring, burning, etching or brasing or otherwise influencing areas or objects down to microscopic dimensions. The paintpulse in this etching system for microscopic dimensions is generated by the means outlined above, but it also can be derived from a system identical to that of the Harper invention mentioned above, which is a video-drawing system; or as described in the Hendrick patent, which is a telautographic system.
When the invention output is connected to a scanning electron microscope capable of generating a beam that can etch, score or burn microscope capable of generating a beam that can etch, score or burn miscroscopic objects, similar for example to that described by Braers and Hatzakis in Microcircuits by Electron Beam, in the November 1972 issue of Scientific American, the paintpulse output from clipper 11 controls the beam by deflecting it on and off the axis of the electron microscope column with electrostatic deflection plates. The scanning rate of the microscope is synced to the sync generator 22, and blanking is derived from the same source. Normally a less intense electron beam is made to impinge on the object by having only a portion of the beam in the column line from a small dc level voltage, sufficient to provide enough secondary electrons from the conventionalpickup systems of scanning electron microscopes to view the object. But when the paintpulse is activated it allows the full force of the electron beam to be aimed down the column to etch the object. This action can be activated for as many frame scans as desired to achieve the desired influence upon the microscopic point desired. Using this system, or the laser microscopic system described below, it is possible to alter or influence extremely microscopic dimensions for the purpose of performing delicate manual controls, or making alterations of objects even down to cellular or molecular levels, all under manual control and only limited by the resolution of the microscopic system used. While the scanning electron system is extremely delicate, a laser scanning system could do less diminutive work. In the laser beam output imaging system the laser beam is deflected across a large surface, or through a microscope, to a small area, by means of electrooptical or acoustical-optical deflectors and rotating mirrors, conventional to the laser art. See for example U.S. Pat. No. 3,488,102 by Buck et al., or US. Pat. No. 3,492,596 by Vorie, plus their cited references. Normally, in this application, the laser beam is blocked by a modulating cell to which the video signal containing the potential paintpulses from clipper 11 are applied. The modulator is a Pockels Cell, Kerr Cell or the like, also conventional to the laser art, that is capable of responding to pulse signal inputs. The surface or microscopic object to be influenced by this laser beam is also televised by conventional techniques for observation purposes. When a person places the hand-held stylus on the paint surface, it sends a signal through the amplifier and clipper 11 to operate the modulator, momentarily allowing the laser beam to send its full force against the hand-chosen point on the object or surface to be etched or burned.
While these systems and various methods for drawing point-by-point, and painting into color television, and 5, manipulating the points and images created, and introduce various other types of designed images into a color output, or down to a microscopic dimension for purposes of etching or burning, represent a complete operational system, it should be apparent to anyone familiar with the art that the various elements and steps may be changed or altered, or completely supplanted by the use or substitution of other elements or arrangements of the components without departing from the spirit and scope of my invention. Accordingly, my invention should be considered to include any or all such modifications, variations and alternative forms that fall within the scope of the appended claims.
What I claim is:
1. In a.real-time television drawing system comprismg means to scan over a given area in synchronism with a television timing signal;
means to produce a plurality of image points within said given area;
means to produce electrical signals in response to said image points;
means for generating a plurality of voltages capable of changing said scan in toto according to various patterns;
means for superimposing said voltages selectively on said scanning means;
means including a display system synchronized to said television timing signals responsive to the electrical signals, for producing at points corresponding to said image points the pattern selected during the time of each produced image points.
2. A system according to claim 1,
wherein said means for superimposing said voltages on said scanning means includes a manually operated piano type keyboard.
3. A system according to claim 2 wherein the keys of said keyboard vary the magnitude of the voltages proportionately to the pressure applied to the keys.
4. A system according to claim 3 wherein said keyboard actuates a sound producing instrument.
5. A system according to claim 1 wherein said display system includes a color television display device, and means for supply color television signals to said display device in response to said electrical signals.
6. A system according to claim 1, including:
means for recording siad electrical signals;
means for adjustably modifying selected characteristics of recorded signals with respect to previously recorded signals; and
means for accumulating said signals within at least one television frame-time sequence.
7. An image producing system, comprising an optical device, such as a prism, having a totally re flective surface with an internal side and an exposed outer side; means for contacting the exposed outer side of said totally reflective surface for breaking the total reflectivity thereof at every point of contact; scanning and light detecting means for illuminating and scanning and light detecting means for illuminating and scanning the internal side of said reflective surface and producing electrical output signals in response to diminution of reflected light in accordance with a pattern on said reflective surface during each complete scan of said surface;
means for producing an energy beam and causing it to scan in synchronism with the scanning of the reflective surface; and
output means responsive to said electrical signals for causing said energy beam to produce animage of each contacted point of said reflective surface.
8. A system according to claim 7, wherein said means 9. A system according to claim 7, wherein said last mentioned means includes apparatus for producing a color television image.
10. A system according to claim 7;
means to generate a plurality of television signals which represent specific images;
means responsive to said electical signals that synchronize said television signals;
means to introduce said television signals into said output means at points corresponding to said contact points.
for producing an energy beam includes a microscope wherein said scanning beam physically changes points within the microscopic area.
11. in a real-time television drawing system comprising;
means to cause a narrow beam of light to scan over a given area in synchronism with television timing signals;
an optical device having a totally reflective surface;
time of each contact.

Claims (11)

1. In a real-time television drawing system comprising means to scan over a given area in synchronism with a television timing signal; means to produce a plurality of image points within said given area; means to produce electrical signals in response to said image points; means for generating a plurality of voltages capable of changing said scan in toto according to various patterns; means for superimposing said voltages selectively on said scanning means; means including a display system synchronized to said television timing signals responsive to the electrical signals, for producing at points corresponding to said image points the pattern selected during the time of each produced image points.
2. A system according to claim 1, wherein said means for superimposing said voltages on said scanning means includes a manually operated piano type keyboard.
3. A system according to claim 2 wherein the keys of said keyboard vary the magnitude of the voltages proportionately to the pressure applied to the keys.
4. A system according to claim 3 wherein said keyboard actuates a sound producing instrument.
5. A system according to claim 1 wherein said display system includes a color television display device, and means for supply color television signals to said display device in response to said electrical signals.
6. A system according to claim 1, including: means for recording siad electrical signals; means for adjustably modifying selected characteristics of recorded signals with respect to previously recorded signals; and means for accumulating said signals within at least one television frame-time sequence.
7. An image producing system, comprising an optical device, such as a prism, having a totally reflective surface with an internal side and an exposed outer side; means for contacting the exposed outer side of said totally reflective surface for breaking the total reflectivity thereof at every point of contact; scanning and light detecting means for illuminating and scanning and light detecting means for illuminating and scanning the internal side of said reflective surface and producing electrical output signals in response to diminution of reflected light in accordance with a pattern on said reflective surface during each complete scan of said surface; means for producing an energy beam and causing it to scan in synchronism with the scanning of the reflective surface; and outpUt means responsive to said electrical signals for causing said energy beam to produce an image of each contacted point of said reflective surface.
8. A system according to claim 7, wherein said means for producing an energy beam includes a microscope wherein said scanning beam physically changes points within the microscopic area.
9. A system according to claim 7, wherein said last mentioned means includes apparatus for producing a color television image.
10. A system according to claim 7; means to generate a plurality of television signals which represent specific images; means responsive to said electical signals that synchronize said television signals; means to introduce said television signals into said output means at points corresponding to said contact points.
11. In a real-time television drawing system comprising; means to cause a narrow beam of light to scan over a given area in synchronism with television timing signals; an optical device having a totally reflective surface; means to focus said given area of scanned light on one side of said surface; means for generating a plurality of voltages capable of changing said scan in toto according to various patterns; means for superimposing said voltages selectively on said scanning means; means to contact a plurality of points on one side of said surface; means to produce electrical signals in response to said contact points; means including a display system synchronized to said television timing signals responsive to the electrical signals for producing at points corresponding to said contacts the pattern selected during the time of each contact.
US00323874A 1971-08-12 1973-01-15 Direct television drawing and image manipulating system Expired - Lifetime US3846826A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US00323874A US3846826A (en) 1971-08-12 1973-01-15 Direct television drawing and image manipulating system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US17115571A 1971-08-12 1971-08-12
US00323874A US3846826A (en) 1971-08-12 1973-01-15 Direct television drawing and image manipulating system

Publications (1)

Publication Number Publication Date
US3846826A true US3846826A (en) 1974-11-05

Family

ID=26866789

Family Applications (1)

Application Number Title Priority Date Filing Date
US00323874A Expired - Lifetime US3846826A (en) 1971-08-12 1973-01-15 Direct television drawing and image manipulating system

Country Status (1)

Country Link
US (1) US3846826A (en)

Cited By (82)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4025946A (en) * 1976-03-22 1977-05-24 Casey Susan D Method and apparatus for generating graphic designs
US4232311A (en) * 1979-03-20 1980-11-04 Chyron Corporation Color display apparatus
US4318096A (en) * 1980-05-19 1982-03-02 Xerox Corporation Graphics pen for soft displays
DE3114354A1 (en) * 1980-04-16 1982-06-24 Western Electric Co TOUCH-SENSITIVE DEVICE
DE3148116A1 (en) * 1980-12-04 1982-07-08 Quantel Ltd., Newbury, Berkshire VIDEO IMAGE CREATING SYSTEM AND METHOD FOR CREATING A VIDEO IMAGE APPLICABLE TO THIS
US4346376A (en) * 1980-04-16 1982-08-24 Bell Telephone Laboratories, Incorporated Touch position sensitive surface
US4355805A (en) * 1977-09-30 1982-10-26 Sanders Associates, Inc. Manually programmable video gaming system
US4371893A (en) * 1979-09-11 1983-02-01 Rabeisen Andre J Video communication system allowing graphic additions to the images communicated
FR2523332A1 (en) * 1982-03-11 1983-09-16 Quantel Ltd SYSTEM AND METHOD FOR CREATING ELECTRONICALLY SYNTHETIZED PALLET IMAGES
US4484179A (en) * 1980-04-16 1984-11-20 At&T Bell Laboratories Touch position sensitive surface
US4499457A (en) * 1978-10-05 1985-02-12 Evans & Sutherland Computer Corp. Shadow mask color system with calligraphic displays
FR2554261A1 (en) * 1983-10-28 1985-05-03 Thomson Csf SENSITIVE DISPLAY DEVICE HAVING A SCAN SCREEN
US4542375A (en) * 1982-02-11 1985-09-17 At&T Bell Laboratories Deformable touch sensitive surface
US4561017A (en) * 1983-08-19 1985-12-24 Richard Greene Graphic input apparatus
US4621257A (en) * 1983-08-15 1986-11-04 At&T Bell Laboratories Video display touch detection digitizer
US4663616A (en) * 1985-06-25 1987-05-05 International Business Machines Corp. Attachment of lines to objects in interactive draw graphics
US4683468A (en) * 1985-03-11 1987-07-28 International Business Machines Corp. Method for manipulation of graphic sub-objects in an interactive draw graphic system
US4694286A (en) * 1983-04-08 1987-09-15 Tektronix, Inc. Apparatus and method for modifying displayed color images
US4751503A (en) * 1984-12-24 1988-06-14 Xerox Corporation Image processing method with improved digital airbrush touch up
US4789855A (en) * 1984-10-11 1988-12-06 Hitachi, Ltd. Device for editing document in colors
US4843568A (en) * 1986-04-11 1989-06-27 Krueger Myron W Real time perception of and response to the actions of an unencumbered participant/user
US5131056A (en) * 1990-01-23 1992-07-14 Crosfield Electronics Limited Electronic airbrushing
US5181108A (en) * 1991-10-07 1993-01-19 Greene Richard M Graphic input device with uniform sensitivity and no keystone distortion
US5216755A (en) * 1980-12-04 1993-06-01 Quantel Limited Video image creation system which proportionally mixes previously created image pixel data with currently created data
US5459529A (en) * 1983-01-10 1995-10-17 Quantel, Ltd. Video processing for composite images
US5484288A (en) * 1994-03-25 1996-01-16 Delgigante; Michael Apparatus for teaching inscription of characters
US5619253A (en) * 1993-06-25 1997-04-08 Miranda, Jr.; Henry A. Video display of indicia
US5767843A (en) * 1993-10-30 1998-06-16 Daimler-Benz Aerospace Ag Manually controlled imput device for a computer
US6008800A (en) * 1992-09-18 1999-12-28 Pryor; Timothy R. Man machine interfaces for entering data into a computer
US6012980A (en) * 1995-12-01 2000-01-11 Kabushiki Kaisha Sega Enterprises Coordinates detecting device, method for same and game device
US6061177A (en) * 1996-12-19 2000-05-09 Fujimoto; Kenneth Noboru Integrated computer display and graphical input apparatus and method
US20030001818A1 (en) * 2000-12-27 2003-01-02 Masaji Katagiri Handwritten data input device and method, and authenticating device and method
US20030122733A1 (en) * 2000-06-15 2003-07-03 Blackham Geoffrey Howard Apparatus using framestore demultiplexing
US20040074376A1 (en) * 2000-04-06 2004-04-22 Rainbow Music Corporation System for playing music having multi-colored musical notation and instruments
US6750848B1 (en) 1998-11-09 2004-06-15 Timothy R. Pryor More useful man machine interfaces and applications
US20050174337A1 (en) * 2004-02-11 2005-08-11 Nielsen Paul S. Electronic handheld drawing and gaming system using television monitor
US20060109266A1 (en) * 2004-06-29 2006-05-25 Sensable Technologies, Inc. Apparatus and methods for haptic rendering using data in a graphics pipeline
US7098891B1 (en) * 1992-09-18 2006-08-29 Pryor Timothy R Method for providing human input to a computer
US20060202953A1 (en) * 1997-08-22 2006-09-14 Pryor Timothy R Novel man machine interfaces and applications
US20080029691A1 (en) * 2006-08-03 2008-02-07 Han Jefferson Y Multi-touch sensing display through frustrated total internal reflection
US20080088620A1 (en) * 1998-07-17 2008-04-17 Sensable Technologies, Inc. Systems and methods for sculpting virtual objects in a haptic virtual reality environment
US20080122799A1 (en) * 2001-02-22 2008-05-29 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
US20080180405A1 (en) * 2007-01-31 2008-07-31 Han Jefferson Y Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US20080212035A1 (en) * 2006-12-12 2008-09-04 Christensen Robert R System and method for aligning RGB light in a single modulator projector
US20080218514A1 (en) * 1996-08-02 2008-09-11 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with a haptic virtual reality environment
US20080259988A1 (en) * 2007-01-19 2008-10-23 Evans & Sutherland Computer Corporation Optical actuator with improved response time and method of making the same
US20080284925A1 (en) * 2006-08-03 2008-11-20 Han Jefferson Y Multi-touch sensing through frustrated total internal reflection
US20090002644A1 (en) * 2007-05-21 2009-01-01 Evans & Sutherland Computer Corporation Invisible scanning safety system
US20090033637A1 (en) * 2007-07-30 2009-02-05 Han Jefferson Y Liquid multi-touch sensor and display device
US20090168186A1 (en) * 2007-09-07 2009-07-02 Forrest Williams Device and method for reducing etendue in a diode laser
US20090219491A1 (en) * 2007-10-18 2009-09-03 Evans & Sutherland Computer Corporation Method of combining multiple Gaussian beams for efficient uniform illumination of one-dimensional light modulators
US20090267921A1 (en) * 1995-06-29 2009-10-29 Pryor Timothy R Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US20090322740A1 (en) * 2008-05-23 2009-12-31 Carlson Kenneth L System and method for displaying a planar image on a curved surface
US20100177060A1 (en) * 2009-01-14 2010-07-15 Perceptive Pixel Inc. Touch-Sensitive Display
US20100182136A1 (en) * 2004-09-07 2010-07-22 Timothy Pryor Control of appliances, kitchen and home
US20100182137A1 (en) * 2002-07-03 2010-07-22 Pryor Timothy R Control systems involving novel physical controls and touch screens
US20100190610A1 (en) * 2000-03-07 2010-07-29 Pryor Timothy R Camera based interactive exercise
US20100231547A1 (en) * 2001-02-22 2010-09-16 Pryor Timothy R Reconfigurable tactile control display applications
US20100302185A1 (en) * 2009-06-01 2010-12-02 Perceptive Pixel Inc. Touch Sensing
US20100302196A1 (en) * 2009-06-01 2010-12-02 Perceptive Pixel Inc. Touch Sensing
US20100302210A1 (en) * 2009-06-01 2010-12-02 Han Jefferson Y Touch Sensing
US7864173B2 (en) * 1998-07-17 2011-01-04 Sensable Technologies, Inc. Systems and methods for creating virtual objects in a sketch mode in a haptic virtual reality environment
US8077147B2 (en) 2005-12-30 2011-12-13 Apple Inc. Mouse with optical sensing surface
US8077378B1 (en) 2008-11-12 2011-12-13 Evans & Sutherland Computer Corporation Calibration system and method for light modulation device
US8228305B2 (en) 1995-06-29 2012-07-24 Apple Inc. Method for providing human input to a computer
US8239784B2 (en) 2004-07-30 2012-08-07 Apple Inc. Mode-based graphical user interfaces for touch sensitive input devices
US8289316B1 (en) 2009-04-01 2012-10-16 Perceptive Pixel Inc. Controlling distribution of error in 2D and 3D manipulation
US8306635B2 (en) 2001-03-07 2012-11-06 Motion Games, Llc Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction
US8314773B2 (en) 2002-09-09 2012-11-20 Apple Inc. Mouse having an optically-based scrolling feature
US8381135B2 (en) 2004-07-30 2013-02-19 Apple Inc. Proximity detector in handheld device
US8482535B2 (en) 1999-11-08 2013-07-09 Apple Inc. Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US8576199B1 (en) 2000-02-22 2013-11-05 Apple Inc. Computer control systems
US8614668B2 (en) 1997-08-22 2013-12-24 Motion Games, Llc Interactive video based games using objects sensed by TV cameras
US8654198B2 (en) 1999-05-11 2014-02-18 Timothy R. Pryor Camera based interaction and instruction
US8702248B1 (en) 2008-06-11 2014-04-22 Evans & Sutherland Computer Corporation Projection method for reducing interpixel gaps on a viewing surface
USRE45559E1 (en) 1997-10-28 2015-06-09 Apple Inc. Portable computers
US9239677B2 (en) 2004-05-06 2016-01-19 Apple Inc. Operation of a computer with touch screen interface
US9239673B2 (en) 1998-01-26 2016-01-19 Apple Inc. Gesturing with a multipoint sensing device
US9292111B2 (en) 1998-01-26 2016-03-22 Apple Inc. Gesturing with a multipoint sensing device
US9448712B2 (en) 2007-01-07 2016-09-20 Apple Inc. Application programming interfaces for scrolling operations
US9641826B1 (en) 2011-10-06 2017-05-02 Evans & Sutherland Computer Corporation System and method for displaying distant 3-D stereo on a dome surface
US10643491B2 (en) 2017-03-14 2020-05-05 Matthew CHELEL Process, system and method for step-by-step painting of an image on a transparent surface

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2168049A (en) * 1936-12-24 1939-08-01 Bell Telephone Labor Inc Electro-optical system
US2734100A (en) * 1956-02-07 Kendall
US3340401A (en) * 1963-12-26 1967-09-05 Xerox Corp Motionless data input key
US3539717A (en) * 1967-09-25 1970-11-10 Texas Instruments Inc Touch control display system
US3651509A (en) * 1970-11-06 1972-03-21 Bell Telephone Labor Inc Light pen for display having inherent memory
US3758712A (en) * 1972-03-27 1973-09-11 Sarkes Tarzian Digital special effects generator

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2734100A (en) * 1956-02-07 Kendall
US2168049A (en) * 1936-12-24 1939-08-01 Bell Telephone Labor Inc Electro-optical system
US3340401A (en) * 1963-12-26 1967-09-05 Xerox Corp Motionless data input key
US3539717A (en) * 1967-09-25 1970-11-10 Texas Instruments Inc Touch control display system
US3651509A (en) * 1970-11-06 1972-03-21 Bell Telephone Labor Inc Light pen for display having inherent memory
US3758712A (en) * 1972-03-27 1973-09-11 Sarkes Tarzian Digital special effects generator

Cited By (144)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4025946A (en) * 1976-03-22 1977-05-24 Casey Susan D Method and apparatus for generating graphic designs
US4355805A (en) * 1977-09-30 1982-10-26 Sanders Associates, Inc. Manually programmable video gaming system
US4499457A (en) * 1978-10-05 1985-02-12 Evans & Sutherland Computer Corp. Shadow mask color system with calligraphic displays
US4232311A (en) * 1979-03-20 1980-11-04 Chyron Corporation Color display apparatus
US4371893A (en) * 1979-09-11 1983-02-01 Rabeisen Andre J Video communication system allowing graphic additions to the images communicated
US4484179A (en) * 1980-04-16 1984-11-20 At&T Bell Laboratories Touch position sensitive surface
DE3114354A1 (en) * 1980-04-16 1982-06-24 Western Electric Co TOUCH-SENSITIVE DEVICE
US4346376A (en) * 1980-04-16 1982-08-24 Bell Telephone Laboratories, Incorporated Touch position sensitive surface
US4318096A (en) * 1980-05-19 1982-03-02 Xerox Corporation Graphics pen for soft displays
US4633416A (en) * 1980-12-04 1986-12-30 Quantel Limited Video image creation system which simulates drafting tool
US5216755A (en) * 1980-12-04 1993-06-01 Quantel Limited Video image creation system which proportionally mixes previously created image pixel data with currently created data
US4514818A (en) * 1980-12-04 1985-04-30 Quantel Limited Video image creation system which simulates drafting tool
DE3148116A1 (en) * 1980-12-04 1982-07-08 Quantel Ltd., Newbury, Berkshire VIDEO IMAGE CREATING SYSTEM AND METHOD FOR CREATING A VIDEO IMAGE APPLICABLE TO THIS
US4542375A (en) * 1982-02-11 1985-09-17 At&T Bell Laboratories Deformable touch sensitive surface
FR2523332A1 (en) * 1982-03-11 1983-09-16 Quantel Ltd SYSTEM AND METHOD FOR CREATING ELECTRONICALLY SYNTHETIZED PALLET IMAGES
US5459529A (en) * 1983-01-10 1995-10-17 Quantel, Ltd. Video processing for composite images
US4694286A (en) * 1983-04-08 1987-09-15 Tektronix, Inc. Apparatus and method for modifying displayed color images
US4621257A (en) * 1983-08-15 1986-11-04 At&T Bell Laboratories Video display touch detection digitizer
US4561017A (en) * 1983-08-19 1985-12-24 Richard Greene Graphic input apparatus
EP0141729A3 (en) * 1983-10-28 1985-06-26 Thomson-Csf Sensitive display device involving a scanning screen
EP0141729A2 (en) * 1983-10-28 1985-05-15 Thomson-Csf Sensitive display device involving a scanning screen
FR2554261A1 (en) * 1983-10-28 1985-05-03 Thomson Csf SENSITIVE DISPLAY DEVICE HAVING A SCAN SCREEN
USRE34835E (en) * 1984-10-11 1995-01-24 Hitachi, Ltd. Method and apparatus for editing document in colors
US4789855A (en) * 1984-10-11 1988-12-06 Hitachi, Ltd. Device for editing document in colors
US4751503A (en) * 1984-12-24 1988-06-14 Xerox Corporation Image processing method with improved digital airbrush touch up
US4683468A (en) * 1985-03-11 1987-07-28 International Business Machines Corp. Method for manipulation of graphic sub-objects in an interactive draw graphic system
US4663616A (en) * 1985-06-25 1987-05-05 International Business Machines Corp. Attachment of lines to objects in interactive draw graphics
US4843568A (en) * 1986-04-11 1989-06-27 Krueger Myron W Real time perception of and response to the actions of an unencumbered participant/user
US5131056A (en) * 1990-01-23 1992-07-14 Crosfield Electronics Limited Electronic airbrushing
US5181108A (en) * 1991-10-07 1993-01-19 Greene Richard M Graphic input device with uniform sensitivity and no keystone distortion
US7098891B1 (en) * 1992-09-18 2006-08-29 Pryor Timothy R Method for providing human input to a computer
US6008800A (en) * 1992-09-18 1999-12-28 Pryor; Timothy R. Man machine interfaces for entering data into a computer
US7714849B2 (en) 1992-09-18 2010-05-11 Pryor Timothy R Control of vehicle functions
US20060267963A1 (en) * 1992-09-18 2006-11-30 Pryor Timothy R Method for providing human input to a computer
US5619253A (en) * 1993-06-25 1997-04-08 Miranda, Jr.; Henry A. Video display of indicia
US5767843A (en) * 1993-10-30 1998-06-16 Daimler-Benz Aerospace Ag Manually controlled imput device for a computer
US5484288A (en) * 1994-03-25 1996-01-16 Delgigante; Michael Apparatus for teaching inscription of characters
US9513744B2 (en) 1994-08-15 2016-12-06 Apple Inc. Control systems employing novel physical controls and touch screens
US8427449B2 (en) 1995-06-29 2013-04-23 Apple Inc. Method for providing human input to a computer
US8228305B2 (en) 1995-06-29 2012-07-24 Apple Inc. Method for providing human input to a computer
US20090267921A1 (en) * 1995-06-29 2009-10-29 Pryor Timothy R Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US9758042B2 (en) 1995-06-29 2017-09-12 Apple Inc. Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US8482534B2 (en) 1995-06-29 2013-07-09 Timothy R. Pryor Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US8610674B2 (en) 1995-06-29 2013-12-17 Apple Inc. Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US6012980A (en) * 1995-12-01 2000-01-11 Kabushiki Kaisha Sega Enterprises Coordinates detecting device, method for same and game device
US7800609B2 (en) 1996-08-02 2010-09-21 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with a haptic virtual reality environment
US20080218514A1 (en) * 1996-08-02 2008-09-11 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with a haptic virtual reality environment
US6061177A (en) * 1996-12-19 2000-05-09 Fujimoto; Kenneth Noboru Integrated computer display and graphical input apparatus and method
US20100134612A1 (en) * 1997-08-22 2010-06-03 Timothy Pryor Method for enhancing well-being of a small child or baby
US8614668B2 (en) 1997-08-22 2013-12-24 Motion Games, Llc Interactive video based games using objects sensed by TV cameras
US8405604B2 (en) 1997-08-22 2013-03-26 Motion Games, Llc Advanced video gaming methods for education and play using camera based inputs
US8111239B2 (en) 1997-08-22 2012-02-07 Motion Games, Llc Man machine interfaces and applications
US20060202953A1 (en) * 1997-08-22 2006-09-14 Pryor Timothy R Novel man machine interfaces and applications
USRE45559E1 (en) 1997-10-28 2015-06-09 Apple Inc. Portable computers
USRE46548E1 (en) 1997-10-28 2017-09-12 Apple Inc. Portable computers
US9292111B2 (en) 1998-01-26 2016-03-22 Apple Inc. Gesturing with a multipoint sensing device
US9239673B2 (en) 1998-01-26 2016-01-19 Apple Inc. Gesturing with a multipoint sensing device
US7889195B2 (en) 1998-07-17 2011-02-15 Sensable Technologies, Inc. Systems and methods for sculpting virtual objects in a haptic virtual reality environment
US7864173B2 (en) * 1998-07-17 2011-01-04 Sensable Technologies, Inc. Systems and methods for creating virtual objects in a sketch mode in a haptic virtual reality environment
US20080088620A1 (en) * 1998-07-17 2008-04-17 Sensable Technologies, Inc. Systems and methods for sculpting virtual objects in a haptic virtual reality environment
US8576222B2 (en) 1998-07-17 2013-11-05 3D Systems, Inc. Systems and methods for interfacing with a virtual object in a haptic virtual environment
US6750848B1 (en) 1998-11-09 2004-06-15 Timothy R. Pryor More useful man machine interfaces and applications
US8654198B2 (en) 1999-05-11 2014-02-18 Timothy R. Pryor Camera based interaction and instruction
US8482535B2 (en) 1999-11-08 2013-07-09 Apple Inc. Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US20110018831A1 (en) * 2000-02-22 2011-01-27 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
US8576199B1 (en) 2000-02-22 2013-11-05 Apple Inc. Computer control systems
US20110032203A1 (en) * 2000-02-22 2011-02-10 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
US20110018832A1 (en) * 2000-02-22 2011-01-27 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
US8538562B2 (en) 2000-03-07 2013-09-17 Motion Games, Llc Camera based interactive exercise
US20100190610A1 (en) * 2000-03-07 2010-07-29 Pryor Timothy R Camera based interactive exercise
US20040074376A1 (en) * 2000-04-06 2004-04-22 Rainbow Music Corporation System for playing music having multi-colored musical notation and instruments
US6831220B2 (en) 2000-04-06 2004-12-14 Rainbow Music Corporation System for playing music having multi-colored musical notation and instruments
US20030122733A1 (en) * 2000-06-15 2003-07-03 Blackham Geoffrey Howard Apparatus using framestore demultiplexing
US6947029B2 (en) * 2000-12-27 2005-09-20 Masaji Katagiri Handwritten data input device and method, and authenticating device and method
US20030001818A1 (en) * 2000-12-27 2003-01-02 Masaji Katagiri Handwritten data input device and method, and authenticating device and method
US20100231547A1 (en) * 2001-02-22 2010-09-16 Pryor Timothy R Reconfigurable tactile control display applications
US20080122799A1 (en) * 2001-02-22 2008-05-29 Pryor Timothy R Human interfaces for vehicles, homes, and other applications
US8306635B2 (en) 2001-03-07 2012-11-06 Motion Games, Llc Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction
US8892219B2 (en) 2001-03-07 2014-11-18 Motion Games, Llc Motivation and enhancement of physical and mental exercise, rehabilitation, health and social interaction
US9606668B2 (en) 2002-02-07 2017-03-28 Apple Inc. Mode-based graphical user interfaces for touch sensitive input devices
US20100182137A1 (en) * 2002-07-03 2010-07-22 Pryor Timothy R Control systems involving novel physical controls and touch screens
US20110037725A1 (en) * 2002-07-03 2011-02-17 Pryor Timothy R Control systems employing novel physical controls and touch screens
US8314773B2 (en) 2002-09-09 2012-11-20 Apple Inc. Mouse having an optically-based scrolling feature
US20050174337A1 (en) * 2004-02-11 2005-08-11 Nielsen Paul S. Electronic handheld drawing and gaming system using television monitor
US9239677B2 (en) 2004-05-06 2016-01-19 Apple Inc. Operation of a computer with touch screen interface
US20060109266A1 (en) * 2004-06-29 2006-05-25 Sensable Technologies, Inc. Apparatus and methods for haptic rendering using data in a graphics pipeline
US7990374B2 (en) 2004-06-29 2011-08-02 Sensable Technologies, Inc. Apparatus and methods for haptic rendering using data in a graphics pipeline
US9030411B2 (en) 2004-06-29 2015-05-12 3D Systems, Inc. Apparatus and methods for haptic rendering using a haptic camera view
US20060284834A1 (en) * 2004-06-29 2006-12-21 Sensable Technologies, Inc. Apparatus and methods for haptic rendering using a haptic camera view
US10042418B2 (en) 2004-07-30 2018-08-07 Apple Inc. Proximity detector in handheld device
US8239784B2 (en) 2004-07-30 2012-08-07 Apple Inc. Mode-based graphical user interfaces for touch sensitive input devices
US11036282B2 (en) 2004-07-30 2021-06-15 Apple Inc. Proximity detector in handheld device
US9348458B2 (en) 2004-07-30 2016-05-24 Apple Inc. Gestures for touch sensitive input devices
US8381135B2 (en) 2004-07-30 2013-02-19 Apple Inc. Proximity detector in handheld device
US8612856B2 (en) 2004-07-30 2013-12-17 Apple Inc. Proximity detector in handheld device
US8479122B2 (en) 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US20100182136A1 (en) * 2004-09-07 2010-07-22 Timothy Pryor Control of appliances, kitchen and home
US8077147B2 (en) 2005-12-30 2011-12-13 Apple Inc. Mouse with optical sensing surface
US20080284925A1 (en) * 2006-08-03 2008-11-20 Han Jefferson Y Multi-touch sensing through frustrated total internal reflection
US20080029691A1 (en) * 2006-08-03 2008-02-07 Han Jefferson Y Multi-touch sensing display through frustrated total internal reflection
US8259240B2 (en) 2006-08-03 2012-09-04 Perceptive Pixel Inc. Multi-touch sensing through frustrated total internal reflection
US8144271B2 (en) 2006-08-03 2012-03-27 Perceptive Pixel Inc. Multi-touch sensing through frustrated total internal reflection
US8441467B2 (en) 2006-08-03 2013-05-14 Perceptive Pixel Inc. Multi-touch sensing display through frustrated total internal reflection
US20080179507A2 (en) * 2006-08-03 2008-07-31 Han Jefferson Multi-touch sensing through frustrated total internal reflection
US7891818B2 (en) 2006-12-12 2011-02-22 Evans & Sutherland Computer Corporation System and method for aligning RGB light in a single modulator projector
US20080212035A1 (en) * 2006-12-12 2008-09-04 Christensen Robert R System and method for aligning RGB light in a single modulator projector
US10817162B2 (en) 2007-01-07 2020-10-27 Apple Inc. Application programming interfaces for scrolling operations
US10481785B2 (en) 2007-01-07 2019-11-19 Apple Inc. Application programming interfaces for scrolling operations
US9760272B2 (en) 2007-01-07 2017-09-12 Apple Inc. Application programming interfaces for scrolling operations
US9448712B2 (en) 2007-01-07 2016-09-20 Apple Inc. Application programming interfaces for scrolling operations
US20080259988A1 (en) * 2007-01-19 2008-10-23 Evans & Sutherland Computer Corporation Optical actuator with improved response time and method of making the same
US20080180406A1 (en) * 2007-01-31 2008-07-31 Han Jefferson Y Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US8674948B2 (en) 2007-01-31 2014-03-18 Perceptive Pixel, Inc. Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US8269729B2 (en) 2007-01-31 2012-09-18 Perceptive Pixel Inc. Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US8368653B2 (en) 2007-01-31 2013-02-05 Perceptive Pixel, Inc. Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US20080180405A1 (en) * 2007-01-31 2008-07-31 Han Jefferson Y Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US20080180404A1 (en) * 2007-01-31 2008-07-31 Han Jefferson Y Methods of interfacing with multi-point input devices and multi-point input systems employing interfacing techniques
US20090002644A1 (en) * 2007-05-21 2009-01-01 Evans & Sutherland Computer Corporation Invisible scanning safety system
US8125468B2 (en) 2007-07-30 2012-02-28 Perceptive Pixel Inc. Liquid multi-touch sensor and display device
US20090033637A1 (en) * 2007-07-30 2009-02-05 Han Jefferson Y Liquid multi-touch sensor and display device
US20090168186A1 (en) * 2007-09-07 2009-07-02 Forrest Williams Device and method for reducing etendue in a diode laser
US20090219491A1 (en) * 2007-10-18 2009-09-03 Evans & Sutherland Computer Corporation Method of combining multiple Gaussian beams for efficient uniform illumination of one-dimensional light modulators
US8358317B2 (en) 2008-05-23 2013-01-22 Evans & Sutherland Computer Corporation System and method for displaying a planar image on a curved surface
US20090322740A1 (en) * 2008-05-23 2009-12-31 Carlson Kenneth L System and method for displaying a planar image on a curved surface
US8702248B1 (en) 2008-06-11 2014-04-22 Evans & Sutherland Computer Corporation Projection method for reducing interpixel gaps on a viewing surface
US8077378B1 (en) 2008-11-12 2011-12-13 Evans & Sutherland Computer Corporation Calibration system and method for light modulation device
US20100177060A1 (en) * 2009-01-14 2010-07-15 Perceptive Pixel Inc. Touch-Sensitive Display
US8451268B1 (en) 2009-04-01 2013-05-28 Perceptive Pixel Inc. Screen-space formulation to facilitate manipulations of 2D and 3D structures through interactions relating to 2D manifestations of those structures
US8289316B1 (en) 2009-04-01 2012-10-16 Perceptive Pixel Inc. Controlling distribution of error in 2D and 3D manipulation
US8456466B1 (en) 2009-04-01 2013-06-04 Perceptive Pixel Inc. Resolving ambiguous rotations in 3D manipulation
US8654104B2 (en) 2009-04-01 2014-02-18 Perceptive Pixel Inc. 3D manipulation using applied pressure
US9041679B2 (en) 2009-04-01 2015-05-26 Perceptive Pixel, Inc. 3D manipulation using applied pressure
US8325181B1 (en) 2009-04-01 2012-12-04 Perceptive Pixel Inc. Constraining motion in 2D and 3D manipulation
US8493384B1 (en) 2009-04-01 2013-07-23 Perceptive Pixel Inc. 3D manipulation using applied pressure
US8462148B1 (en) 2009-04-01 2013-06-11 Perceptive Pixel Inc. Addressing rotational exhaustion in 3D manipulation
US20100302210A1 (en) * 2009-06-01 2010-12-02 Han Jefferson Y Touch Sensing
US20100302185A1 (en) * 2009-06-01 2010-12-02 Perceptive Pixel Inc. Touch Sensing
US8624853B2 (en) 2009-06-01 2014-01-07 Perceptive Pixel Inc. Structure-augmented touch sensing with frustated total internal reflection
US9323396B2 (en) 2009-06-01 2016-04-26 Perceptive Pixel, Inc. Touch sensing
US8736581B2 (en) 2009-06-01 2014-05-27 Perceptive Pixel Inc. Touch sensing with frustrated total internal reflection
US20100302196A1 (en) * 2009-06-01 2010-12-02 Perceptive Pixel Inc. Touch Sensing
US9641826B1 (en) 2011-10-06 2017-05-02 Evans & Sutherland Computer Corporation System and method for displaying distant 3-D stereo on a dome surface
US10110876B1 (en) 2011-10-06 2018-10-23 Evans & Sutherland Computer Corporation System and method for displaying images in 3-D stereo
US10643491B2 (en) 2017-03-14 2020-05-05 Matthew CHELEL Process, system and method for step-by-step painting of an image on a transparent surface

Similar Documents

Publication Publication Date Title
US3846826A (en) Direct television drawing and image manipulating system
US2813146A (en) Colored light system
US4021841A (en) Color video synthesizer with improved image control means
US3872462A (en) Form filling system and method
US4833464A (en) Electrophoretic information display (EPID) apparatus employing grey scale capability
US5235363A (en) Method and apparatus for interacting with a computer generated projected image
US3835245A (en) Information modification in image analysis systems employing line scanning
US3459888A (en) Selective photocopier
US3731995A (en) Method and apparatus for producing animated motion pictures
US2403986A (en) Wave translation
US3757040A (en) Wide angle display for digitally generated video information
US4729017A (en) Stereoscopic display method and apparatus therefor
JPH0795803B2 (en) Partial electronic correction method and partial electronic correction apparatus for image structure part in color image duplication
US3078338A (en) Orthogonal diffraction gratings for color reproduction
US3463880A (en) Halftone image generator system
US4751503A (en) Image processing method with improved digital airbrush touch up
US2986596A (en) Television writing pick-up systems
US4025946A (en) Method and apparatus for generating graphic designs
US3912860A (en) Image display system
JPH10260670A (en) Image display device
Van Dam Computer driven displays and their use in man/machine interaction
US3274581A (en) Image scanning apparatus
US3786180A (en) Fourier transforming system
US3657550A (en) Apparatus for measuring the spatial response of optical systems
Kovasznay et al. Processing of two-dimensional patterns by scanning techniques