US7095435B1 - Programmable multifunction electronic camera - Google Patents
Programmable multifunction electronic camera Download PDFInfo
- Publication number
- US7095435B1 US7095435B1 US10/895,615 US89561504A US7095435B1 US 7095435 B1 US7095435 B1 US 7095435B1 US 89561504 A US89561504 A US 89561504A US 7095435 B1 US7095435 B1 US 7095435B1
- Authority
- US
- United States
- Prior art keywords
- image sensor
- pixel
- detector element
- digital data
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
Definitions
- Electronic cameras are well known in the prior art and include conventional video cameras and digital cameras. These cameras typically include pixel image sensors having rectangular arrays of photodetector picture elements, or pixels, which are used to record conventional images for viewing by human observers. The pixel image sensors required by these cameras are manufactured in large quantities and, as a result, are inexpensive and readily available for use by consumers.
- Special purpose electronic cameras that is, electronic cameras that are designed to perform specific functions rather than to simply allow a consumer to view conventional images, are also well known in the prior art. These cameras are used in a variety of fields, including the security, manufacturing, and inspection fields, and include line scan cameras, rosette scan cameras, quadrant detectors, pan-zoom-tilt cameras, cameras that trade off numbers of pixels for frame rate, stereo cameras, windowing cameras, lock-in cameras (experimental only), and others. In contrast to other electronic cameras, special purpose cameras typically include custom designed detector element image sensors, i.e., image sensors that include detector elements having various shapes and sizes rather than pixels.
- Prior art special purpose cameras currently have a number of disadvantages that make them undesirable in many applications.
- the custom designed detector element image sensors required by these cameras are generally manufactured in small quantities for specific applications and tend to be expensive. This causes these types of cameras to be expensive.
- Special purpose electronic cameras have limited capabilities because they include custom designed detector element image sensors that can only be used to perform certain specific functions. For example, some prior art special purpose cameras include image sensors that include ring shaped detector elements that can be used to analyze optical power spectra, while others include image sensors that include wedge shaped detector elements that can be used to make precise angular measurements. Image sensors including ring shaped detector elements cannot be used to perform the same functions that are performed by image sensors including wedge shaped detector elements.
- hybrid detector element image sensors can be used to increase the capabilities of special purpose cameras, they may not be practical in some applications. For example, hybrid image sensors may be too expensive or too large to be used in a given application. Furthermore, even where hybrid image sensors can be used, special purpose cameras are still limited to performing only the functions that can be performed using the hybrid image sensor.
- the assignee of the present invention is aware of one prior art special purpose camera that does not require a custom designed detector element image sensor.
- This camera is described in a paper written by D. J. F. Walker and C. R. Chatwin and entitled “Fast Object Recognition using a Hybrid Optical/Digital Processor.” This paper was published in the September 1990 Proceedings of the British Machine Vision Conference, pgs. 413–418, RAE Cat: 4, CVCP Cat: 4, and is hereby incorporated by reference into this application.
- the prior art camera described in this paper includes a CCD pixel image sensor including a pixel array, external analog to digital converters, and a digital signal processor that is used to form wedge and ring samples using individual pixels included in the pixel array.
- This prior art camera does not require the use of a custom designed detector element image sensor and, as a result, does not have the disadvantages associated with this type of requirement, it nevertheless still has several of the disadvantages discussed above with regard to other prior art special purpose cameras.
- This camera is large and bulky and can only be used to perform the functions that can be performed using the wedge and ring samples. This camera cannot be easily modified to perform additional functions.
- This camera also has the additional disadvantage that it generates ring and wedge samples that include blank areas because pixels along the edges of a wedge or ring are eliminated from consideration.
- one object of the present invention is to provide a special purpose electronic camera that is smaller and more compact than prior art special purpose electronic cameras.
- Another object is to provide a special purpose electronic camera that is less expensive than prior art special purpose electronic cameras.
- a third object is to provide a special purpose electronic camera that can perform the functions normally performed by multiple different special purpose electronic cameras.
- a fourth object of the present invention is to provide a special purpose electronic camera that can be easily modified to perform the functions associated with one type of special purpose electronic camera and then another.
- a fifth object is to provide a special purpose electronic camera that can be manufactured using readily available commercial off-the-shelf image sensors.
- Still another object is to provide a special purpose electronic camera that eliminates the need for the use of cables connecting the detector elements of the image sensor to supporting electronics.
- Yet another object of the present invention is to provide a special purpose electronic camera that eliminates the need for the image sensor detector elements to be connected to one or more external amplifiers.
- An eighth object is to provide a special purpose camera system that includes small detector elements so that the camera optical system can have short focal lengths.
- An ninth object of the present invention is to reduce the cost of special purpose electronic cameras by providing a special purpose electronic camera design that uses common hardware to generate special purpose electronic cameras having different configurations.
- a tenth object of the present invention is to provide a special purpose electronic camera that allows experimental and developmental users to change the camera configuration from one configuration to another without buying a new camera.
- the electronic camera includes an enclosure, a lens (or light collecting) assembly, camera interface connectors, an image (or energy) sensor board, a processing board, and a camera interface board.
- the enclosure is designed to have the lens assembly and the camera interface connectors mounted on it and the image sensor, image processing, and camera interface boards mounted inside it.
- the lens assembly is designed to focus images (or, more generally, energy) on an image (or energy) sensor on the image sensor board.
- the camera interface connectors are designed to allow the camera to be connected to external devices, such as computer systems and flash memory.
- the image sensor board is designed to generate pixel signal digital data in response to images that are received from the lens assembly and to output that data to the image processing board.
- the image sensor board includes an integrated pixel-based, digital image sensor having a pixel array, analog to digital (A/D) converters, a sensor input/output (I/O) interface, and sensor controls.
- the image processing board is designed to convert the pixel signal digital data received from the pixel image sensor into detector element signal digital data representative of analog detector element image sensor signals that would be generated by any one of a variety of different custom designed detector element image sensors, i.e., image sensors that include detector elements rather than small pixels, receiving the images striking the pixel image sensor, and to output that data to the camera interface board.
- the image processing board performs this function by retrieving pixel digital data and pixel location data from the pixel image sensor, retrieving image sensor maps containing information representative of detector element image sensors from memory, mapping each pixel in the pixel image sensor to one of the detector elements included in the image sensor maps using a mapping algorithm, and then combining the pixel digital data for all of the pixels mapped to each one of the detector elements to generate the detector element data.
- the image processing board includes an image processing circuit for performing the conversion of the pixel signal digital data and a mask memory for storing the image sensor masks.
- the camera interface board is designed to receive mapping algorithms and custom detector element image sensor masks from external computer systems, and to output the detector digital data generated by the camera to those systems.
- the camera interface board includes an integrated Universal Serial Bus (USB) peripheral controller, which is used to pass the detector digital data, image sensor masks, and mapping algorithms between the image processing board and the external computer.
- USB Universal Serial Bus
- the lens assembly included in the present invention is simply a light or energy collecting assembly and, as a result, any one of a variety of different types of light or energy collecting assemblies known in the art may be used as well.
- the image sensor is simply a light or energy sensor that is designed to receive and sense light or energy.
- various other types of light and energy sensors may also be used with the present invention.
- FIG. 1 is a block diagram showing one embodiment of the programmable multifunction electronic camera of the present invention.
- FIG. 2 is block diagram showing the image sensor board for one embodiment of the present invention.
- FIG. 3 is block diagram showing the image processing board for one embodiment of the present invention.
- FIG. 4 is a top view showing one embodiment of the hybrid ring/wedge detector element image sensor mask used with the present invention.
- FIG. 5 is a flow diagram illustrating one of the mapping algorithms used with the present invention.
- FIG. 6 is a block diagram showing an embodiment of the present invention that includes a field programmable gate array (FPGA) and illustrates the operation of the present invention when using the hybrid ring/wedge detector element image sensor mask shown in FIG. 4 .
- FPGA field programmable gate array
- FIG. 7 is a block diagram showing one embodiment of the camera interface board of the present invention.
- one embodiment of the programmable multifunction electronic camera 10 includes an enclosure 12 , a lens assembly 14 (also referred to as a light collecting assembly), camera interface connectors 16 , an image sensor board 18 , an image processing board 20 (or simply a processing board), and a camera interface board 22 .
- the lens assembly 14 and camera interface connectors 16 are mounted on the enclosure 12 and the image sensor, image processing, and camera interface boards 18 , 20 and 22 are mounted adjacent to one another inside the enclosure 12 .
- the image sensor board 18 is mounted adjacent to the lens assembly 14 so that the lens assembly 14 can focus images on an image sensor included with the image sensor board 18 and discussed in more detail below.
- the camera interface board 22 is mounted adjacent to and is connected to the camera interface connectors 16 .
- the image sensor board 18 is connected to the image processing board 20 .
- the image processing board 20 is connected to the image sensor board 18 and the camera interface board 22 .
- the enclosure 12 is designed to have the lens assembly 14 and camera interface connectors 16 mounted on it and includes a lens opening (not shown) and connector opening (not shown) for receiving each of these items.
- the enclosure 12 also includes board mountings (not shown) inside the enclosure 12 that allow the boards to be mounted inside the enclosure 12 .
- the lens assembly 14 is designed to focus images on the image sensor on the image sensor board 18 (or in some cases, to simply collect light or energy and direct it toward the image sensor, which may also be referred to as a light or energy sensor).
- the lens assembly 14 includes a lens 24 , which is used to collect or focus images, light, or energy in general, and a lens mounting assembly 26 , which is used to mount the lens 24 on the enclosure 12 so that it can properly focus images, light, or energy on the image sensor.
- the camera interface connectors 16 are designed to allow the camera to be connected to external computer systems 28 .
- the camera interface connectors 16 also allow the camera to be connected to external flash memory devices (not shown) as well.
- the image sensor board 18 includes components that are designed to generate pixel signal digital data (“the pixel digital data”) in response to images (or, more generally, light or energy) that are received from the lens assembly 14 and to output that data to the image processing board 20 .
- the image sensor board 18 includes an integrated pixel-based, digital image sensor 30 (“the pixel image sensor 30 ” or “pixel digital energy sensor 30 ”) that is designed to generate the pixel digital data, and sensor board connectors 32 for connecting the image sensor board 18 to the image processing board 20 and outputting the pixel digital data.
- the pixel image sensor 30 includes a pixel array 34 , analog to digital (A/D) converters 36 , a sensor input/output (I/O) interface 38 , and sensor controls 40 .
- the pixel array 34 generates analog pixel signals in response to images, light, or energy received from the lens assembly 14 and the A/D converters 36 convert those signals into the pixel digital data.
- the sensor I/O interface 38 is connected to the A/D converters 36 , the sensor controls 40 , and the sensor board connectors 32 , and is used to output the pixel digital data to the image processing board 20 and receive control signals from the image processing board 20 .
- the sensor controls 40 control the digitizing of the analog pixel signals and the outputting of the pixel digital data based on the control signals received from the image processing board 20 .
- the pixel array 34 and the A/D converters 36 are integrated together on the pixel image sensor 30 , which is some cases may be a single integrated chip.
- an integrated pixel image sensor 30 reduces the size of the image sensor and allows the camera to be smaller and more compact than prior art special purpose electronic cameras.
- the integration of these components also eliminates the need for separate cables to connect the pixel array 34 to supporting electronics as required by some prior art special purpose electronic cameras.
- Pixel image sensors are inexpensive, commercial, off-the-shelf image sensors that are manufactured in large quantities and are readily available from different manufacturers.
- the use of this sensor reduces the overall cost of this camera by eliminating the need for expensive custom designed detector element image sensors including specially designed detector element arrays.
- the use of this sensor also allows the lens assembly 14 used with this camera to have a short focal length because the pixels included in the pixel array 34 are very small.
- the pixel image sensor 30 includes a 1.3 Megapixel CMOS active-pixel digital image (or energy) sensor 30 manufactured by Micron Technology, Inc, part number MT9M413C36STC. Detailed information regarding this sensor is included in a document entitled “1.3-Megapixel CMOS active-pixel digital image sensor” published by Micron. That document is hereby incorporated by reference into the present application.
- a pixel image sensor 30 that does not include integrated A/D converters 36 , which would be included on one or more separate chips, may be used with the present invention. While embodiments of this type will function properly, it is preferred to use pixel image sensors 30 having integrated A/D converters 36 in order to minimize the size of the camera. In other embodiments, the pixel image sensor 30 and the lens 24 are positioned relative to one another so that the lens 24 generates a Fourier Transform of the energy received by the lens 24 .
- the image processing board 20 (“the IP board”) is designed to convert the pixel digital data received from the pixel image sensor 30 into detector element signal digital data (“the detector digital data”) representative of analog detector element image (or energy) sensor signals that would be generated by any one of a variety of different custom designed detector element image (or energy) sensors, i.e., image sensors that include detector elements rather than small pixels (“the detector element image sensors”) receiving the images (or light, or energy) striking the pixel image sensor 30 , and to output that data to the camera interface board 22 .
- the detector digital data representative of analog detector element image (or energy) sensor signals that would be generated by any one of a variety of different custom designed detector element image (or energy) sensors, i.e., image sensors that include detector elements rather than small pixels (“the detector element image sensors”) receiving the images (or light, or energy) striking the pixel image sensor 30 , and to output that data to the camera interface board 22 .
- the image processing board 20 converts the pixel digital data into the detector digital data by retrieving pixel digital data and pixel location data from the pixel image sensor 30 , retrieving an image (or energy) sensor mask containing information representative of a detector element image (or energy) sensor from memory, mapping each pixel in the pixel image sensor 30 to one of the detector elements included in the image (or energy) sensor mask, and then combining the pixel digital data for all of the pixels mapped to each one of the detector elements to generate the detector element data.
- the IP board 20 includes image sensor board connectors 42 , camera interface board connectors 44 , a mask memory 46 , and an image processing circuit 48 (also referred to as simply a processing circuit).
- the image sensor board connectors 42 are connected to the sensor board connectors 32 and allow pixel digital data to be received from the image sensor and control signals to be passed to the image sensor.
- the camera interface board connectors 44 are connected to the camera interface board 22 and allow detector digital data to be output to that board, and programming instructions and image sensor masks of detector element image sensors to be received from that board.
- the mask memory 46 is designed to store the image sensor masks received from the camera interface board 22 .
- the image sensor masks stored in the mask memory 46 contain information representative of actual detector element image sensors, including information regarding the size, shape, and location of detector elements included in those sensors.
- An example of one type of image sensor mask that can be stored in the mask memory 46 is a hybrid ring/wedge detector element image sensor mask (see FIG. 4 ).
- any one of a number of image sensor masks may be stored in the mask memory 46 , including masks for hybrid ring/wedge detector element image sensors having half rings and half wedges, hybrid ring/wedge detector element image sensors having full rings and full wedges, ring element image sensors having programmable annulus width profiles, circular scan annular detector element image sensors having programmable inner and outer radii and angular widths, radial scan detectors, linear array detector element image sensors having programmable detector element heights, combination horizontal and vertical linear array detector element image sensors, quad detector element image sensors having a programmable size, detector element image sensors including an array of quad detectors having programmable size and location, and combination quad and ring/wedge detector element image sensors (or other geometries) for alignment functions.
- masks for linear or rectangular array detector element image sensors wedge array detector element image sensors where the number of wedges varies as a function of the radii of the detectors, detector element image sensors with moveable windows and resizable windows, detector element image sensors with multiple windows, and detector element image sensors with off-set wedge only configurations for high-resolution angular measurement.
- the image processing circuit 48 includes an image processing image sensor input/output (I/O) interface 52 (“the image sensor interface 52 ”), an image processing camera I/O interface 54 (“the camera interface 54 ”), and an image processing mask memory I/O interface 56 (“the mask memory interface 56 ”).
- the image sensor interface 52 is connected to the image sensor board connectors 42
- the camera interface 54 is connected to the camera interface board connectors 44
- the mask memory interface 56 is connected to the mask memory 46 .
- the image sensor interface 52 is designed to allow pixel digital data and image sensor control signals to be received from and sent to the image sensor.
- the camera interface 54 is designed to allow detector digital data and programming instructions to be sent to and received from the camera interface board 22 .
- the mask memory interface 56 is designed to allow image sensor masks to be stored on and received from the mask memory 46 .
- the image processing circuit 48 also includes image processor hardware and software 58 (“the image processor 58 ”), which is responsible for generating image control signals that cause the pixel image sensor 30 to send pixel digital data and pixel location data to the image processing circuit 48 , generating mask request signals that cause the mask memory 46 to send image sensor masks to the processing circuit, mapping the pixels in the pixel image sensor 30 to the detector elements included in the image sensor masks, combining the pixel digital data for the pixels mapped to the image sensor detector elements, and outputting the resulting detector digital data to the camera interface board 22 .
- the image processor is also responsible for storing image sensor masks received from the camera interface board 22 in the mask memory 46 and storing the mapping algorithm that is used to map the pixels in the pixel image sensor 30 to the image sensor masks.
- the image processor uses two different mapping algorithms to map pixels.
- the first algorithm is a generic algorithm that maps each pixel in the pixel image sensor 30 to the image sensor masks. This algorithm performs the mapping function by using matrixes to compare the location of each pixel relative to the pixel image sensor 30 with the location of each detector element relative to the pixel image sensor 30 . This algorithm is illustrated in matrix and summation form by the following equations:
- I is an input column vector including information representing the locations of pixels included in one column of the pixel image sensor 30
- W is a weighting matrix that includes information representing the locations of detector elements in an image sensor mask
- O is an output column vector containing information indicating whether the pixels in the input column vector are located in the detector elements of the image sensor mask. This calculation is performed for each column of the pixel image sensor 30 .
- the general mapping algorithm typically generates an output matrix that consists predominantly of zeros, indicating that a pixel is not included in a particular detector element on the image sensor mask.
- a second mapping algorithm that reduces the number of calculations that result in zeros and runs much faster than the generic mapping algorithm may be used instead. This algorithm performs a preliminary calculation to determine if a pixel is located in any of the detector elements and, if not, simply generates a zero for the output matrix without performing the mapping calculations performed in the generic mapping algorithm.
- FIG. 5 An example of this type of mapping algorithm for the hybrid ring/wedge detector element image sensor from FIG. 4 is shown in FIG. 5 .
- the “floor” term is a software function (in FIG. 5 , the term is from LabView software, a software program known to those skilled in the relevant art) that causes the “r/2M” term to be rounded to the next lowest whole number. Thus, if this term equals 5.1, the output of this function is 5. In a similar manner, if this term equals 5.8, the output of this function is also 5.
- the “floor” term is also typically referred to as a “truncation” function.
- the pixels may not be square and the equations shown in FIG. 5 would need to be modified accordingly.
- alternative embodiments may include different numbers of rings and wedges, e.g., 10 rings and 20 wedges, etc., and the virtual center may not be the exact center of the detector array.
- the image processor retrieves pixel digital data and pixel location data from the pixel image sensor 30 by sending control signals to the pixel image sensor 30 that cause it to capture and send frames of information to the image processing board 20 .
- Each frame includes pixel location data and pixel digital data for each pixel included in the pixel image sensor 30 .
- the image processor uses this data to determine the pixel digital data associated with each pixel in the pixel image sensor 30 .
- the image processor retrieves image sensor masks by sending mask requests to a mask memory 46 located on the image processing board 20 that cause the mask memory 46 to send image sensor masks to the image processing board 20 .
- the image processor maps each pixel included in the digital pixel image sensor 30 to the image sensor masks and identifies pixels that can be combined together to create “virtual detector elements,” or “super-pixels,” having the same size, shape, and location as the detector elements included in the image sensor masks.
- the image processor then sums the digital pixel signal data for all of the pixels mapped to each “virtual detector element” to generate the detector digital data and outputs that data to the camera interface board 22 .
- the image processor maps the pixel digital data as it arrives at the image processor. In alternative embodiments, however, the image processor may collect all of the pixel digital data before it performs the mapping calculations.
- the pixel digital data for a given pixel must be split between one or more “super-pixels” because portions of the pixel fall within each of these “super-pixels.”
- the image processor uses a weighting factor to determine what portion of the digital pixel signal data should go to each “super-pixel.”
- the image processor allows a user to load different image sensor masks into the mask memory 46 using an external computer system or flash memory. This allows the camera to use common hardware to create a variety of different camera configurations and to be easily programmed to perform the functions normally associated with multiple different types of special purpose electronic cameras. This also allows the camera to be easily programmed to perform the functions associated with one type of special purpose electronic camera and then another. This further permits experimental and developmental users to change camera configurations without purchasing new special purpose electronic cameras.
- the image processor allows a user to program the camera to use different types of mapping algorithms using an external computer system. This provides users with the ability to vary the processing time required to perform mapping as necessary from one application to another.
- the image processing circuit 48 includes a programmable logic device, such as a field programmable gate array (FPGA) circuit from the Virtex-II Pro family of FPGAs manufactured by Xilinx, Inc., part number XC2VP50, and the mask memory 46 includes a 16 Mbit Synchronous Random Access Memory (SRAM) chip manufactured by Cypress Semiconductor Corporation, part number CY7C1371.
- FPGA field programmable gate array
- SRAM Synchronous Random Access Memory
- Virtex FPGA In Detailed information regarding the Virtex FPGA is included in a document entitled “Virtex-II Pro Platform FPGAs: Introduction and Overview” published by Xilinx, Inc. This document is hereby incorporated by reference into the present application. Detailed information regarding the Cypress SRAM chip may be found in a document entitled “512K ⁇ 36/1M ⁇ 18 Flow-Thru SRAM with NoBL Architecture” published by Cypress. This document is also incorporated by reference into the present application.
- FIG. 6 A simplified block diagram illustrating the use of an FPGA to implement the present invention and the processing of ring and wedge information for a hybrid ring/wedge detector element image sensor is shown in FIG. 6 .
- this embodiment includes a pixel image sensor 58 , an FPGA 60 , and mask memory 62 .
- the pixel image sensor 58 and mask memory 62 operate as indicated previously.
- the figure includes a series of blocks representing various portions of the FPGA 60 that are responsible for the different functions performed by the FPGA 60 .
- the camera control block 64 represents the portion of the FPGA 60 that is responsible for interfacing with the pixel image sensor 58 and starting frame captures. This portion is also responsible for tracking pixel location on each input frame and passing this information to the Mask Fetch block 66 and the Mask/Pixel Decoder block 68 .
- the Mask Fetch block 66 represents the portion of the FPGA 60 that is responsible for retrieving image sensor mask information from the mask memory 62 , which may be an external storage media such as static random access memory or SRAM.
- the image sensor mask information, or Mask Data is supplied to the Mask/Pixel Decoder block 68 , which represents the portion of the FPGA 60 that is responsible for mapping each pixel into one of 11 Ring accumulators 70 or one of 8 Wedge accumulators 72 , one accumulator for each of the ring and wedge shaped detector elements shown in FIG. 4 .
- the Ring and Wedge accumulators 70 and 72 represent the portions of the FPGA 60 that are responsible for summing all of the pixel values, i.e., the pixel digital data discussed previously, mapped into each ring or wedge detector element for each frame of data.
- the portion of the FPGA 60 represented by the Interface Control Block 74 reads all of the accumulators and formats a packet of data that can be sent out a serial port on the FPGA 60 .
- the block diagram shown in FIG. 6 is tailored to the hybrid ring/wedge detector element image sensor shown in FIG. 4 but any remapping of the camera into different regions can be accommodated by altering the mask.
- the camera of the present invention may include a digital signal processing (DSP) board (not shown), including a DSP chip such as the TMS320VC33 DSP chip, manufactured by Texas Instruments Incorporated.
- DSP digital signal processing
- the DSP board is connected between the image processing board 20 and the camera interface board 22 and is used to process the detector digital data prior to outputting that data to the external computer system 28 .
- the DSP in these embodiments may be used to perform some of the functions, such as the calculations associated with the algorithm shown in FIG. 5 , that are performed by the FPGA in other embodiments.
- the camera interface board 22 is designed to receive programming instructions, including mapping algorithms, and image sensor masks from an external computer system 28 (see FIG. 1 ) or flash memory, and to output the detector digital data generated by the camera to the computer system.
- the camera interface board 22 includes image processing board connectors 76 , which are used to connected the camera interface board 22 to the image processing board 20 , and an integrated Universal Serial Bus (USB) peripheral controller 78 , which is used to pass the detector digital data, image sensor masks, and mapping algorithms between the image processing board 20 and the external computer 28 .
- the USB peripheral controller 78 includes a USB transceiver 80 for transmitting and receiving data from the image processing board 20 , a serial interface engine 82 (SIE) for handling USB protocol issues, a microcontroller 84 for handling application specific functions, and a peripheral interface 86 for use in connecting the camera interface board 22 to the external computer system 28 .
- the USB transceiver 80 is connected to the image processing board connectors 76 and the peripheral interface 86 is connected to the camera interface connectors 16 mounted on the camera enclosure 12 (see FIG. 1 ).
- the USB peripheral controller 78 includes a USB 2.0 integrated microcontroller chip manufactured by Cypress Semiconductor Corporation, part number CY7C68013. This chip is described in detail in a document entitled “CY7C68013 EZ-USB FX2 USB Microcontroller High-Speed USB Peripheral Controller” published by Cypress. That document is hereby incorporated by reference into the present application.
Abstract
Description
Claims (15)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/895,615 US7095435B1 (en) | 2004-07-21 | 2004-07-21 | Programmable multifunction electronic camera |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/895,615 US7095435B1 (en) | 2004-07-21 | 2004-07-21 | Programmable multifunction electronic camera |
Publications (1)
Publication Number | Publication Date |
---|---|
US7095435B1 true US7095435B1 (en) | 2006-08-22 |
Family
ID=36821740
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/895,615 Expired - Fee Related US7095435B1 (en) | 2004-07-21 | 2004-07-21 | Programmable multifunction electronic camera |
Country Status (1)
Country | Link |
---|---|
US (1) | US7095435B1 (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060114312A1 (en) * | 2003-05-02 | 2006-06-01 | Kabushiki Kaisha Toshiba | Optical beam scanning device and image forming apparatus |
US20060171414A1 (en) * | 2004-11-24 | 2006-08-03 | Behnam Katibian | Systems and methods for digital data transmission rate control |
US20070235632A1 (en) * | 2006-04-10 | 2007-10-11 | Arjuna Bin Marzuki | Method and apparatus for integrating a quantity of light |
US20080259203A1 (en) * | 2007-04-20 | 2008-10-23 | Goris Andrew C | Systems And Methods For Identifying Camera Sensors |
US20100260055A1 (en) * | 2003-12-08 | 2010-10-14 | Qualcomm Incorporated | High data rate interface with improved link synchronization |
US8539119B2 (en) | 2004-11-24 | 2013-09-17 | Qualcomm Incorporated | Methods and apparatus for exchanging messages having a digital data interface device message format |
US8606946B2 (en) | 2003-11-12 | 2013-12-10 | Qualcomm Incorporated | Method, system and computer program for driving a data signal in data interface communication data link |
US8625625B2 (en) | 2004-03-10 | 2014-01-07 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8630305B2 (en) | 2004-06-04 | 2014-01-14 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8635358B2 (en) | 2003-09-10 | 2014-01-21 | Qualcomm Incorporated | High data rate interface |
US8650304B2 (en) | 2004-06-04 | 2014-02-11 | Qualcomm Incorporated | Determining a pre skew and post skew calibration data rate in a mobile display digital interface (MDDI) communication system |
US8667363B2 (en) | 2004-11-24 | 2014-03-04 | Qualcomm Incorporated | Systems and methods for implementing cyclic redundancy checks |
US8681817B2 (en) | 2003-06-02 | 2014-03-25 | Qualcomm Incorporated | Generating and implementing a signal protocol and interface for higher data rates |
US8687658B2 (en) | 2003-11-25 | 2014-04-01 | Qualcomm Incorporated | High data rate interface with improved link synchronization |
US8694663B2 (en) | 2001-09-06 | 2014-04-08 | Qualcomm Incorporated | System for transferring digital data at a high rate between a host and a client over a communication path for presentation to a user |
US8692839B2 (en) | 2005-11-23 | 2014-04-08 | Qualcomm Incorporated | Methods and systems for updating a buffer |
US8694652B2 (en) | 2003-10-15 | 2014-04-08 | Qualcomm Incorporated | Method, system and computer program for adding a field to a client capability packet sent from a client to a host |
US8692838B2 (en) | 2004-11-24 | 2014-04-08 | Qualcomm Incorporated | Methods and systems for updating a buffer |
US8705521B2 (en) | 2004-03-17 | 2014-04-22 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8705571B2 (en) | 2003-08-13 | 2014-04-22 | Qualcomm Incorporated | Signal interface for higher data rates |
US8723705B2 (en) | 2004-11-24 | 2014-05-13 | Qualcomm Incorporated | Low output skew double data rate serial encoder |
US8730069B2 (en) | 2005-11-23 | 2014-05-20 | Qualcomm Incorporated | Double data rate serial encoder |
US8745251B2 (en) | 2000-12-15 | 2014-06-03 | Qualcomm Incorporated | Power reduction system for an apparatus for high data rate signal transfer using a communication protocol |
US8756294B2 (en) | 2003-10-29 | 2014-06-17 | Qualcomm Incorporated | High data rate interface |
US8873584B2 (en) | 2004-11-24 | 2014-10-28 | Qualcomm Incorporated | Digital data interface device |
US20160013017A1 (en) * | 2014-01-13 | 2016-01-14 | Frederick A. Flitsch | Method and apparatus for a high resolution imaging system |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3689772A (en) | 1971-08-18 | 1972-09-05 | Litton Systems Inc | Photodetector light pattern detector |
US4869574A (en) | 1988-05-13 | 1989-09-26 | The United States Of America As Represented By The Secretary Of The Army | Hybrid optical correlator |
US5883830A (en) * | 1995-12-29 | 1999-03-16 | Intel Corporation | CMOS imaging device with integrated flash memory image correction circuitry |
US6046769A (en) * | 1994-02-28 | 2000-04-04 | Canon Kabushiki Kaisha | Sensing apparatus |
US6256350B1 (en) * | 1998-03-13 | 2001-07-03 | Conexant Systems, Inc. | Method and apparatus for low cost line-based video compression of digital video stream data |
-
2004
- 2004-07-21 US US10/895,615 patent/US7095435B1/en not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3689772A (en) | 1971-08-18 | 1972-09-05 | Litton Systems Inc | Photodetector light pattern detector |
US4869574A (en) | 1988-05-13 | 1989-09-26 | The United States Of America As Represented By The Secretary Of The Army | Hybrid optical correlator |
US6046769A (en) * | 1994-02-28 | 2000-04-04 | Canon Kabushiki Kaisha | Sensing apparatus |
US5883830A (en) * | 1995-12-29 | 1999-03-16 | Intel Corporation | CMOS imaging device with integrated flash memory image correction circuitry |
US6256350B1 (en) * | 1998-03-13 | 2001-07-03 | Conexant Systems, Inc. | Method and apparatus for low cost line-based video compression of digital video stream data |
Non-Patent Citations (2)
Title |
---|
Fast Object Recognition using a Hybrid Optical/Digital Processor-D.J.F. Walker and C.R. Chatwin-Proceedings of the British Machine Vision Conference, Sep. 1990, p. 413-418, RAE CAT:4, CVCP Cat:4. |
K.B. Farr and R.L. Hartman, "Fourier Plane Detectors for Optical Image Processing," SPIE 3386, pp. 78-86, (1998). |
Cited By (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8745251B2 (en) | 2000-12-15 | 2014-06-03 | Qualcomm Incorporated | Power reduction system for an apparatus for high data rate signal transfer using a communication protocol |
US8694663B2 (en) | 2001-09-06 | 2014-04-08 | Qualcomm Incorporated | System for transferring digital data at a high rate between a host and a client over a communication path for presentation to a user |
US8812706B1 (en) | 2001-09-06 | 2014-08-19 | Qualcomm Incorporated | Method and apparatus for compensating for mismatched delays in signals of a mobile display interface (MDDI) system |
US7304659B2 (en) * | 2003-05-02 | 2007-12-04 | Kabushiki Kaisha Toshiba | Optical beam scanning device and image forming apparatus |
US20080055691A1 (en) * | 2003-05-02 | 2008-03-06 | Kabushiki Kaisha Toshiba | Optical beam scanning device and image forming apparatus |
US20060114312A1 (en) * | 2003-05-02 | 2006-06-01 | Kabushiki Kaisha Toshiba | Optical beam scanning device and image forming apparatus |
US8705579B2 (en) | 2003-06-02 | 2014-04-22 | Qualcomm Incorporated | Generating and implementing a signal protocol and interface for higher data rates |
US8681817B2 (en) | 2003-06-02 | 2014-03-25 | Qualcomm Incorporated | Generating and implementing a signal protocol and interface for higher data rates |
US8700744B2 (en) | 2003-06-02 | 2014-04-15 | Qualcomm Incorporated | Generating and implementing a signal protocol and interface for higher data rates |
US8705571B2 (en) | 2003-08-13 | 2014-04-22 | Qualcomm Incorporated | Signal interface for higher data rates |
US8719334B2 (en) | 2003-09-10 | 2014-05-06 | Qualcomm Incorporated | High data rate interface |
US8635358B2 (en) | 2003-09-10 | 2014-01-21 | Qualcomm Incorporated | High data rate interface |
US8694652B2 (en) | 2003-10-15 | 2014-04-08 | Qualcomm Incorporated | Method, system and computer program for adding a field to a client capability packet sent from a client to a host |
US8756294B2 (en) | 2003-10-29 | 2014-06-17 | Qualcomm Incorporated | High data rate interface |
US8606946B2 (en) | 2003-11-12 | 2013-12-10 | Qualcomm Incorporated | Method, system and computer program for driving a data signal in data interface communication data link |
US8687658B2 (en) | 2003-11-25 | 2014-04-01 | Qualcomm Incorporated | High data rate interface with improved link synchronization |
US8670457B2 (en) | 2003-12-08 | 2014-03-11 | Qualcomm Incorporated | High data rate interface with improved link synchronization |
US20100260055A1 (en) * | 2003-12-08 | 2010-10-14 | Qualcomm Incorporated | High data rate interface with improved link synchronization |
US8669988B2 (en) | 2004-03-10 | 2014-03-11 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8730913B2 (en) | 2004-03-10 | 2014-05-20 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8625625B2 (en) | 2004-03-10 | 2014-01-07 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8705521B2 (en) | 2004-03-17 | 2014-04-22 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8630318B2 (en) | 2004-06-04 | 2014-01-14 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8650304B2 (en) | 2004-06-04 | 2014-02-11 | Qualcomm Incorporated | Determining a pre skew and post skew calibration data rate in a mobile display digital interface (MDDI) communication system |
US8630305B2 (en) | 2004-06-04 | 2014-01-14 | Qualcomm Incorporated | High data rate interface apparatus and method |
US8723705B2 (en) | 2004-11-24 | 2014-05-13 | Qualcomm Incorporated | Low output skew double data rate serial encoder |
US8667363B2 (en) | 2004-11-24 | 2014-03-04 | Qualcomm Incorporated | Systems and methods for implementing cyclic redundancy checks |
US8699330B2 (en) * | 2004-11-24 | 2014-04-15 | Qualcomm Incorporated | Systems and methods for digital data transmission rate control |
US8692838B2 (en) | 2004-11-24 | 2014-04-08 | Qualcomm Incorporated | Methods and systems for updating a buffer |
US8873584B2 (en) | 2004-11-24 | 2014-10-28 | Qualcomm Incorporated | Digital data interface device |
US8539119B2 (en) | 2004-11-24 | 2013-09-17 | Qualcomm Incorporated | Methods and apparatus for exchanging messages having a digital data interface device message format |
US20060171414A1 (en) * | 2004-11-24 | 2006-08-03 | Behnam Katibian | Systems and methods for digital data transmission rate control |
US8611215B2 (en) | 2005-11-23 | 2013-12-17 | Qualcomm Incorporated | Systems and methods for digital data transmission rate control |
US8692839B2 (en) | 2005-11-23 | 2014-04-08 | Qualcomm Incorporated | Methods and systems for updating a buffer |
US8730069B2 (en) | 2005-11-23 | 2014-05-20 | Qualcomm Incorporated | Double data rate serial encoder |
US8232512B2 (en) * | 2006-04-10 | 2012-07-31 | Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. | Method and apparatus for integrating a quantity of light |
US20070235632A1 (en) * | 2006-04-10 | 2007-10-11 | Arjuna Bin Marzuki | Method and apparatus for integrating a quantity of light |
WO2008131112A1 (en) * | 2007-04-20 | 2008-10-30 | Hewlett-Packard Development Company, L.P. | Systems and methods for identifying camera sensors |
US20080259203A1 (en) * | 2007-04-20 | 2008-10-23 | Goris Andrew C | Systems And Methods For Identifying Camera Sensors |
US20160013017A1 (en) * | 2014-01-13 | 2016-01-14 | Frederick A. Flitsch | Method and apparatus for a high resolution imaging system |
US9558915B2 (en) * | 2014-01-13 | 2017-01-31 | Frederick A. Flitsch | Method and apparatus for a high resolution imaging system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7095435B1 (en) | Programmable multifunction electronic camera | |
US6069351A (en) | Focal plane processor for scaling information from image sensors | |
CA2152314C (en) | Method and apparatus for hemisperic imaging | |
JP6030524B2 (en) | Camera system having a plurality of pixel arrays on one chip | |
JP6101288B2 (en) | Thermal imaging apparatus and thermal image standard imaging method | |
US8461530B2 (en) | Sensor array microchip | |
US20130058589A1 (en) | Method and apparatus for transforming a non-linear lens-distorted image | |
US6392216B1 (en) | Method for compensating the non-uniformity of imaging devices | |
JP2004260821A (en) | Image sensor for capturing and filtering image data | |
WO2014044221A1 (en) | Thermal image diagnosis device and thermal image diagnosis method | |
EP3765815B1 (en) | Imaging device, image processing apparatus, and image processing method | |
US7129978B1 (en) | Method and architecture for an improved CMOS color image sensor | |
Sengupta et al. | BAE systems' SMART chip camera FPA development | |
CN103776539B (en) | Analysis device and analysis method | |
WO2017126242A1 (en) | Image capture device and image data generation method | |
JPH06205273A (en) | Video camera with built-in geometrical correction function | |
JP6585195B2 (en) | Imaging apparatus and image data generation method | |
KR102484150B1 (en) | Electronic device and method for upsampling image thereof | |
Wang et al. | High speed wide field CMOS camera for Transneptunian Automatic Occultation Survey | |
US9955099B2 (en) | Minimum height CMOS image sensor | |
JP2007300625A (en) | Imaging subsystem employing bidirectional shift register | |
US5317523A (en) | Integrated reflective image sensor | |
JPH11150681A (en) | Information processing device and method, information processing system and recording medium | |
CN211013261U (en) | True-color night vision thermal infrared imager | |
KR20000057783A (en) | Imaging device and method of capturing an image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: PETITION RELATED TO MAINTENANCE FEES FILED (ORIGINAL EVENT CODE: PMFP); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Free format text: PETITION RELATED TO MAINTENANCE FEES GRANTED (ORIGINAL EVENT CODE: PMFG); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
REMI | Maintenance fee reminder mailed | ||
REIN | Reinstatement after maintenance fee payment confirmed | ||
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20100822 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
PRDP | Patent reinstated due to the acceptance of a late maintenance fee |
Effective date: 20101018 |
|
SULP | Surcharge for late payment | ||
FPAY | Fee payment |
Year of fee payment: 8 |
|
AS | Assignment |
Owner name: ADVANCED OPTICAL SYSTEMS, ALABAMA Free format text: NUNC PRO TUNC ASSIGNMENT;ASSIGNORS:HARTMAN, RICHARD LEON;FARR, KEITH B.;REEL/FRAME:039273/0154 Effective date: 20160630 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.) |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20180822 |
|
AS | Assignment |
Owner name: ZEROCONZERO, LLC, ALABAMA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ESTATE OF DOROTHY CAROLYN SMITH DAVIDSON;REEL/FRAME:062807/0401 Effective date: 20220630 |