Information and Links

Join the fray by commenting, tracking what others have to say, or linking to it from your blog.


Apple Integrated Sensing display

hrmpf on January 12th, 2006

Apple integrated sensing display- patent- 20060007222

Apple invents 1984’stelescreens, 22 years too late- Oh, the irony! (considering their Superbowl ad)
1984

Interesting patent from Apple- incorporates the camera into the screen:

An integrated sensing display is disclosed. The sensing display includes display elements integrated with image sensing elements. As a result, the integrated sensing device can not only output images (e.g., as a display) but also input images (e.g., as a camera).

An interesting idea- basically you look at your screen and it looks at you- using the space between pixels (i didn’t know there was that much space!)

I wonder if it’s practically possible? I doubt Apple would implement it. It would, one imagines, add significantly to the cost of manufacture of an LCD screen and prevent Apple buying off the shelf components…

A lot of patents come to nothing so we’ll see. The iSight camera integrated into the iMac and MacBook seems to indicate they don’t need this technology. It would make a good digital mirror though- apply a few flattering core-image filters and it’d be perfect!


Apple has a few suggestion as well:

11. The device of claim 1, wherein the device is used in a portable communication device.
12. The device of claim 11, wherein the portable communication device is a telephone.
13. The device of claim 11, wherein the portable communication device is personal digital assistant.
14. The device of claim 1, wherein the device is used in a computer monitor or a television.
16. The device of claim 15, wherein the device is a medical device.

I think an iPredator invisibility suit would be a much better use!

Though, maybe some big brotheresq goverment will do a bulk order for the TV version ala “1984“:

Behind Winston’s back the voice from the telescreen was still babbling away about pig-iron and the overfulfilment of the Ninth Three-Year Plan. The telescreen received and transmitted simultaneously. Any sound that Winston made, above the level of a very low whisper, would be picked up by it, moreover, so long as he remained within the field of vision which the metal plaque commanded, he could be seen as well as heard. There was of course no way of knowing whether you were being watched at any given moment. How often, or on what system, the Thought Police plugged in on any individual wire was guesswork. It was even conceivable that they watched everybody all the time. But at any rate they could plug in your wire whenever they wanted to. You had to live — did live, from habit that became instinct — in the assumption that every sound you made was overheard, and, except in darkness, every movement scrutinized.

The inventor listed is Michael Uy:

quote from MUGCENTER:

iMovie Product Manager – Apple
As iMovie Product Manager for Apple, Michael Uy is responsible for positioning, marketing strategy, and on-going development of iMovie worldwide. Uy joined Apple in 2000, where he worked in Worldwide Developer Relations to manage key developers creating solutions for computer graphics and digital video. He worked to bring such products as Alias Wavefront’s Maya and ToonBoom Technologies’ Studio to the Mac platform. He also worked with digital camera vendors to adopt the QuickTime file format. Prior to joining Apple, Uy worked at Sony Corporate Headquarters in Tokyo, Japan, as a project manager in the Global R&D Strategy Department. He has also authored a case study on 3D game consoles for the Harvard Business School and an IT policy analysis report for the Japanese government. Uy received his bachelor degree from Harvard University and a Masters from joint studies at Harvard University’s John F. Kennedy School of Government and the Harvard Business School.

and some lovely images from the patent (captions added by me):


Wireless transmitting iPod Patented by Apple:
A patent from Apple gives an insight to their thinking for the future development of the iPod in November 2004.

Other Apple articles at Hrmpf.com

Peter Power’s Photos



Write a Comment

Take a moment to comment and tell us what you think. Some basic HTML is allowed for formatting.

Reader Comments

Interesting. Apple’s suggested uses seem very broad! ‘medical device’ could be so many things! I guess I haven’t read many patents, they’re probably all that broad… I like your ‘mirror with filters’ idea though!

[...] Apple Integrated Sensing display Published January 12th, 2006 in OS X. [...]

Generally it is a good idea to apply for a patent with the broadest sense of your idea first, even if you think there is no way it will be granted. You can slowly narrow it down until the patent is granted, giving you the broadest patent possible.

The thin-film-transistor (TFT) that drives pixel is photon sensitive and has to have be processed to shield it from light, much like (for those that remember) when you remove cover from DRAM, now commonly a CMOS sensor. The fact that the TFT is light sensitive and that it would be possible to create a image sensor in the display was discussed in open forum in the 80’s. I expect it will be a weak patent.

It does seem to be a bit of an opening gambit by Apple- the route suggested in the patent seems to suggest the use of the new breed of electrically or magnetically focusable lens not TFT but i think cost may be a major reason not to make it

from the patent:
Furthermore, the concept could be used in non-display devices as well. If at least one pixel were merely a light source, the camera would be capable of performing in dark spaces with little space, such as with a medical probe. Here, the surrounding display pixels could be used to transmit light, while the integrated sensing pixels recorded the image.

what does this mean? why would you need ‘pixels’ to be a light source? wouldn’t a light source be a good light source?

the inventor doesn’t sound like a tech guy- maybe it’s just what him and steve wrote on a napkin after a long lunch :)

“Apple invents 1984’s telescreens, 12 years too late-”

Woah, welcome back to 1996! Off by 10 years there. ;)

arhh, What year is it? -2006! crikey!

- thanks Nick- fixed!

this would be a useful invention, because currently with iSight and other webcams it’s hard to make “eye contact” with the person your are video chatting with. By looking directly into the screen…instant eye contact

I think df has the point behind this patent. When you look at the current “ad image” for iChat with the three friendly people, you get the wrong impression that they are looking straight at you and have eye contact with you. In reality they are staring into their iSight and can’t look at the incoming images on their screen, because then you would see three people watching at something more or less close to their iSight (depending on the position of the iSight and the iChat window on the display and the size of the display – with the 30″ Cinema Display and the iChat window in the middle of that screen you can actually make sort of a dandruf test, because you are far from eye contact and only see the scalp on the other end). I think this aspect of videoconferencing is always overglossed by advertising and many people buy an iSight because they think eyecontact while talking would be great. Soon after they get dissappointed (as I got) by videoconferencing in practise because you CAN’T have eye contact for all participants simultaineously until the above patent is put to life.

Hopefully someone will solve this practical drawback of VC soon (why not apple with the implementation of this patent?)…

Hmmm, someone is a little paranoid it appears. Bear in mind:

- the telescreen couldn’t actually view anything – it was just rumored to do so (works just as well from big brothers point of view
- even if your third term bush gets in and supplies these as mandatory devices, a newspaper, or jacket, or anything draped in front of it would mess it up big-time

The eye-contact issue is one that Apple has been working on for a long time — the effect is much more pronounced the closer the camera and subject get, and iSight is -very- close up.

Pushing this as a 1984 equivalent is really, really stretching it.

dimmer said:
>- even if your third term bush gets in and supplies these as mandatory devices, a newspaper, >or jacket, or anything draped in front of it would mess it up big-time

- mandatory Apple hardware- even i might vote for bush! that damn three term rule!

Apple (re?)inventa cran com cmera integrada

A Apple recebeu a patente dum monitor que ao mesmo tempo serve de cmera. Se o conceito lhe soa familiar, simples de explicar: o livro “1984″ de George Orwell tinham algo parecido chamado “telescreens”.

> the telescreen couldn’t actually view anything – it was just rumored to do so (works just as well from
> big brothers point of view

Yes it did (work)! and no it doesnt (work as well if it didnt)

With a flexible screen and this technology we can finally make an invisibility suit like Predator wears.

Does Sun’s Starfire concept video count as prior art?
http://www.asktog.com/starfire/starfireHome.html

In one scene, a character is show scanning a document by placing it on a display surface.

I was thinking Starfire too when I read the post above. Good catch, jayerandom. Note that Microsoft is also using stuff lifted from Starfire in their “office of the future” concept.

New Apple patent lets the screen see you

An integrated sensing display is disclosed. The sensing display includes display elements integrated with image sensing elements. As a result, the integrated sensing device can not only output images (e.g., as a display) but also input images (e.g., as…

Apple Creates Display Screen That Captures Images

Apple’s new patent application is for a display device with integrated sensing capabilities, that is, a camera built directly into its screen. Rather than include a separate camera built into a monitor, as Apple has done recently with the…

I don’t really see how this is all so interesting to anyone, this technology has been in science fiction for years, you don’t ever see people in Star Trek or futuristic games looking into a camera to talk to someone. Just finally someone has maybe come up with a way to do it while keeping display quality.

A similar thing has already been done, a few years ago somer company that does printers/scaners integrated a monochrome scanner into an lcd. You hold your thing you want scanned on the display, and thats it. This Apple patent though is a much more practical use of this kind of technology, and if they could pull it off then videoconferencing would finally really have that eye contact, because the camera wouldn’t be at the top of the screen, or on the desk, the “cameras” would be right between the pixels, so when you looked at someones eyes, they would see you looking at their eyes, not several inches below or to some offscreen glowing display.

[...] Apple Integrated Sensing display (HRMPF!): [...]

Apple patents “I look back at you!” LCD

One for the “the scary future is near” department comes surprisingly from Apple. While I love the general innovation Apple puts into its product its never THAT far ahead of the loop with its products that I would file under…

This sounds like it would work as a scanner, not a camera. how would it be in focus? Tiny lenses over each sensor, perfectly calibrated to make a coherent image? Seems fishy to me.

wouldnt it just be easier to put cameras on either side of the screen and apply the difference

[...] Das hätte Apple gern. Die Firma hat vor 8 Tagen das Patent erhalten auf das Konzept eines Displays, das auch Kamera ist, meldet dieser Blog. [...]

[...] Apple Patents Two-Way Screen A patent from Apple incorporates the camera into the screen: “An integrated sensing display is disclosed. The sensing display includes display elements integrated with image sensing elements. As a result, the integrated sensing device can not only output images (e.g., as a display) but also input images (e.g., as a camera).” Bloggers comment that the device would work like a telescreen described by Orwell in 1984.– via Digg [...]

I was searching the web and found your entry. I really like your site and found it worth while reading through the posts. I am looking to publish a comprehensive site reviewing many different articles and blog. Please feel free to take a look at my blog at computer training course

and add anything your want.

Great blog. Found your blog while searching for more information at yahoo about bereich wireless security solution . Your blog has quite a lot of interesting thoughts. Keep up the good work.

I was searching the web and found your entry. I really like your site and found it worth while reading through the posts. I am looking to

publish a comprehensive site reviewing many different articles and blogg. Please feel free to take a look at my blog at wireless cctv video security cameras and add anything your want.

Hi, I thought I’d just leave this message on your blog. I hope you don’t mind. I’ve been trying to find blogs where people are talking about hp pavilion ze2308wm notebook computer and when I was looking, I found this one on this post. I thought would say hi, before I go off to find some more on hp pavilion ze2308wm notebook computer

Multitouch displays

I love to see where those will be in a few years. These multitouch screens open new possibilities with Interaction design. It is much easier to get intuitive computer programs. It can get rid of the whole screen, mouse, keyboard triangle.

Just watch t…

[...] Screen sensor: http://hrmpf.com/wordpress/38/apple-integrated-sensing-display (which could also make possible a scanner that directly scans a picture by holding it on the screen) [...]

I believe I know the purpose of this patent. It isn’t to integrate a camera into the display, but to create what is in essence a touch-screen. The sensors described in the patent aren’t meant to be used as cameras. This would be too inefficient.

Instead, the sensors are incredibly efficient at detecting where your fingers or other objects are relative to the screen. From a practical standpoint, this would make much more sense.

[...] A new apple patent application covers building the camera into the screen- so that your screen can not only output images (e.g., as a display) but also input images (e.g., as a camera).read more | digg story [...]

Your blog is so informative … ..I just bookmarked you….keep up the good work!!!!

I’m Out! :)



s