DISQUS

VentureBeat: Apple asked Google not to use multi-touch in Android, and Google complied

  • TedHoward · 10 months ago
    I wouldn't call this anti-competitive collusion. If Apple has a broad patent portfolio regarding multi-touch, then Google was simply prudent to avoid the issue. That's just how patents work. Schmidt, being CEO of Google and on Apple's board, may have had back-channel discussions but unless he traded stock on that I don't see much wrong. Also, IANAL.

    The most interest phrase I saw in this post was, "will multi-touch become important enough that Google has to include it in Android?" If Google failed to include multi-touch due to potential patent litigation, then one can conclude that including it in future releases of Android would require patent licenses. In general, such licensing is on a per-unit basis, but it is my understanding that Android is offered royalty-free. Such per-unit licensing would then cause Google to lose money on each Android unit sold. It would likely also require Google to provide a method of accounting for each Android license sold for later auditing.

    One way out of patent license costs for Google would be a cross-licensing agreement with Apple or with Microsoft to share patents, but that seems unlikely.
  • MG Siegler · 10 months ago
    Thanks Ted, good stuff.

    Though not stated, something else to think about is that Google could wait to see how the whole thing plays out with Apple and Palm re: multi-touch. While we've seen some of Apple's huge portfolio of patents, to my knowledge, we haven't really seen what Palm has, though its statements seem confident. It will definitely be something very interesting to watch over the next year.
  • HereAndNow · 10 months ago
    If it turns out that Apple's multi-touch patents are defensible in court then it may be difficult to include it in the generic Android base. However, vendors could conceivably license the technology from Apple, so that it can be included with their Android devices. After all, the device vendors are the ones that make money, when Android ships, not Google.
  • TedHoward · 10 months ago
    That's true. It would allow for multi-touch to make its way into some Android devices and would allow those device makers (or the distributing NOPs) to differentiate from other Android devices.

    I'm not sure if Google would appreciate all such efforts, as it may also fragment the Android platform to the point that some apps work on some devices but not on all. Taken to an extreme, one could fork Android to make a more customized version that breaks APIs. OTOH, I don't know Android's licensing or API's.
  • Umesh · 10 months ago
    I think i know whats Intel doing. They are putting Android into a chip so that they can take off the hard disc from the comp. The online GDrive will be used instead. :P Well thats my wildest shot at it :-)
  • Constantine · 10 months ago
    I'm going to have to call bullshit on this one. The only reason multi touch didn't ship on the G1 was the tight deadline Google imposed on themselves when they promised that a device would hit the market by the end of 2008.

    Multi touch drivers are not easy to write and I'm sure multi touch is on the roadmap. Why would HTC put a capacitive screen inside their device when they could have put in a cheaper resistive touch screen to cut down on the bill of materials? Something tells me Google wanted to ship with that capability from day 1, but could not.

    Anyway, we'll see what happens; 2009 still has a lot of months left in her!
  • MG Siegler · 10 months ago
    Well they've had almost a half year extra now to do it and still no dice. And it's not showing up in any of the working builds, even though hackers have been abel to do it. And given all that we're hearing about Palm drawing Apple's gaze with its multi-touch use, do you think Google is really jumping at the chance to test the legal waters as well? Call bullshit all you want, but all of these things are out there.
  • Constantine · 10 months ago
    The whole Apple vs Palm thing was blown out of proportion since companies like those two do not fight over individual patents, instead they use their lump sum of IP when entering private negotiations. Palm has plenty of patents, as does Apple.

    Back to Google, half a year is still not very long comparatively speaking from a platform development perspective. Multi touch as an input method has to be baked into Android and accessible to all application via standard APIs. With the video you embedded above you can clearly see that while multi touch works, it is not the smoothest experience.

    If I was Google I would want to work on that.

    Like I said, 2009 still has a long ways to go. Multi touch is an inevitability across all mobile platforms.
  • matthaus · 10 months ago
    I agree with your sentiment that "the whole Apple vs Palm thing was blown out of proportion."

    However, as in recent Android posts I would like to point out some VB editorial policy stuff. We only report rumours if we have a way to double-check them. And we did as always.

    On top of that in this case I can actually argue our opinion via some facts you can check yourself. The Multi touch hack is 2 months old by now. If you look at its code you'll find that it is original and commented Google code. However, Google decided to take out that code at some point. You'll still find some images in which the original Google code is in, though.

    We tend to disagree on some points within VB, too. Personally, to me the whole discussion on what G1 hardware does is boring from day 1. I would not have cared if HTC decided to install Android on a '89 Soviet device. MG, however, likes to repeat his opinions on the keyboard etc. We'll see a lot of Android devices and what they are able to do is for OHA/the mobile eco system to decide.
  • Constantine · 10 months ago
    Did not know about the fact that multi touch code was commented out, thanks for pointing that out and correcting my error.

    I can only hope that MG Siegler is wrong concerning the gentlemen's agreement to disable multitouch, for the sake of innovation in the mobile industry.
  • R · 10 months ago
    MULTITOUCH CODE WAS NEVER COMMENTED OUT.
    If you watch lukehutch's videos of what works on g1 and what doesn't, you would learn that multitouch isn't actually built into the hardware. He uses a simple additional information available to make it look like apple's multitouch.

    Difference:
    iPhone uses a touch screen with individual wiring to each touch point (each pixel).
    G1 uses a touch screen with a simple grid where x, y axis merge. (See the mentioned video to understand).

    But yes Android isn't the limited one. Google has all rights to modify android to support the iPhone's hardware too. But till the patent nonsense is sorted out, it might be used on an iPhone only.

    It is just a matter of time before Apple gives in.
  • Constantine · 10 months ago
    Actually, here is what the guy who made the multi touch hack in the first place had to say:

    "By uncommenting a bunch of lines in the synaptics touchscreen driver, and recompiling my kernel and replacing my boot.img - I was able to enable the debug logging of the touch input that tracks 2 fingers."

    Source: http://www.ryebrye.com/blog/2008/11/17/proving-...
  • matthaus · 10 months ago
    Thanks Constantine, for pointing out this post. I've forgotten about it.

    @R. I will not get into an examination of available code and commentary simply because I don't have the time for it.

    We don't write stuff under the pretension that we know what Google/OHA is exactly doing. We don't and we've repeatedly said so. We only write about stuff we can report on and we are comfortable reporting.

    It is our view that most of the discussion in the media on what functionalities are enabled by Android is foolish. When talking to different OHA folks early on it became clear to me that the status of these issues changes extremely fast. Android is only partly a debate on what technically is possible. For us it us much more important to view it as a constant negotiation on how OHA members want to use it for their purposes. As media we only can give updates on what the status of these negotiations is & point our readers towards the relevancy of the news.
  • Koush · 10 months ago
    RyeBrye was just uncommenting debug code. He didn't fully understand the code and realize that multitouch was supported at the driver/hardware level, but not at Android Java API level.

    Luke Hutch and I both confirmed this.

    "It looks like the stuff you uncommented is just debug code, and the driver is still in fact reporting 2 finger tracking:" - Koush
    http://forum.xda-developers.com/showthread.php?...


    "Actually, it turns out that if you read a little further down in the driver code (lines 187-200 of synaptics_i2c_rmi.c), you’ll notice that you don’t need to recompile your kernel at all to get multitouch working on the G1 — the kernel driver in fact already emits multitouch information!" - Luke

    http://lukehutch.wordpress.com/2009/01/10/full-...
  • Luke Hutchison · 10 months ago
    I'm the guy that implemented the multitouch solution shown in the video above. Forget the conspiracy theory. There isn't a trace of implemented-then-removed multitouch code in the Android codebase, I have been through pretty much all of it that has anything to do with event processing, from the low-level kernel driver to the singleton class that receives events across the JNI bridge to the event processing pipeline. The kernel driver always supported multitouch because it is based off of generic synaptics code that already supported multitouch.

    My conclusions after going through the code and scouring the web for reasons why it wasn't implemented in 1.0, as well as conversations with Google employees and all sorts of interactions with the community since the multitouch release are the following:

    (1) The G1 was simply never intended to be a multi-touch device. HTC didn't spec it that way (their top leadership came out and said "it was designed to be a single-touch device"), Google didn't ask for them to design an MT-capable device, it wasn't on Google's list of things to do for 1.0.

    (2) Apple's multitouch patent may not even cover the pinch gesture. So far they have not even approached me with a C&D, and I don't expect they will. (And anyway, I never made a cent off of this, and I am doing no more development on multitouch now that the capability is out there in firmware images that you can flash on your own phone.)

    (3) Google *is* interested in multitouch capabilities, it's just nowhere near the top of their priority list. Anyone in the community could step forward today with a well-designed extension to the MotionEvent class that properly supports MT, and the Google guys and gals would vet it just like any other community submission, and it would stand as good a chance of making it into the codebase as anything else. (HOWEVER the Google Android engineers have been rushed off their feet for about the last two years straight, including lots of late nights and weekends, and the pace sped up if anything after 1.0, so they are so busy with their own internal priorities that the Android *platform* is only a community project in name at the moment, because the ones that can actually commit to the repository at the moment are mostly/all(?) Google engineers, and they're just plain flat-out busy... time will tell if that changes, or if their community module ownership handout system works.)

    (4) Google will deal with legal issues if and when they come up, but that hardly stops them doing something they think should be done. Take a look at Book Search and YouTube ;-) (I know, I used to work at Google on Book Search...)

    (5) Apparently the driver for a resistive MT-capable/iPhone-like touchscreen was checked into the git kernel tree after the 1.0 release, so we now have (at least?) two MT-capable drivers in the tree. This is barely surprising given the huge number of Android devices of every form factor currently in the pipeline. You can bet somebody wants to market the devices even if it means licensing from / fighting with Apple.

    (6) I could go on, but basically put away your tinfoil hats, people.
  • Luke Hutchison · 10 months ago
    One more thing: if you really want to know what happened with Android 1.0, read through the Android platform source. All of it. Or as much as you possibly can in the next year or so. You will quickly come to realize that the pulling-together of Android in the short period of time over which it was accomplished constitutes one of the greatest software engineering accomplishments of our time. The code is, for the most part, polished, clean, well-written, low on bugs and seamlessly integrated. I don't know how on earth they managed to (a) write (/acquire :) ) that amount of code in such a short time, (b) so seamlessly integrate the efforts of what must have been a very large number of programmers, and (c) somehow also build a complete working lightweight linux distribution, an Eclipse IDE and debugger, an entirely new VM, and (working with HTC) an actual physical device that stands to be one of the best physical 1.0 releases of a complex device of all time.

    Once you catch the vision of that, you will understand why MT conspiracies are ridiculous -- why would MT or other bling even be an issue when you're trying to accomplish so many far more difficult engineering tasks and meet a shipping deadline?
  • matthaus · 10 months ago
    Thanks for your extensive and valuable input, Luke. I would appreciate it if we could chat at some point (matthaus AT venturebeat).

    We actually did read the code early on. All of it. I co-sign your wish that people should do so as it's worth the time if you are in mobile. I actually co-sign your whole last comment if I may.

    Look at my author profile and you'll see that we embraced covering Android extensively back in July. Back then various tech media folks felt we are idiots because of that (they may be right, but that's another issue). You'll also see that we also talk frequently to people, do some of our own research, play around with code, build some minor apps.

    Personally I don't believe any conspiracy theories here and continue to be disinterested in any iPhone-Android platform-Pre-whatever phone comparisons. That's not been the rational behind MG's story, either, as I said before.
  • FrankT · 10 months ago
  • MG Siegler · 10 months ago
    I fail to see where I wrote that Google took out multi-touch support that it initially had in there. So nice job debunking...something. Hope you get some decent traffic.
  • Cill · 10 months ago
    You're incorrect. Apple owns all the Multitouch patents. Basically, any phone with a touchscreen is voilating that patent. Any such company that produces these products should be shot. Apple has the best phone out there. Best computers, best music players, best everything. They cant be topped. Ever. It's only fair that the originator of an idea keeps that idea for the very best products made by his company and no one else's. You don't want the public confused. That's the worst thing. People who buy the G1 and other touchscreen phones are confused or too cheap to afford the best, which is the iPhone. Apple has all the patents and it was absolutely right of them to warn Google of infringing on them. Apple should sue the hell out of them if they keep it up. And I hope they do.
  • R · 10 months ago
    Article is a crap. No source pointed. No google employee said anything so in specific. Didn't know venturebeat allowed rumours to be "created". Bad idea
  • MG Siegler · 10 months ago
    Oh, didn't realize you set the policy for what other people can and cannot say. Thanks for clearing that up. No source pointed? Your second statement contradicts your first.
  • garazy · 10 months ago
    Does Apples patents mean only they will ever be able to create multi-touch devices? That seems crazy.
  • MG Siegler · 10 months ago
    We'll see. A lot of company's have multi-touch patents of some kind. Sadly, it'll be a legal matter.
  • Kontra · 10 months ago
    "Multitouch is so obvious..."

    Right. The whole mobile industry had a decade to ship a device comparable to the iPhone, but apparently chose not to. The iPhone was so obvious, two years later there's still no competition. But I digress.
  • Michael · 10 months ago
    Clearly, the iPhone != the idea of multitouch. Few people argue that the former was innovative, but the idea that someone should own the latter is absurd. It is in fact so absurd that even the often screwed up software patent system doesn't grant apple that right.

    See for example here:
    http://www.engadget.com/2009/01/28/apple-vs-pal...
  • lauri · 10 months ago
    in a recent interview with nokia's director of UI design mr mattila, it was mentioned that nokia has had patents on multitouch since 2003 (nokia did release their first touch device in 2004)... now, i'd love to see whose (apple vs nokia) patents prove to be enforcable.
  • mobinauten · 10 months ago
    I would like to suggest, we, developer and G1 users, should write an Open Letter to Apple to opensource this technology.
    Oliver
  • Sean C · 10 months ago
    What if you dont have two hands, I guess your just out of touch with this technology
  • VietRiceboy · 10 months ago
    you don't need two hand.. just two fingers.
  • clevetbs · 10 months ago
    ha ha ha, i already have multi touch on my G1 Tooo darn bad Apple
  • KDiddy · 10 months ago
    It's interesting that Microsoft is always blamed for being anti-competitive, but it has never asked a company not to innovate. Could you imagine MS asking Mozilla not to make a web browser and they comply? This is absurd. Apple should beat Google with their product, or their marketing, or understanding of consumers. Anything, but using patents to stiffle innovation. Because trust me, IBM and MS have the patents to keep the industry frozen for a long time.
  • eitan · 10 months ago
    this is why folks shouldn't buy apple. but they just don't get it. the next time apple unveils a pretty pretty shiny shiny new device, everyone will flock to it again, regardless of whether it shackles you to eternal servitude.
  • MG Siegler · 10 months ago
    Well, I think Apple might argue that its IP is the reason TO buy Apple.
  • Arn Lessink · 10 months ago
    Jesus Diaz wrote a great comment about this article over at http://i.gizmodo.com/5150354/apple-stopped-mult...

    >>
    Completely drunk sources also claim that Google's CEO Eric Schmidt likes Steve's tempura tofu too much to risk his gourmet pleasure over a stupid phone. And when I say "his gourmet pleasure," I really mean "his gonads."
    <<

    Jesus puts MG Siegler clearly into the same league as Apple-shill and pseudo-journo Jim Goldman 8-)
  • LukeHutchison · 10 months ago
    Whoever R.. is right about the hardware..
    HTC Dream doesn't have what iPhone has.
    Synaptics driver provides what is available even in a macbook.
    Two finger click & scroll etc are used in macbook's touch pad.
    This part of the internal code alone was commented out.
    This is not protected by any patent.
    Synaptics provides it and has to deal with it for itself.
    Patented gestures are short-lived and can be easily countered
    by a slight change.

    That is very different from multi-touch used and patented in iPhone.
    It has a matrix of touch sensors, one for almost every pixel manufactured by a German co. 'Balda'.

    With HTC Dream, it would be impossible to detect jerky rotations, quick spin-unspins etc.

    Android is not HTC Dream / G1 / ADP1 / ...
    Even if it were, Apple's patent doesn't hold much against supporting this hardware.
  • Luke Hutchison · 10 months ago
    I don't know who this guy is, claiming he's me, but he's not Luke Hutchison and I didn't write this. I'm the real Luke Hutchison :-)
  • AgentSmith · 10 months ago
    Matrix has made copies of Lukes.
  • Gregg Oldring · 10 months ago
    This raises a larger issue of the value of our current intellectual property laws. Too often they seem to inhibit rather than encourage innovation. I feel innovation benefits society as a whole.

    It's time to scrutinize our IP laws and ensure that they are still fair and beneficial. I see plenty of room for improvement.
  • IsaacM · 10 months ago
    I acknowledge that apple makes hot-tech stuff. But I hate how they rip off the world. Comparison: google lets you use all internet tools and goodies, and the price you pay (for now) is a bit of unobtrusive advertisement; apple lets you use nothing unless you pay dearly for it (no apple clones).

    Therefore, if I could, I'd make free applications for android that implement all the multi-touch stuff and more. All for free. Nor google, nor HTC (or whoever makes the phone), nor me get money, but we bust apple's extreme greed.
  • Wayne · 10 months ago
    I'd rather operate my touchscreen phone with a single thumb on the screen, a scroll wheel, a keyboard or other actual buttons thank you very much.
  • @JoeHobot · 10 months ago
    I sometimes don't get it.

    Apple made smart move to patent multi-touch since they knew that somebody else would want it.

    By law I would not allow Apple to patent that just because things like that stop technology to advance further. Apple is not the only company that has smart dev team.
  • Jerry · 10 months ago
    Hey LiveCrunch, maybe you don't get it because you are an incompetent blogger with no idea about the tech space. Get a life,, change your name and go work as a salesman for Helio.
  • @JoeHobot · 10 months ago
    Go play with Tom, Jerry!
  • applesktc · 10 months ago
    Apple's patent claims, both new and purchased, are baseless because, when tested in court, they will fail the prior art clause. They are simply not novel. There are numerous extant examples of prior art for multitouch dating back to the early 1980s, and it's notable, and even damaging, that Apple's most recent claim did not even acknowledge the prior art even though one of the lead "inventors" wrote his thesis on the prior art of multitouch in the late 1990s.
  • what · 10 months ago
    Absolutely. I can't see how Apple can make any meaningful claim to this technology, Google have caved in to the kind of patent bullying that is ruining software development.

    Yet again, Google fails their own "do no evil" standards. The company is sad a joke that makes Microsoft look virtuous by comparison.
  • LinuxAddict · 10 months ago
    The thing which wonders me is why the multi touch has patent issues. come on.. palm is the one introduced the touch screen concept which didn't stop apple, google, etc to from using it. Now what apple is does what M$ has been doing it for long time. Kill the competition..




    ~LInux Addict
  • matt · 10 months ago
    KDiddy: "It's interesting that Microsoft is always blamed for being anti-competitive, but it has never asked a company not to innovate."

    Oh, they sure did. And MS asked its competitors, not what could be described as its strategic parnters.

    www.businessweek.com/microsoft/updates/up81022a...

    http://news.cnet.com/Apple-Microsoft-was-on-war...
  • Myself · 10 months ago
    Well,

    I can't say my name, and I can't give any source, but it's true than Apple does put pressure on Google for not adding feature, or even removing existing feature from Android which were not yet published. Theses pressures are not done through official PR but just in private between founders.

    Apple brings a significant number of search through Safari and Google does not want thoses requests to go away with Apple replacing this with yahoo or whatever search engine.

    Some removal requests are really stupid, they can be about the screen unlock pattern which has to be 4 digits long instead of 3, or how the scrollbar should react to touch.

    The good part of Android is its open source license and I just hope theses features will be added by independent developers. However independent open source developers are usually very bad at UI and they don't have much ideas about design, sadly. It involves spending too much time on something they don't care for most of them.
  • stucktrader · 10 months ago
    Well all this conversation about Android would be a moot point had Apple made the iPhone available to T-Mobile... and drop this ridiculous subscription sharing model. Then again, think about it. Even if customers of AT&T never buy another iPhone, Apple gets a piece of their monthly.

    In the end Apple could have conquered the U.S. market had it not signed an exclusive with AT&T.
  • Cill · 10 months ago
    And it's a damn good thing Google complied! These are APPLE patents. No phone can possibly beat the iPhone. Ever. No one infringes on Apple's technology, because it's simply second to none. If someone takes their idea, they will go after them, and that's only right. It makes perfect sense.
  • Deep Touch · 10 months ago
    Google also left out the swipe gesture for browsing photos...at Steve Jobs request.
  • jorge · 10 months ago
    Microsoft should do the same against Google. They should stop copying their word applications, internet browsers, contacts and everything else google makes lol...
  • Flooring · 6 months ago
    Not sure if this really is market manipulation of is there something else going on
  • Eglence · 6 months ago
    Therefore, if I could, I'd make free applications for android that implement all the multi-touch stuff and more thank you nice wrok.
  • jay · 10 months ago
    If this is true, then this is collusion and market manipulation. If Microsoft did this, you would scream, shout and the authorities would hit hard. This now needs to be investigated.
  • Steve D. · 10 months ago
    Huh? Look up what collusion is. That's just being smart and avoid a giant lawsuit.
  • RottenApple · 10 months ago
    Yet another reason I'm getting an Android phone eventually...

    Multitouch is so obvious that to expect it to hold as a patent in courts is unlikely. "Wow, touching more than one finger to a touch screen? AMAZING INNOVATION!"

    I want multitouch on Android -- to the point of it being necessary because it's such an obvious/basic functionality to use more than one finger. I highly doubt Apple's patents are truly unique and non-obvious since I've seen multi-finger resizing in tech dating back many years. I expect to fully see it in Android (and not just from a developer mod).

    I'll be very disappointed in Google if they don't get with it very soon and not let Apple run wild and dominate with obvious technology. Hurry it up, Google!