Rupert Murdoch Says Google Is Stealing His Content 504
Hugh Pickens writes Weston Kosova writes in Newsweek that Rupert Murdoch gave an impassioned speech to media executives in Beijing decrying that search engines — in particular Google — are stealing from him, because Google links to his stories but doesn't pay News Corp. to do so. 'The aggregators and plagiarists will soon have to pay a price for the co-opting of our content,' Murdoch says. 'But if we do not take advantage of the current movement toward paid content, it will be the content creators — the people in this hall — who will pay the ultimate price and the content kleptomaniacs who triumph.' But if Murdoch really thinks Google is stealing from him, and if he really wants Google to stop driving all those readers to his Web sites at no charge, he can simply stop Google from linking to their news stories by going to his Web site's robot.txt file and adding 'Disallow.'"
Dear Mr Murdoch (Score:5, Insightful)
If you don't want to be hyperlinked to, you might consider
not putting your content on the worldwide web.
Dolt.
Re:Dear Mr Murdoch (Score:5, Informative)
Or make your site subscription-based. Of course you might want to talk with the guys over at Slate first to see how well that works out...
Re: (Score:3, Informative)
A good few years ago now, Rupert had certain sections of The Times and The Sunday Times as subscription pages, certainly the archive section was subscription (basically any story over a week old went into the archive which you had to pay to access). They even had a CD-ROM of The Times archive (I remember using it at university - it only went back to about 1990 articles IIRC). Not enough people paid up to justify running the "archive", so it was removed and now we have the free for all, so long as Rupert all
Re:Dear Mr Murdoch (Score:5, Insightful)
Sorry people, but Murdoch has a point. Professional reporting takes time and money, and if no one pays for it, it's not going to happen.
His advertisers are paying for it. His subscriptions (if any of his sites are subscription based) are paying for it. News sources deserve to make a profit if there product warrants it in the general capitalistic model. But Google should not be paying for it. That's like asking for money from someone who tells a friend to check out a wall street journal article because they thought it best answered the question their friend had.
Re:Dear Mr Murdoch (Score:4, Insightful)
Professional reporting is dead, and nowhere demonstrates this more elegantly that Fox News.
Precisely because its expensive to send out correspondents to do real reporting, big media has stopped doing it. Having Bill O'Reilly throw a tantrum at some unsuspecting guest is cheap and grabs ratings.
Consider the recent turmoil after the Iranian election; twitter contained almost as much information as the big news outlets (who were, in some cases, reporting what was on twitter). How many of them actually had guys on the ground in Iran? I can't think of a single one, because it would be expensive and dangerous work. So the news sites did what the rest of us did and looked on twitter. If they do that, then why are they needed?
Re:Dear Mr Murdoch (Score:4, Informative)
Precisely because its expensive to send out correspondents to do real reporting, big media has stopped doing it.
In the last couple of months hundreds of adverts have appeared in London (mostly on the Underground) for the Times saying how they have lots of science correspondants. Although having just searched Google for one to check I remembered it correctly, I'm no longer as impressed [theregister.co.uk].
Re: (Score:3, Informative)
Incidentally, the BBC had a reporter in Iran -- at least until he was expelled [guardian.co.uk], I don't know what they have there now.
Re: (Score:3, Interesting)
We have too much news as it is. There isn't enough interesting things going on to justify numerous 24 hour news outlets. Imo, this is why some are sensationalising news and effectively turning opinion into fact too.
We don't need that and it's damages society.
We could do with these big news corporations falling apart. Go back to more localised news and if you want to find out about news outside of your area then go to Google.
Re: (Score:3, Interesting)
As newspapers go out of business the value of the remaining ones will increase. It will mean more valuable advertising space, more readers, perhaps even a desire to pay for some more specialized news.
That's the key point there. If you go to Google News and find an article on something even remotely national newsworthy, you'll see their little link at the bottom "View 3000+ news articles . . .". Most of them say pretty much the same thing over and over. That's an over-saturated market. Of course some are going to go out of business with the transition to online news simply because a single provider can reach a much larger number of subscribers.
The ones who figure out how to survive in the market wil
Re: (Score:3, Funny)
I love the smell of a price fixing cartel in the morning.
Re:Dear Mr Murdoch (Score:4, Insightful)
Additionally, if you want to be on the web but not listed by google there is a "bots" file. Dunno if that works with news aggregation but there's probably some way for little guys like Rupy to opt-out.
Oh my but the he wouldn't be paid would he?
Re: (Score:3, Insightful)
Mr Murdoch may be simply quite too stupid to understand the plumbing of the internet and that he indeed does have control of some of the values, ie Robots files. His father (or grandfather) was probably indoor plumbing-challenged too, with all those levers and values on toilets, etc.
At some point, old age, impacts the ability of some people to understand new things.
Mr. Murdoch may be an example of the old dogs and new tricks syndrome.
Given his personaility, it is probably unlikey that given his nepotistic
Re: (Score:3, Funny)
What 21st century? (Score:3, Interesting)
This is similar to authors who complain about their books getting listen in catalogs with excerpts (?) from their books, or horror of horrors, libraries.
Murdoch ain't even smart enough to come up with new idiotic complaint.
Re: (Score:3, Funny)
Re:Dear Mr Murdoch (Score:5, Insightful)
Re: (Score:3, Interesting)
Hmm... not convinced.
I do remember reading an article that said he has his emails printed out and brought to him...
He's probably wandering around NewsCorp HQ right now, trying to find the typing pool.
Re: (Score:3, Funny)
Re: (Score:3, Interesting)
That's rather the question, as he'd presumably still want to appear in Google search results outside of Google News. So a simple Disallow wouldn't *quite* do the job; he'd have to be able to disallow only the news aggregators, which would only be possible if they had a different signature to regular Googlebot.
So he may have to just dissallow everything, which would be fair. Is there any way, as a community service, way we could all chip in a few bucks and buy him an
Re:Dear Mr Murdoch (Score:5, Funny)
You have to look at it from his perspective.
Basically his perspective is "Someone else has money. I want it." ...
Not the best perspective by my standards, but he has many times more money than I do, so who am I to say he's a F*#@#ing idiot.
Murdoch is not a technophobe (Score:5, Insightful)
He doesn't want Google or anyone else to stop linking or he would have already stopped them by technical means, what he wants is a slice of Google pie, the bigger the slice the better. If he thinks ordinary people can't see through his feigned "push for paid content" then his sense of entilment must be at least an order of magnitute larger than his media empire.
Re: (Score:3, Insightful)
He doesn't want Google or anyone else to stop linking or he would have already stopped them by technical means, what he wants is a slice of Google pie, the bigger the slice the better.
Google is fairly high on contention for "most profitable site on the 'web." A big reason for why they are so profitable is that they have a trusted search engine & an only sliightly-less-trusted news aggrigator. Both of these two exist by pointing to work someone ELSE is doing.
Now, Google's all fine and dandy with not getting any direct revenue from these things -- they get trust, and knowledge, which let them sell the ads that bring in all that revenue.
Murdoch's News Corp, otoh, is on all fronts doin
Re:Murdoch is not a technophobe (Score:5, Insightful)
The line between professional blogger and professional journalist is an increasingly murky one (from day to day I'm not even sure which I am, but its definitely one or the other), and even if some of the major "dead tree" media sites haven't figured out how to make money there are a lot of others that do, albeit on a smaller scale.
But is that really a problem? I look at it like the OSS industry: there may never be the sort of revenues in the free software world that there was in the commercial software world, but plenty of open source projects/companies are profitable, and so long as the product is better, who cares?
Google isn't the problem here, and they're just being used as a scapegoat because they make money and other people don't. But I don't hear Canonical griping to HP just because HP is making a profit on their hardware and people just download Ubuntu for free, one of the few things that makes an HP system remotely usable.
The "old media" types have an outdated business model, but they also increasingly have a credibility problem. Most of their highest priced talent has gotten very sloppy in recent years, and a lot of them just pick their favorite politician or party and parrot the official line until told otherwise. Show me a well known newspaper columnist of the last ten years and I'll show you someone who has repeatedly claimed Iraq had weapons of mass destruction.
Re:Murdoch is not a technophobe (Score:5, Insightful)
I wouldn't be surprised if Murdoch's beef with Google is not that Google makes the money, but that Google retains the audience. People go to news aggy sites, rather than entering into a News Corp empire portal, going to a News Corp source, and ultimately staying within the News Corp family throughout their visit. The latter is far more valuable than sharing ad revenue for a single article impression.
Re:Murdoch is not a technophobe (Score:5, Insightful)
because we are FAR better served as a country by having professional journalists and bloggers, than by having bloggers alone.
While I agree this statement on the basis that by "professional journalists" mean people who "reported fairly and factually on world events important to most people". However, I have to contend that most (but not all) "media" we see day to day, including Murdoch's, are NOT populated by "professional journalists".
The only "professional" about most journalists we see in the media are only the sense that they get paid, i.e. it is their "profession" as a journalist.
About "actually do research and write something", most media companies are only doing the "write something" part, and are seriously lacking in the "do research" part. Note that I said "most", I admit there are a few journalists out there that really "do research and write something".
So, given that the current business model only give you a handful of real "professional journalists" mixed in sea of "journalists" not much better than bloggers, I am not sure what is the value of preserving this business model by having Google pay those media companies. It is the same argument for supporting RIAA because a few of their "artists" are really talented and deserved to be paid. Well, I suppose most people would think there should be a better business model to achieve that goal.
Google is fairly high on contention for "most profitable site on the 'web." A big reason for why they are so profitable is that they have a trusted search engine & an only sliightly-less-trusted news aggrigator. Both of these two exist by pointing to work someone ELSE is doing.
While this is somewhat off-topic regarding Murdoch, I think this statement downplayed the value Google is providing.
Consider this, there are lots and lots of knowledge available in the world, both static like a cooking recipe, or dynamic like the news or a blog. But the fact is, for most of human history, these knowledge are not available cheaply and timely to most people. What Google did is making the knowledge that already exists on the web available to anyone, that alone is providing tremendous value to most people, and I congratulate them for thinking of a business model that can also make a profit doing it.
Re: (Score:3, Insightful)
Consider this, there are lots and lots of knowledge available in the world, both static like a cooking recipe, or dynamic like the news or a blog. But the fact is, for most of human history, these knowledge are not available cheaply and timely to most people. What Google did is making the knowledge that already exists on the web available to anyone, that alone is providing tremendous value to most people, and I congratulate them for thinking of a business model that can also make a profit doing it.
Oliver's point about the value of Google's service is a point lost on most armchair entrepreneurs these days.
Too many of us get hung up on "creativity" being the only valuable service you can provide digitally, the product of which becomes some kind of "product" which should then be marketed to the masses by least efficient and most pocket-lining means possible.. be that Murdock, RIAA, PRS, whoever.
We then disrespect any second tier services that may organize and present this information to you in a meaning
Re: (Score:3, Interesting)
Murdoch's News Corp, otoh, is on all fronts doing what everyone else in the "actually do research and write something" industry is doing -- losing money.
Do you not mean the "rewrite stuff from press releases and news wires, distorting it to suit a political or business agenda" industry. People will pay for good content: It works for the FT and the New Scientist.
professional journalists and bloggers, than by having bloggers alone
Most of the blogs I read are better than anything the journalists produce. For example, I get news on the economy by reading blogs by economists, rather than a journalists summary of what he or she half understood after interviewing economists.
Re: (Score:3, Insightful)
[citation needed]
Re:Murdoch is not a technophobe (Score:5, Insightful)
I think you're giving the man too much credit. You're reasoning is that because he knew a technology back in the 80s he should be aware of how technology works 20 years later and in a completely different medium.
It seems to me that this is more of a cause of him not understanding exactly how the internet works. Especially since he calls them "plagiarists" and "content kleptomaniacs*", which implies he thinks that they somehow are copying and keeping his content. Maybe he was just trying to be dramatic to get more attention, but I'm still pretty sure he's not exactly sure what it means when a search engine links to the page of a website without going through it. (This is guessing a lot, but I tend to think he believes that if he goes to paid content using a Google search will bring you to the content by going around the page that asks you to pay for it.)
*Google probably is the definition of a content kleptomaniac. They store all your information on their servers forever and their terms and agreements state that pretty much any content you e-mail, use their hosting service for, or put in any of their other tools becomes theirs. However, them being a search engine is pretty much their only service that they aren't kleptomaniacs about.
Re: (Score:3, Interesting)
He was certainly making expensive business decisions about internet companies in 2001, so unfortunately for us all that makes you the one that is out of touch while he has had his finger on the pulse for more than a decade.
Murdoch understands it all right, the problem is he is quite happy to try to
Re: (Score:3, Insightful)
It's not so much that he wants a bigger slice of the pie, its that he has to talk up every other newspaper in to going to a charge for content model before he turns off Google. If Google was smart, they would simply stop crawling his sites until he comes back begging. Murdoch owns most of the newspapers that aren't going to die in the next few years but he owns lots that will be dead in a less than a year and I think he is spooked by the numbers. For the last few decades the newspaper was paid for by ads
I think his viewpoint is just different (Score:3, Interesting)
Murdoch might be looking at things differently
First, he has come to the conclusion that people don't type in http://www.google.com/ [google.com] to an address bar to visit Google, they're going to Google to eventually go somewhere else.
Second, he probably feels that his newspapers get a lot of web traffic. I have no idea, I'll assume they do.
Third, since he seems to own most of the major newspapers these days, he's probably convinced himself that he is an important part of the internet.
Fourth, he realizes Google is mak
Re: (Score:3, Insightful)
You might want to consider breaking your, er, writing up into paragraphs. If you want anyone to read your posts, anyway.
Re: (Score:3, Informative)
It's not the paragraphs that are the problem, (Melvile got away with that) the content screams second language over an iPhone with the "ten random cliches" site open and a large bottle of Irish Whiskey.
After seeing [sic] after one of the few correctly spelt words I was amused, not that spelling really matters much anyway on a forum like this.
Sorry to be an annoying nitpicking bastard to new500 but the "freetard" insult is as annoying here as driving tw
Re:Dear Mr Murdoch (Score:5, Insightful)
That is the key: He wants the traffic, and he wants Google to PAY him for driving the traffic to him. It is kinda like Google adwords, except they pay you to advertise. (there is a soviet russia joke somwhere in there)
If he wanted to disallow Google, adding two lines to robots.txt is all it takes. This is just a money grab by someone who appears to really not "get it" about how the interweb works, and how there is simply more supply than demand when it comes to internet content of all kinds.
Google could simply choose to exclude Fox News from any spidering for news, but then RM would be suing Google saying they exclude him because they are (insert reasons here, such as "conservative"). Again, it is just a money grab by an old man who thinks "reading on the internet is like reading a paper, someone should pay for the right to read it", and you can't equate the two. It is more than just the medium that has changed.
Re:Dear Mr Murdoch (Score:5, Insightful)
Again, it is just a money grab by an old man who thinks "reading on the internet is like reading a paper, someone should pay for the right to read it", and you can't equate the two. It is more than just the medium that has changed.
Except that was never how newspapers worked, either, and Murdoch of all people should know it. Subscription fees and newsstand prices never did much more than pay for duplication and distribution. They certainly didn't contribute much, if any at all, to the costs of newsgathering.
So essentially in the old model news was free to anybody who bought a paper-- a paper full of advertisements, which are what really paid for the content to be generated. Advertisers knew how much to pay based on the demographics of the subscriber base and the paper's circulation.
Freed from the tyranny of ink and paper, content can now be delivered for pretty close to free-- so most of the time you don't need to subscribe or pay a newsstand cover charge, you just need to have Internet access. Advertisers, if they are thinking about it rationally, love this because unlike with newspapers and magazines, they know exactly how many people viewed an ad, how many people clicked it, and they may know a great deal more about that person, demographically, than they ever knew about any individual or group of individuals that made up a newspaper's subscriber base.
What I expect Murdoch is whining about is not Google Search. That does deliver him traffic. He's probably on about Google Reader, which uses RSS to present stories, whole or in part, divorced from the source's presentation (and thus its advertising). However I do suspect that like search, making content available in RSS does News Corp more good than harm-- if not, they could simply stop providing it.
If Google Reader is screenscraping News Corp sites then he's got a legitimate complaint. It's the equivalent of rip-and-read, but on the Internet.
Re:Dear Mr Murdoch (Score:5, Insightful)
News corp, and unfortunately a company I work for are getting it wrong time and time again with the whole digital age. They are expecting people to pay for a service that advertising has paid for since newspapers were invented. It's general knowledge in the industry that if there were no subscribers (ie, people paying), not much would change. As long as the paper is in people's hands and advertisers are willing to pay stupid amounts for space, everyone gets paid.
Re:Dear Mr Murdoch (Score:4, Insightful)
Actually, I have it on pretty good authority that Obama was born in Hawaii, is a practising Christian, prefers women to men, wrote a couple of insightful books, and got elected democratically to lead the world's leading democracy, rather than a communist nation. I also heard he won some prize recently, but I could be mistaken about that.
However, many people prefer to believe fiction rather than the truth. Feel free to dig for your own particular flavor of fiction if you are looking to blind yourself. It's amazing how many of us prefer such fiction to real news, which is one of the many reasons news providers are in trouble.
Re:Dear Mr Murdoch (Score:4, Informative)
Google News is what is he's complaining about.
He doesn't mind the search links, the RSS feed, etc.
He's complaining that Google News is gathering the content from his News Corp properties using their Googlebot, and taking all of the advertising revenue because Google places their own paid ads on the pages instead of the News Corp ads that would appear from the originating sites.
This is the same issue/complaint that organizations like the AP and Reuters have with Google.
Re: Free from influence (Score:3, Insightful)
I read a very apposite quotation about that just last night. Showing that some things never change, it is attributed to a journalist named Hannon Swaffer back in 1928.
"Freedom of the press in Britain means freedom to print such of the proprietor's prejudices as the advertisers don't object to".
Source: "Newspeak in the 21st Century, David Edwards and David Cromwell"
http://www.amazon.com/NEWSPEAK-21st-Century-David-Edwards/dp/0745328938/ref=sr_1_1?ie=UTF8&s=books&qid=1255263047&sr=1-1 [amazon.com]
Re:Dear Mr Murdoch (Score:5, Insightful)
This is where I really wish Google occasionally actually wrote the letters we pretend they do. For example:
Dear Mr. Murdoch,
As requested, we have stopped copying your content without permission. Unfortunately, this has resulted in your sites being removed from Google Search results, as our spiders have to copy content in order to index it. Sorry about that.
Re: (Score:3, Insightful)
Google should helpfully remove all links to newscorp owned sites. See how old Rupert likes that. He'd be crying in outrage pretty much instantly.
Re:Dear Mr Murdoch (Score:4, Interesting)
The old bastard may be old be he's not stupid, he gets it all right. The problem here is that he wants to change it all so that he can make money from things we didn't have to pay for in the past.
It's the old story about fencing things off and then charging admission. Murdoch has been very active in the internet space for well over a decade. I lost a job in 2001 after Murdoch bought the company I was with and kept just the small bit he was after to use for internet publishing. It wasn't just someone employed by Murdoch doing this, he was involved himself.
Anecdotes aside, it appears that he wants us all to pay him subscription fees and many things are in the way, google for a start.
Re:Dear Mr Murdoch (Score:4, Insightful)
He wouldn't stand a chance in court (Score:3, Interesting)
If google just stopped indexing all his "intellectual property", he'd be laughed out of complaining about it because of his now quite public previous statements. He's already dicked himself and he doesn't even know that.
And I think google should do this NOW and set a precedent by showing these online news content complainers exactly what they are asking for. And google has another ace in the hole, it isn't that much for them to just regurgitate the AP and other feeds either, they can afford i
questions, questions (Score:3, Insightful)
Why do i have to install and configure noscript and adblock when i go to a site, instead of they asking me politely at first visit, if i want to see their crappy ads?
I feel so sorry for poor little Ruppy (Score:4, Funny)
Must be absolutely horrible having all those evil search engines actually index his pages! I guess his robots files aren't working or something.
Maybe Google should sue for slander? (Score:3)
Afterall, he is making some specific charges here. I'd like to see his ass handed to him in court although I know the fine or whatever it is probably will be insignificant.
Right ... (Score:5, Insightful)
Media companies want Google to pay, not us (consumers). Because you can charge Google $X (where X has 7 digits) whereas to get consumer money, you have to produce a useful product.
Re: (Score:3, Informative)
Perhaps his new companies should try raising the bar on their quality rather than asking Google to fund their half assed "journalism".
Re:Right ... (Score:5, Informative)
Dude, go back school. 0.000001 only has one sigfig. 1.000000 has 7. 0.000001000000 has seven also.
Re: (Score:3, Informative)
Actually I'm pretty sure that putting .0000000010000000 the second set of 0's are still significant since you're indicating a level of precision beyond the 7 significant digits...
Uh...yeah, the second set of 0's are significant. The first set still aren't.
Maybe he doesn't know? (Score:4, Insightful)
Re:Maybe he doesn't know? (Score:4, Insightful)
If this involved google ignoring robot.txt or something, and crawling him without his permission, I'd be rather more sympathetic. As it is, though, these guys haven't asked for that, because they know that it is valuable to them; but are still whining about how oppressed they are. Fuck 'em.
Re:Maybe he doesn't know? (Score:5, Insightful)
Murdoch needs Google a lot more than Google needs Murdoch. All Google has to do is ignore Murdoch's content entirely until Murdoch learns his lesson or until his media empire collapses like the newspapers did. As for myself, I'm rooting for the latter to occur.
Re:Maybe he doesn't know? (Score:5, Informative)
Murdoch is not an Australian - he gave up his citizenship as soon as it hindered his US interests.
He's as American as any other immigrant.
On behalf of Australians everywhere, I'm sorry that he's your problem now.
A simple solution (Score:5, Insightful)
Re:A simple solution (Score:5, Insightful)
There. Fixed that for you.
Re:A simple solution (Score:5, Funny)
Re:A simple solution (Score:5, Insightful)
We subscribe to four weekly paper magazines and use Google News to see what's happening on shorter time scales. For me as a consumer, News Corp's stuff is distracting and annoying clutter when Google indexes it.
I for one, second ivoras' solution.
Re:A simple solution (Score:5, Insightful)
Re: (Score:3, Informative)
socialist
I don't think that word means what you think it does. The socialist solution would be to create a public newspaper, or in the case of extreme socialism, confiscating private newspapers companies. But you rarely here about socialist solutions nowadays, because there hardly are any real socialists in politics. Instead it is all about the government hiring private contractors, or the government paying money to private companies so they can build infrastructure. Or the government selling its property to private
A better solution (Score:5, Insightful)
A better solution would be for robots.txt (or a more secure equivalent) to allow google to know that they need to pay when their results come up in your search results. Of course, google will require the searcher (eg you) to pay to see those results. A simple click through would work ("click here to see this pay-per-view result - your account will be debited $0.01c"). Add another link at the top (and bottom) of the results for "Never, ever, show me pay-per-view search results again. It's a stupid idea and I hate it.".
The users are happy because they get to exclude search results from people who just don't get it.
Media empires will be happy because they got what they wanted (and unhappy as they go broke as they become invisible to the internet without understanding why, but that's not google's problem).
Google will be happy because all the companies that want this feature will finally stfu and go broke.
Wow... (Score:2)
I think we're all going to drown in Rupert's crocodile tears.
Re: (Score:3, Insightful)
Because they're the ones who ultimately frame the debate to us voters.
dear Rupert, (Score:5, Insightful)
Re:dear Rupert, (Score:5, Informative)
User-agent: * /printer_friendly_story /projects/livestream /printer_friendly_story /google_search_index.xml /google_news_index.xml /*.xml.gz
Disallow:
Disallow:
#
User-agent: gsa-crawler
Allow:
Allow:
Allow:
Allow:
#
Sitemap: http://www.foxnews.com/google_search_index.xml [foxnews.com]
Sitemap: http://www.foxnews.com/google_news_index.xml [foxnews.com]
Notice the sitemap section, they are directly telling Google what news they have
Please Google... (Score:2, Insightful)
Please Google, teach this old bag a lesson and kill all links to his website so we can no longer find any of his companies online. Do it!!! It would be a glorious day when we would be allowed to go to other news sources and let Murdoch die a slow death holding on to a fading newspaper.
Re:Please Google... (Score:4, Insightful)
Please Google, teach this old bag a lesson and kill all links to his website so we can no longer find any of his companies online. Do it!!! It would be a glorious day when we would be allowed to go to other news sources and let Murdoch die a slow death holding on to a fading newspaper.
As much as I hate Murdoch... all of those people that are just encouraging Google to teach him a lesson, you are also encouraging Google to be Evil. I dunno about you guys, but I, for one, don't want Google turning into Apple or Microsoft. We're the good guys, remember?!
Re:Please Google... (Score:5, Insightful)
Read between the lines ... (Score:5, Interesting)
if he really wants Google to stop driving all those readers to his Web sites at no charge, he can simply stop Google from linking to their news stories by going to his Web site's robot.txt file and adding 'Disallow.
Murdoch may be a complete asshole but he's hardly stupid: I'm sure his tech people explained to him that Google respects the Robot Exclusion Protocol. All the big boys do ... not to do so would be a. sleazy and b. stupid, since there are plenty of litigious fucks like Murdoch out there. The fact that he's making such misinformed claims in apparent ignorance indicates that he has another agenda, one of which we currently know nothing. Ultimately though, I think it comes down to an outfit like Google, with the stated goal of indexing all the world's knowledge, coming into direct conflict with those who wish to restrict access to knowledge for profit. What makes matters worse for the likes of Murdoch is that Google makes its money from other sources, and is not responsive to the same motivations and perceived threats as the incumbent news organizations. If Newscorp and every other such "service" were to disappear tomorrow, it would make little difference to Google's bottom line.
Re:Read between the lines ... (Score:5, Informative)
http://www.newscorp.com/robots.txt:
User-Agent: *
Disallow:
Hmm, so they have heard of robots.txt and already made the decision not to restrict any search engines...
Re:Read between the lines ... (Score:5, Informative)
Re:Read between the lines ... (Score:5, Funny)
Not only that, but the one on foxnews.com provides Google sitemaps.
That's too bad. Google's spider really has better things to do than index Fox News ... for example, my great aunt Betty's second cousin's daughter's wedding photos.
Murdoch not so smart, really (Score:5, Insightful)
Murdoch may be a complete asshole but he's hardly stupid:
You're falling into the trap of thinking that success in high places must mean competence. The world isn't nearly that sane. So long as the guy hires smart people and is smart enough not to put too many obstacles in their way, that's smart enough.
Being an asshole however does seem to be a pre-requisit to great wealth. If you're fair to everyone and share your wealth, you simply never get rich enough for people to know your name. (You may make enough to live comfortably and have a good life, but you won't get rich and people will try to take advantage of you).
There's also the illusion that if you're bad tempered and mean you're getting ahead because you "don't put up with crap" and "don't suffer fools" and "don't get emotional when it comes to the tough decisions". In reality you're just a lucky arsehole whose only talent is in exploiting people.
Re: (Score:3, Interesting)
umm.. I know lots of "computer literate" people who have never heard of robots.txt.. the vast majority of people I know actually. This whole internet thing is still just magic to most people.
Re: (Score:3, Insightful)
No.. and neither does Murdoch.
Re: (Score:3, Insightful)
No.. and neither does Murdoch.
True, and that's why I referred to "his tech people". Presumably he has advisors to help him understand the rudiments of what his Web operations are doing (at least, those parts that are relevant to his corporate strategizing), and I further assume that he's smart enough to consult them. If he's not, then silly comments about Google "stealing" content are to be expected from him. If he is, then he's dissembling for some other reason.
Re: (Score:3, Interesting)
Riight. 1. If I was one of Murdoch's techs I'd be keeping particularly quiet about how stupid he sounds.. and 2. I expect Murdoch wouldn't even consider the possibility that other people see things differently to him, let alone that he might be wrong about something, or not understand it fully.
Re: (Score:3, Interesting)
if google isn't in the least bit afraid of rupert and he knows this as well, it's just the game thats played at that level.
Re: (Score:3, Insightful)
He is just doing what he does best: Spreading FUD and steering public opinion. Some time ago there was an interview with the very same Murdoch proudly explaining how the purchase of MySpace would transform his media empire.
But he would rather see a world in which Google faces strong mistrust by people and their governments. That's why he is spreading this nonsense. What an imposter!
Google should follow his wishes (Score:3, Insightful)
And stop linking to his sites- he deserves it. And the resulting reduction in traffic to foxnews would make the world a better place.
Rupert Murdoch is something else. (Score:5, Funny)
I bet he thinks the dewey decimal system "steals" content from libraries by classifying and categorizing books.
The Irony... (Score:5, Insightful)
'The aggregators and plagiarists will soon have to pay a price for the co-opting of our content,
Considering that Murdoch owns MySpace and markets it to artists as a place where independents, and even established artists, can show their wares - in effect aggregating boatloads of content that is not his in the first place - the irony of his whining is almost too much to bear.
The online media world without Newscorp (Score:3)
Gosh, what tragedy. Guess we'll just have to suck it up and get by without their relentlessly negative hate spew.
Don't let the search engine door hit you on the way out bunghole.
movement toward paid content? (Score:5, Insightful)
The only evidence of a "movement toward paid content" that I have seen is Rupert Murdoch telling people that there is a movement toward paid content.
Re: (Score:3, Insightful)
But if we do not take advantage of the current movement toward paid content
The only evidence of a "movement toward paid content" that I have seen is Rupert Murdoch telling people that there is a movement toward paid content.
And you think it won't work? It worked with Iraq.
Just sayin'....
Re: (Score:3, Interesting)
Typical News Corp. Look at the recent Faux News bits about the tea parties - "OMG ITS SUCH A NATIONWIDE GRASSROOTS PROTEST!"
The entirety of his business model, it seems, is to come up with something and go on about how big a deal it is, until it actually becomes a semi-big deal.
Misinterpretation (Score:5, Interesting)
I'm not sure why some of you think he doesn't want Google to link to him - that's not what he says at all. What Rupert Murdoch wants is for Google to link to him and pay him money for the privilege. He's smart enough to know that his media empire, from which he's made billions, is dying - but he isn't smart enough to figure out how to transform his dying business into a new type that can survive and thrive in the new electronic world (but then neither has anyone else as of yet). So he's doing the only thing he can think of, which is attempt to shift the blame over to the innovators that are responsible for his industry dying.
Now, as the old media continues to die off, I wouldn't be all that surprised to see a company like Google make an effort to build a new media company with paid reporters and the like - but there's absolutely no reason that would involve someone like Rupert Murdoch, since he'd basically be relegated to the role of unnecessary middle-man.
Ronald Reagan put it best (Score:3, Funny)
Kick the fox out of the henhouse (Score:3, Insightful)
It is a difficult problem of our times how traditional news media can survive with the expectations we have of the internet. It is another difficult problem how one can combat news institutes that have contempt for real journalism and become institutes for advocacy.
While we figure out how to solve the first problem, we can use the first problem to help against the second. In the end, we're best off both with FoxNews/SkyNews gone and traditional journalism revived and (somehow) funded.
Real problem (Score:5, Interesting)
The real problem is simply answered. Can I, through the use of Google obtain Rupert Murdoch's content without ever visiting his site or seeing ads on his site?
If the answer is no, then someone doesn't understand.
If the answer is yes, then there is a real problem. I tend to think that the answer is yes on a couple of levels. First off, can I use a "Murdoch" headline and then read the content somewhere else? Yup, I am sure I can do that. Secondly, can I use Google to grab "Murdoch" content without visiting any of his sites? Yup, I can use the Google cache and never touch the original site.
Finally, doesn't Google show enough of the text to let me know if I really want to look at the whole article on the site?
No, this isn't anywhere near as simple as just using robots.txt to deter Google from indexing. This is using a service from Google to preempt other sites.
Re:Real problem (Score:4, Informative)
No, this isn't anywhere near as simple as just using robots.txt to deter Google from indexing.
Sure it is. If Google's spider is blocked from indexing "Murdoch" content by robots.txt, it's also blocked from caching any "Murdoch" content, the "Murdoch" headline never shows up on Google News, and there isn't any "Murdoch" text appearing to let me know if I really want to look that the whole article.
Murdoch has, in fact, deliberately made content available for free by and through Google. Before Murdoch took over the Wall Street Journal, all Wall Street Journal news content could not be accessed by Google News, and could not be obtained by using Google News or a Google cache. You could only get WSJ content by going to the WSJ site. After Murdoch took over the Wall Street Journal, all Wall Street Journal content was made accessible to Google News. Furthermore, the WSJ paywall was deliberately lowered to allow people to read articles on the WSJ site for free if they follow a link to the article from Google News.
Murdoch isn't letting Google access this content by accident or through ignorance. He has actively chosen to make this content available by and through Google. He can undo that any time he chooses, for any of his sites.
http://www.foxnews.com/robots.txt (Score:3, Insightful)
User-agent: * /printer_friendly_story /projects/livestream /printer_friendly_story /google_search_index.xml /google_news_index.xml /*.xml.gz
Disallow:
Disallow:
#
User-agent: gsa-crawler
Allow:
Allow:
Allow:
Allow:
#
Sitemap: http://www.foxnews.com/google_search_index.xml [foxnews.com]
Sitemap: http://www.foxnews.com/google_news_index.xml [foxnews.com]
Why does Google put up with this? (Score:3, Interesting)
"/Dear/ Mr. Murdoch,
In wishing to completely and speedily address your worries, we have permanently removed all domains owned by your corporation from our search index. You will now no longer suffer from an onslaught of non-paying visitors to your sites. With the best wishes, Google."
They should stop fucking around. Murdoch and the other paid-content-idiots know they can't do business without the search engines linking to them, and if they don't, it's high time they learned it. They need the search engines more than the search engines need them.
Re: (Score:2)
Simple. There are enough dumber people out there financing his operations.
Re: (Score:3, Funny)
Re: (Score:3, Insightful)
They'll be be money to be made for those who defect.
Re:google: another banker owned entity (Score:5, Informative)
Technically he is right.
No, he isn't.
And Google really do take without providing anything back.
Bullshit. As the summary stated: if Newscorp really was the victim here, they'd implement a robots.txt file telling Google to go away.
The problem is that if Google went away, Newscorp would lose business.
The rest of your post is even more idiotic than your first two sentences. (Come on, legal theft? If it was theft, it wouldn't be legal, asshat.)
You have every choice not to deal with them. It's perfectly possible to do without - there are other search engines, other webmail providers, other banner networks. If you have a website, you can even exclude them in your robots.txt if you want.
Re: (Score:3, Informative)