• On CBS.com: Sexy women of CBS
May 19, 2008 1:10 PM PDT

Web monitoring for ads? It may be illegal

Posted by Declan McCullagh
  • Font size
  • Print

Online advertising has ballooned into a roughly $45 billion-a-year business, to the benefit of Google, Yahoo, ad networks, and innumerable speciality and hobbyist Web sites.

One corner of this ecosystem that hasn't managed to cash in on advertising is, by some measurements, the largest: broadband providers. So it may have been inevitable that they would seek additional revenue by monitoring their customers' online activities and creating behavioral profiles that could yield hyper-relevant ads.

The only problem with this practice is that it may not be entirely, well, legal. The first warning sign came last week when two members of the U.S. Congress sent a letter to Charter Communications, a large cable provider, raising "substantial questions" about the legality of deep packet inspection and asking the company to hold off. (See our Q&A with a Charter executive.)

In interviews with News.com over the last few days, privacy advocates and attorneys pointed to a collection of federal laws--written in the 1980s when broadband services were merely a pipe dream--that combine to create a treacherous legal landscape for broadband providers that plan to conduct Web monitoring.

It's "a problem for cable providers because the very collection of personal information is prohibited without consent," said Al Gidari, a partner at Perkins Coie in Seattle, whose clients include Google and broadband providers. "It's plainly a problem for Charter. I'm amazed we haven't seen a class action lawsuit on this."

The problem for broadband providers is that intercepting customers' Web browsing, analyzing the protocols to see what's going on, and reviewing the packets' contents starts to look a lot like wiretapping. And there are federal and state laws, complete with civil and criminal sanctions, that broadly prohibit wiretapping.

It's unclear how many providers are performing Web monitoring for advertising, not least because all of the companies providing deep packet inspection are highly secretive.

Wide Open West is using technology from Redwood City, Calif.-based NebuAd, as it discloses in its privacy policy. Charter and (reportedly) Knology are experimenting with it, too. CenturyTel told us that "we are doing business" with NebuAd and that it did a trial of NebuAd's technology in one of its markets late last year.

Embarq talks about "preference advertising" in its privacy policy and confirmed it has tested NebuAd "in one of our markets," but added that "we are not currently using those tools and have not decided whether to move forward with them." Rivals to NebuAd include Front Porch of Sonora, Calif., and U.K.-based Phorm.

NebuAd refused to disclose what advertising networks--such as DoubleClick or Microsoft's Aquantive--it uses, or what broadband providers it counts as customers. So did Phorm and Front Porch (which said it could not arrange an interview).

When asked why it won't disclose that information, NebuAd told us in e-mail: "We would like to respect the trust and relationship that already exists between an ISP and their end customer. We want to stress that we do not publicly discuss our ISP partner relationships because of the direct relationship that already exists between an ISP and their customers. Our belief is that our ISP partners have a direct, trusted relationship with their customers; and communication, public or otherwise, should be directly from our ISP partner to their end customer." NebuAd does provide an opt-out mechanism through browser cookies.

The stakes are high. The advertising industry is moving toward behavioral targeting, meaning compiling dossiers (anonymized or not) on individuals and using those to display targeted ads. Theoretically, this benefits everyone: Internet users see ads that match their interests, and advertisers sell more products.

Because deep packet inspection can, barring the use of encryption, monitor everything that a customer does online, a broadband provider is in the enviable position of being able to know exactly what each customer is doing. The odds of successful monetization are high. But so are the legal risks.

Three federal laws, three legal hurdles

At least three wiretapping-related federal laws restrict what broadband providers can do: the Electronic Communications Privacy Act of 1986 (ECPA); the Communications Act of 1934; and the Cable TV Privacy Act of 1984. The cable privacy law is the most restrictive and applies only to cable broadband providers--meaning, thanks to a law written when the Apple Macintosh was new, they're at a competitive disadvantage to AT&T and Verizon.

The cable privacy law is unusually onerous because it requires the "prior written or electronic consent of the subscriber" before any personally identifiable information can be collected. What that means is sending a postcard or e-mail telling customers that they can opt-out (which is what cable providers are doing so far) may not be good enough.

"They have to worry about it more," said Gidari, the attorney at Perkins Coie, referring to cable operators. "Their rules are much more restrictive. They have the obligation to give notice to their customers before they disclose information. They have the obligation not to collect information without prior consent...Cable operators have the most exposure in doing this."

"Do (broadband providers) think they own that data? If they own that data, there are no limits on what can be done with it? Can they give it to an employer? Can they give it to a credit bureau? Can they give it to a potential landlord?"
--Barry Steinhardt, ACLU's Technology and Liberty Program

One irony of this situation is that broadband providers are seeking to do precisely what companies like Google and Yahoo have done for many years: monitor what users are doing and display relevant advertisements. But cultural expectations are different. And by an accident of history, or a quirk of fate, those laws don't apply to Google and Yahoo and other Web sites. They single out Internet service providers.

For their part, cable providers insist that they're following the law. Charter tells us it is "confident" that "all legal requirements" have been met. Wide Open West, a cable operator in the Midwest that's using NebuAd's hardware, said: "We feel that the service and our use of it is in compliance with current regulations."

But other laws apply to all Internet providers. ECPA says, in general, that "a person or entity providing an electronic communication service to the public shall not intentionally divulge the contents of any communication." Two exceptions to that general rule allow monitoring that is a "necessary incident" to providing the service and monitoring with a user's "lawful consent."

Translation: Obtaining "lawful consent" may mean more than sending e-mail notifying customers that the terms of service have changed. At the least it means that an opt-in process is less risky, legally speaking, than an opt-out one.

The 2003 In Re Pharmatrak decision from the U.S. Court of Appeals for the 1st Circuit offers a glimpse of how judges view consent. The court ruled in a case involving Web tracking "that it makes more sense to place the burden of showing consent on the party seeking the benefit of the exception." The judges approvingly cited a second case, which said "consent can only be implied when the surrounding circumstances convincingly show that the party knew about and consented to the interception."

Yet another legal obstacle for Web monitoring is the Communications Act, which says companies engaged in "transmitting" communications shall not "divulge" those contents.

"The question is whether or not a third party like this can track usage for things other than for routine maintenance of a network--they are entitled to do that," said Barry Steinhardt, director of the ACLU's Technology and Liberty Program. "But where you're actually tracking the content of what users do, there are serious questions there about the Electronic Communications Privacy Act and the cable laws."

Steinhardt added: "I think Congressman (Edward) Markey is exactly right to raise this issue. The implications here are profound...Do (broadband providers) think they own that data? If they own that data, there are no limits on what can be done with it? Can they give it to an employer? Can they give it to a credit bureau? Can they give it to a potential landlord?"

Another possible threat to broadband providers is the Federal Trade Commission, which can file lawsuits alleging unfair or deceptive business practices. The FTC has posed suggested guidelines for behavioral advertising after convening a workshop last fall, and the Center for Democracy and Technology filed comments with the agency last month raising questions about NebuAd and its peers. (Disclaimer: I spoke at last fall's workshop.)

CDT's comments allege that broadband providers do "not appear to be adequately disclosing this involvement" and suggests that the Electronic Communications Privacy Act regulates the practice. They also suggest that the FTC "should address" advertising-related monitoring and require affirmative consent from customers instead of an opt-out mechanism. In its privacy principles, the FTC said "companies should obtain affirmative express consent from affected consumers" before substantially changing privacy policies.

In the past, the FTC has taken a relatively strict view of informed consent. In its lawsuit filed against Odysseus Marketing, the FTC argued that it was unlawful for a company not "to adequately disclose" to customers that it was sharing information with third parties. The case ended in a settlement.

There's one final legal twist that could imperil NebuAd and similar companies that conduct deep packet inspection. The way they work is to perform a Carnivore-like interception of all customers' Web browsing. Then Web traffic with NebuAd's opt-out cookie is discarded.

What that means in practice is that, if you've chosen to opt-out through your Internet provider, the contents of your communications are nevertheless continually disclosed to a third party--even if for a microsecond--which is exactly what federal privacy laws seem to prohibit.

News.com's Anne Broache contributed to this report

Declan McCullagh, CNET News' chief political correspondent, chronicles the intersection of politics and technology. He has covered politics, technology, and Washington, D.C., for more than a decade, which has turned him into an iconoclast and a skeptic of anyone who says, "We oughta have a new federal law against this." E-mail Declan.
Recent posts from Politics and Law
DHS needs fresh ideas on cybersecurity, experts say
Panel: Government data-mining programs lack oversight
Bush signs law promoting censorship of kids' programming
Telcos, groups draw up national broadband strategy
'Help Wanted' ad names next FCC chair's priorities
Coalition urges Obama to adopt open transition
Obama's attorney general pick: Good on privacy?
Obama team changes Change.gov copyright policy
Add a Comment (Log in or register) 21 comments
by R.Jefferson May 19, 2008 1:42 PM PDT
We have no rights only privledges. We dont own nor can we control our personal information, it is content that corporations and industry regulate and own and have sole exculsive use thereof.

Comon now, I know I want spam emails and ads for things I might buy, not just suspect pharmaceuticals or FREE* iPods.
Reply to this comment
by pgp_protector May 19, 2008 1:50 PM PDT
What about the fact that they are also modifying other pages, not giving the client what was sent from the server.

Site "A" has deal with company "B" to display ads.
Site "A" puts company "B"'s ads on the web page
Site "A" sends page with company "B"'s ads to Visitor.
Visitor sees company "C"'s ads that neither Site "A" or Company "B" approved.
Reply to this comment
by declan00 May 19, 2008 1:59 PM PDT
pgp_protector: That is _not_ what they're doing, according to our Q&A with Charter:
http://www.news.com/8301-13578_3-9945309-38.html

Q: Let's say NebuAd has a relationship with DoubleClick, and let's say CNN.com uses DoubleClick for advertising. If you visit car Web sites and then visit CNN.com, you're more likely to see a car ad as a result, right?
A: Yes. If you look at the transaction flow, if CNN has a relationship with DoubleClick, we, through this anonymous model, have provided information to NebuAd. The ads that are already being served are being served on an informed basis. We're informing the model to an additional degree. There is a level of misinformation about how that works.
Reply to this comment
by popper99 May 20, 2008 6:13 AM PDT
it might _not_ what they're doing right now but if their Patent is anything like Phorms Deep Pack Inspection kit capability, then they can do this at any time, Phorm did exactly this in the old unlawful BT trials in the past for instance.

you need to be asking the right questions, and push for the right answers apparently.

in the referenced NebuAd Q&A for instance, he states its not DPI , thats a clear lie, as it IS Deep Packet Inspection ,infact it appears NebuAD kit works in virtually the same mannor as Phorm in all respects.

you and the other new outlets really need to read and understand the Phorm model and so be in a far better position to challenge the lies by NebuAD executives.

see the webs longest Phorm and the Phormettes thread on the UK cable forum were many tech and conserned end users are giving and getting real informed information.

READ AND UNDERSTAND this report from Richard Clayton :
#6801
http://www.cableforum.co.uk/board/12/33628733-virgin-media-phorm-webwise-adverts-updated-page-454.html#post34555106

"http://www.lightbluetouchpaper.org/2...ges-all-alike/
"
Twisty little passages, all alike

May 18th, 2008 at 19:29 UTC by Richard Clayton
Last month, on the 4th April, I published a document describing how the Phorm system worked and blogged about what I thought of the scheme.

The document had been run past Phorm?s technical people to ensure it was correct, but ? it turns out ? there were still a handful of errors in it.

A number of helpful people pointed out that I?d misdescribed third-party cookies (which didn?t matter much because Phorm specifically uses first-party cookies), and I?d managed to reference RFC2695 rather than RFC2965 !
....
The Phorm system does some of its tracking magic by redirecting browser requests using HTTP 307 responses.

When this was first explained to me at the meeting with Phorm there were two redirections (a scan of my notes is here), but having thought about this for a while, I asked for it to be explained to me again later on, and it turned out that I had previously been misled, and that there were in fact three redirections (here?s my notes of this part of the meeting).

It now turns out, following my further emails with Phorm, that there are in fact FOUR redirections occurring! This is not because my notes are rubbish ? but because Phorm have managed to recall more of the detail of their own system!
...
"
"
by Renegade Knight May 19, 2008 2:52 PM PDT
When I pay directly for a service there is no need for ads. Some pay services like to throw in ads anyway (Cable for example) but they are nothing more than an optional plan to try and make more money on the same service you are already buying. In other words, Corporate Double Dipping.
Reply to this comment
by steelhoof May 19, 2008 5:31 PM PDT
Declan, once again I think you are striking at the heart of the issue. What is, in reality, the difference between deep monitoring of packets used by a computer vs the packets used by voice communication systems? The easy difference is Voice monitoring is on a one to one basis between to endpoints, in a serial fashion. Computer connections, ie "surfing" is parallel, but not all we do on the net is performed by a browser. Also, when we go to sites with "secure" connections, the idea is to keep data secret from others, and sniffing each packet defeats that.

We talk about the lack of trust when it comes to electronic voting. Can we really trust the software or the vendor? What of this deep packet hardware? Who vets the vendor, the software or the firmware used? I use gmail, and I know it is all "sniffed" by google, but if I need to keep it secure, i will use a different resource. What is to keep someone sniffing packets with the blessing of the ISP from sorting and the selling the information like Lawanda Jackson did with the medical records of celebrities at UCLA Medical Center?

The risk of sniffing online communications for discrete data is too high, and the potential damage too great to allow.

Would you like others to know that your kids are checking out porn? Or that you are seeing a secret lover in a chatroom,? And that you have $10,238.67 in a bank account your husband knows nothing about?

The reading of packets to develop a profile is totally wrong. What if you surf porn at night, and your kids go to sesamestreet during the day? Will you trust the computer delivering content not to get confused if you 6 year old goes online at 2 am because she woke up and wanted to play?
Reply to this comment
by The_Decider May 19, 2008 7:16 PM PDT
If you are talking about traditional phone service there is a huge technical difference. Packet switching vs circuit switching.
by higginsoft May 19, 2008 5:32 PM PDT
I contacted Charter and asked them about the monitoring. This is what they sent back:

We are monitoring the site that you go to in order to have the advertising you see on website become customized to the website's you are looking at. if you wish to not take part in this you can got to www.charter.com/onlineprivacy to stop it. We are currently only doing this in 4 cities, so this may not affect you. the cities are Newtown, CT, Fort Worth, Texas, San Luis Obisop, CA, and Oxford, Massachusetts. If you wish to discuss this as it regards your particular account, you can chat in at charter.com or call us a 888-438-2427. Due to FCC regulations, we can not discuss individual accounts by email.
Thanks,
Don

When you go there, you enter you name and address. They return the following:

Opt-Out is Complete
Your opt-out request has been received and processed.
Please note that the opt-out cookie is specific to the browser and computer you are using right now. Your opt-out choice cannot be honored if you access this site using a different browser on this computer or from a different computer. Additionally, your opt-out choice cannot be honored if the cookies on your computer(s) are deleted. As a result, you should repeat this process with each browser and computer you use to access this site and whenever cookies are deleted from your computer(s).
Reply to this comment
by zeroplane May 19, 2008 6:50 PM PDT
Although currently the service is a joke, I am finding the freenet service idea more and more desirable. http://freenetproject.org/

From my observation is can easily be as lame as the normal internet, and from what I have seen it is like stepping back into the early 90es. But the advantage is providing a backbone that can not be tracked and is a virtual private network between computer on the internet.
Reply to this comment
by zeroplane May 19, 2008 6:52 PM PDT
So what is stopping someone from releasing a proxy that works with Seek and Destroy to make it permanent. http://www.safer-networking.org/en/index.html
Reply to this comment
by royc May 19, 2008 8:26 PM PDT
All the ISP really needs to do is amend the terms of use and say to use (or continue to use) our service you must agree to the new terms of use. If you do not agree your service will be terminated.

I tried to check on a new service provider based on billing trouble and there are none in my area so I'm stuck with a monthly battle over my bill or going backwards to 1998 and 33Kb/sec.
Reply to this comment
by mraardvark May 19, 2008 9:09 PM PDT
So they give a special opt out cookie. Considering I have at least three different programs deleting cookies (firefox, ccleaner, and my antivirus) keeping something like that around would end up being a royal pain in the backside. Most people wouldn't even notice it was gone let alone know all the random cache cleaners running around will delete it. Of course I'm sure these guys are counting on it .
Reply to this comment
by CookieBarrel May 19, 2008 9:53 PM PDT
With billion$ at stake, there is no doubt that this will all go ahead regardless of the opt-in opt-out argument. In the UK they are tackling the same issues head-on with a very different approach judging by this story: http://news.zdnet.co.uk/internet/0,1000000097,39419839,00.htm
Reply to this comment
by Wookiee-1138 May 19, 2008 10:43 PM PDT
Thank St. Isidore for Firefox's Adblock Plus.
Reply to this comment
by kayoub May 19, 2008 11:23 PM PDT
I use Adblock as well, and blocked anything from NebuAd, etc. However, that only stops me from seeing the ad. It doesn't stop Charter and its partners in crime from seeing me.
by JadedGamer May 20, 2008 2:36 AM PDT
"All the ISP really needs to do is amend the terms of use and say to use (or continue to use) our service you must agree to the new terms of use. If you do not agree your service will be terminated."

What, you mean unilaterally change a contract after it has been signed? They would be crushed in court if they tried that kind of trick.
Reply to this comment
by popper99 May 20, 2008 6:25 AM PDT
discused in the UK CableForum Phorm thread and my post from /.

"Would, say, injecting a layer over the site (and placed above the site, much like Google does when you are searching for Images) really be copyright infringement though? Stealing advertising, maybe."

the point your all missing or Obfuscate on purpose! so far, is that the advert placements or even viewing/blocking them,
is secondary to all this real 'copyright infringement' and 'unauthorised derivative work' for commercual profit.

a commercial 'unauthorised derivative work' for profit IS a criminal offence in the UK/EU and i assume the US! , canada? and Oz

it is blatant "COMMERCIAL PIRACY FOR PROFIT", end of story.

even without considering any copyright notice on a website, or all the 'not for commercial use' type notices, as is found on a LOT of sites today, not to mention the newest trend of forbiding Phorm or the Phormettes/other DPI dirivatives we (cableforum)in the UK have been advocating for all non signed up sites to include.

they the (ISP's)2nd party ARE making this 'unauthorised derivative work' from BOTH the auto copyrighted consumers (1st partys)datastream AND the Auto copyrighted website content owners original work.

from this 'unauthorised derivative work' they (the 2nd party ISP's or the 3rd partys Phorm/NebuAd etc) are selling this unauthorised data for profit to the 4th party ad network or ad customer in this case, well outside any 'mere conduit' in UK/EU legal terms, or 'common carrier' i think you call it in the US legal terms, and so not covered by any legal protections in that regard.

if as Irish_Samurai states, he's putting the case of the ISPs that they will try to use 'an agent for the users', then they better find a far better defence as it cant possibly be defended against with this in effect 'comercial piracy for profit' 'unauthorised derivative work' .

as far as im concerned, even the crazy US courts dont allow any 'unlawful clause' inside a consumer T&C Contract to become 'enforcable' when its clearly not legal as in forcing one of the partys to break other clear cut laws.

any unlawful clause IS UNENFORCABLE, even if the rest of a contract is still deemed valid by a court, and while it might be the case in the US that you dont have stronger laws that the courts always favour the consumer position when ruling in explicit T&C consumer contracts, even the US courts must uphold unreasonable T&C consumer contract clauses as invalid and unenforceable in so called "good faith" legal terms.... do they?
Reply to this comment
by popper99 May 20, 2008 6:31 AM PDT
NebuAd is virtually the same Phorm in its operation and deplyment so read this and understand all his points and the pdf report, then go as your informed questions and point out the lie
"Q: If you're conducting deep packet inspection, that means you know what data your customers are transferring. Are you going to look for evidence of copyright infringement, child pornography, and so on as well?

The enhanced advertising solution [http://_does_ _not_ utilize deep packet inspection.|http://_does_ _not_ utilize deep packet inspection.] It looks at URL level information only. That's another point of misinformation on the Net.

"


http://www.lightbluetouchpaper.org/2...ges-all-alike/
"
Twisty little passages, all alike

May 18th, 2008 at 19:29 UTC by Richard Clayton
Last month, on the 4th April, I published a document describing how the Phorm system worked and blogged about what I thought of the scheme.


The document had been run past Phorm?s technical people to ensure it was correct, but ? it turns out ? there were still a handful of errors in it.


A number of helpful people pointed out that I?d misdescribed third-party cookies (which didn?t matter much because Phorm specifically uses first-party cookies), and I?d managed to reference RFC2695 rather than RFC2965 !

....

The Phorm system does some of its tracking magic by redirecting browser requests using HTTP 307 responses.


When this was first explained to me at the meeting with Phorm there were two redirections (a scan of my notes is here), but having thought about this for a while, I asked for it to be explained to me again later on, and it turned out that I had previously been misled, and that there were in fact three redirections (here?s my notes of this part of the meeting).


It now turns out, following my further emails with Phorm, that there are in fact FOUR redirections occurring! This is not because my notes are rubbish ? but because Phorm have managed to recall more of the detail of their own system!
...

"
"
Reply to this comment
by popper99 May 20, 2008 6:56 AM PDT
it appears the url messed up trying again
http://www.lightbluetouchpaper.org/2008/05/18/twisty-little-passages-all-alike/

if that doesnt work, just go to to http://www.lightbluetouchpaper.org/ and its the first story

and for the cable forum thread
http://www.cableforum.co.uk/board/12/33628733-virgin-media-phorm-webwise-adverts-updated.html
Reply to this comment
by popper99 May 20, 2008 4:05 PM PDT
you might find this Deep Packet Inspection Procera Networks? advert enlightening as to what your DPI installed ISP/Phorm/NebuAd kit can see as just one single example.

not exactly private or hidden as they keep telling you, if you have access to that DPI kit locally or remotely as is the case with Phorm/NebuAd etc.

http://www.proceranetworks.com/products/packetlogic-demo.html

thanks to Phormic Acid on the http://www.cableforum.co.uk/board/12/33628733-virgin-media-phorm-webwise-adverts-updated-page-460.html thread
Reply to this comment
by popper99 May 21, 2008 4:39 PM PDT
http://www.cableforum.co.uk/board/12/33628733-virgin-media-phorm-webwise-adverts-updated-page-465.html#post34557239
?Re: Virgin Media Phorm Webwise Adverts [Updated: See Post No. 1, 77, 102 & 797]

???????????????????????????

X-posted from Badphorm

Hello all,

pleased to announce a new prerelease version of Dephormation is available to download.

It includes a significant new feature, developed by Narcosis, that records evidence of redirects by Phorm (or Nebuad) to a log file. This data could be used to support Fraud/Computer Misuse/RIPA complaints, or simply for technical analysis of DPI systems like Phorm and Nebuad. (I?ve checked every contributed line of code, and found only pure genius).

I?ve tested this on Windows XP/FF2, and Linux/FF1.5. Narcosis has tried it on a Mac.

http://www.dephormation.org.uk/prere?phormation.xpi

Please feel free to give it a try (and revert back to the current public v1.6 if you encounter problems).

Please note, with logging enabled, there is a trivial but discernable performance hit. The code probably needs some file handling optimisation. I?d suggest keeping the feature off, unless you suspect you are being redirected and want to capture a log.

On Windows, the log file is best viewed in Wordpad, not Notepad (due to carriage return/line feed layout issues).

PS? forgot to mention, the options can be accessed from the new Tools/Dephormation? menu item.

regards
Pete
__________________
BT/Virgin/TalkTalk customers - you don?t need Webwise and Phorm, pure and simple.
Find a Phorm Free ISP. Phorm must be stopped.
Download Dephormation for Firefox
?
Reply to this comment
 See all 21 Comments >>
advertisement

In the news now

Confessions of a man who does the layoffs

It's easy to vilify the guy who hands out the pink slips. But contrary to popular notions, these aren't decisions that are taken lightly, at least with the executive we interviewed.


Dell racks up Microsoft as data center customer

After finding itself on the losing end of a number of deals, Dell creates a special unit aimed at getting its gear inside the world's largest data centers.


About Politics and Law

Lead contributor Declan McCullagh has covered politics, technology, and Washington, D.C., for more than a decade, which has turned him into an iconoclast and a skeptic of anyone who says, "We oughta have a new federal law against this."

Add this feed to your online news reader

Politics and Law topics

advertisement
advertisement

Inside CNET News

Scroll Left Scroll Right