Facebook and deep customer tracking, I want my data!

To nobody’s surprise, Facebook, just like any other entity selling you stuff, or selling you to people who sell you stuff is trying to connect more and more sets of previously unconnected data. This particular case deals with brick and mortar store data that is linked with customers’ email addresses and loyalty cards.

Facebook will be using Datalogix to prepare reports for its advertisers about who, if anyone, bought more of their stuff after they ran ads on the social network. But by matching your Facebook profile with your CVS bill, this means that Facebook has the potential to know some of your most intimate details (my, that’s a lot of bunion cream you’re buying!), and the privacy concerns are enormous. When DoubleClick attempted something similar to this, user-backlash ultimately led them to cancel the project.

Can Facebook Possibly Build a Business Model That Isnt Inherently Creepy? – Derek Thompson – The Atlantic.

Corporations (more than government, open data activists!) have been deep mining our data for years. It is part of creating the information asymmetry that enables profits to be made. You may remember this story about Target (coming to Canada as soon as we can learn to say Tarjay) and how they outed a teen’s pregnancy.

 About a year after Pole created his pregnancy-prediction model, a man walked into a Target outside Minneapolis and demanded to see the manager. He was clutching coupons that had been sent to his daughter, and he was angry, according to an employee who participated in the conversation.

“My daughter got this in the mail!” he said. “She’s still in high school, and you’re sending her coupons for baby clothes and cribs? Are you trying to encourage her to get pregnant?”

Companies’ ability to reduce us to a shopping probability statistic is only going to get better as they learn to connect more of our data and computing gets faster. Can regulation keep up? Can customer outrage keep up with companies offering us coupons to keep us temporarily happy as impulse centres in our brain are carefully triggered for profit? Can customer outrage even keep up with the barrage of occurrences?

Receipt 2.0

I don’t think we can keep up. So, I want my data. I want information on what I bought, when I bought it, where I bought it in a standardized open data format. No, not a paper receipt, not a paper receipt scanner, but something that can be beamed to my phone, or emailed to me. I want to know when I buy coffee. Can I correlate my shopping habits with my mood?  Do I buy more random electronics when I need a pick me up? What is the spread in the price I paid for my favourite cereal? Do some stores price it differently on Wednesdays? I want apps that can mine my data and tell me where to buy my cereal, or when not to buy. I want apps that can tap into a product database and give me a carbon footprint, or a fair trade pass/fail, or a local product breakdown.

Also, I do not want to re-enter the same bits of data multiple times and increase error. A payment made to my dentist should be sent directly to my extended health “insurance” provider for a refund. It should also go to my tax receipts virtual pile and await reimbursement. Any tax deductions can easily be tagged and directly entered into my tax preparation software at the end of the year. if I want to expense something for work, I should just be able to tag them and send them along. I can’t imagine how much time and effort this will save in error checking, manual entry, auditing, so much more.

Some of this is possible with systems like Mint, but they operate on a payment level, not on a line item level.

The new mobile payment system Square (not in Canada yet) shows some potential, so does Intuit’s GoPayment, which is available in Canada. But these payment systems emphasize ease of payment on both sides of the transaction, not the ability to mine our own data.

Can this happen via the market with no regulatory push? I don’t see how. Reducing information asymmetry is not in corporations’ interest. So it will have to be regulated. You have our data, just give it to us.

Not to mention, this is the “free market” way to go. Think of all the innovation that can be unleashed on the consumer side. Think of the apps that can provide better financial advice, the apps that can collate data at city/regional level and help consumers make better decisions.

Will companies have to spend money to make this happen? Yes. This will not be challenging for larger companies who already spend millions deep-mining our data. What about small business? This is where small tweaks to new systems like Square or GoPayment can be the game changer. Square already charges less for a swipe than a typical Visa transaction. So, I would see local business as saving money. When I buy local, I usually feel a bit more connection with the product. Imagine seeing my decision reinforced by data from Receipt 2.0. Small local business cannot data mine, but can generate enough goodwill with local consumers to get access to their data. Unlike Target, when my corner soap store does something unethical with my data, they cannot survive the bad publicity.

Are there privacy concerns? Yes. But our privacy is already compromised the minute we pay anything other than cash, or use the internet (Tor users, stop smirking). Good regulation can address most concerns.

My information is being used to make me a consume more, I want it to make me a better “consumer”. Open data efforts have focused intensely on public and government data, while privacy activists have tried unsuccessfully to stop private data gathering. I would like open data advocates to look carefully at liberating corporate mined data as well.

Featured Image courtesy the Culturally Authentic Picture Lexicon used under a creative commons licence.

Similar Posts

  • |

    FDA Issues Dietary Supplements Final Rule

    The FDA issues rules that will finally make dietary supplement manufacturers conform to some rules in the manufacturing of the products.

    Which ones?

    1. Accurate potency and labeling – 30 mg glucosamine will now contain something close to 30mg
    2. Impurities Testing – All the raw materials will now be tested for impurities/contaminants. They will probably follow USP guidelines.
    3. Adverse event reporting – Manufacturers/sellers will need to report adverse events. This is after the fact safety testing, wholly inadequate, but better than what we had previously.

    See something missing? Efficacy!! You do not have to prove that your product actually works! Basic safety? What is the overdose level? Interactions with other medicines/supplements? Is your dosing form actually bioavailable? Meaning, if you swallow a pill, will it actually get into your bloodstream and reach the intended target?

    Who knows, but standardizing, cataloging and auditing manufacturing processes is a start, I guess. 1.5 cheers for the FDA!

    I would be curious to find out how these companies are going to get audited by the FDA to prove that they’re following the quality control measures they’re supposed to implement. Guess I have to read the 815 pg bundle of joy that is the actual rule to find out more. A cursory word search on audits suggests that the manufacturers do audits on their suppliers, that the quality control unit of manufacturer perform audits on their manufacturing process, but nothing about the FDA conducting audits. Of course, calling yourself a GMP (good manufacturing processes) manufacturer is usually enough to trigger an FDA audit if you’re in pharma. I wonder how the FDA will deal with this one.

    FDA Issues Dietary Supplements Final Rule

    The U.S. Food and Drug Administration today announced a final rule establishing regulations to require current good manufacturing practices (cGMP) for dietary supplements. The rule ensures that dietary supplements are produced in a quality manner, do not contain contaminants or impurities, and are accurately labeled.

    “This rule helps to ensure the quality of dietary supplements so that consumers can be confident that the products they purchase contain what is on the label,” said Commissioner of Food and Drugs Andrew C. von Eschenbach, M.D. “In addition, as a result of recent amendments to the Federal Food, Drug, and Cosmetic Act, by the end of the year, industry will be required to report all serious dietary supplement related adverse events to FDA.”

    The regulations establish the cGMP needed to ensure quality throughout the manufacturing, packaging, labeling, and storing of dietary supplements. The final rule includes requirements for establishing quality control procedures, designing and constructing manufacturing plants, and testing ingredients and the finished product. It also includes requirements for recordkeeping and handling consumer product complaints.

    “The final rule will help ensure that dietary supplements are manufactured with controls that result in a consistent product free of contamination, with accurate labeling,” said Robert E. Brackett, Ph.D., director of FDA’s Center for Food Safety and Applied Nutrition.

    Under the final rule, manufacturers are required to evaluate the identity, purity, strength, and composition of their dietary supplements. If dietary supplements contain contaminants or do not contain the dietary ingredient they are represented to contain, FDA would consider those products to be adulterated or misbranded.

    The aim of the final rule is to prevent inclusion of the wrong ingredients, too much or too little of a dietary ingredient, contamination by substances such as natural toxins, bacteria, pesticides, glass, lead and other heavy metals, as well as improper packaging and labeling.

  • |

    Fun with maps: BC Smart meters and the 2013 election

    SmartMeterVotingMapI have been MOOC’ing this summer and learning how to do maps. Geography as an adult is much more fun than my 10th grade geography class.

    Chad Skelton over at the Vancouver Sun intrigued me with his data retrieval and mapping of British Columbia’s Smart Meter uptake. if you’re not from BC, here’s a short intro (#BCpoli-aware feel free to skip the next two paragraphs).

    BC Hydro is the government owned (Crown Corporation) utility that produces and distributes electricity for the province of British Colombia in Canada. In 2011, BC Hydro announced its intention to spend $$$ upgrading all its electricity meters to “smart meters”. These meters are capable of being read via wifi by meter readers, and potentially also give BC residents the ability to monitor their electricity usage in near-real time.

    Many concerns were raised about the smart meters. One was about the costs of the program vs. perceived benefits. The others, which gained traction were around an emerging movement in BC connecting wifi, cell signals and wifi-enabled smart meters with a whole variety of health effects. While few, if any of these health concerns have been actually causally linked to smart meters, or even to the amorphous descriptor “wifi radiation”, these health concerns have gained traction even among official bodies such as the Union of BC Municipalities, municipal councils and school boards. The BC provincial election in 2013 was a chance for people to voice their concerns. The opposition parties all brought the issue up during canvassing.

    For my peer assessment mapping project, I wanted to see if areas of relatively high smart meter refusal were correlated or co-located in any way with voting against the ruling BC Liberals.

    This is the map I made, my first ever map not scrawled on paper.


    View Larger Map

    Reading the Map

    The electoral districts are colour-coded by BC Liberal Party percentage, darker means higher vote for the BC Liberals. I chose this rather than “who won” because I was looking more for an anti-BC Liberal effect. I will, at some point in time, try to overlay “who won” as well. The smart meter refusal data is in three different coloured and sized circles. Large and red means higher refusal, and small and green means low refusal. This is a hybrid of a graduated circle symbol scheme and a diverging colour scheme. Clearly, using points to represent areas is a big limitation, but it is sufficient for a quick peek.

    Anything to See?

    • An overwhelming majority of people had smart meters installed, > 90% in most places. So, BC Hydro’s brute force, no options, default installation plan was mostly successful
    • Places of higher than normal refusal tended to vote against the BC Liberals. I believe this had more to do with existing anti-BC-Lib tendencies influencing smart meter refusal rather than the other way around.
    • Urban centres like Victoria and Vancouver had relatively low rates of refusal. Is this because of higher apartment proportions, or because smart meter refusal was restricted to a small number of high information, highly motivated individuals whose number varied by location and whose numbers in places like Victoria were muted by larger populations?. Note that my home area of Victoria had the most (7300) rejected smart meters, even though the percentage is small. The ageing white (l)iberal enclave of Saltspring Island (Ganges), aka hippieville, Canada had by far the highest refusal percentage. So, is this smart meter refusal map mostly a hippie population distribution map?

    The take home message for me was that the anti-smartmeter movement had little influence on the election, which was most likely won on the usual and mundane issues of the economy, trust and corruption.

    Methods

    1. I downloaded data on smart meter refusal from the Chad Skelton’s post and Tableau public
    2. The data from BC Hydro is categorized using their division of BC into distinct geographical billing areas. I used billing area names to geotag the information. The site http://www.findlatitudeandlongitude.com/ has a feature where addresses can be uploaded in bulk via a text interface, and the site returns the place, and latitude longitude. I added province and country to the place names, and edited ambiguous names to make the search more effective.
    3. I uploaded this table to arcgis to form one layer. Arcgis is a big and expensive GIS software, with a limited free online playpen where this map is displayed. I used graduated circles and natural breaks to represent the different levels of smart meter refusal. A big limitation to this approach is that the BC Hydro billing areas are just that, areas, not points on a map. However, the area boundaries are not available as a shape file, and geographical areas vary widely. So, the points correspond to the centre of the nearest big population area mentioned in the BC Hydro billing area description
    4. I downloaded BC electoral district shape files from Paul Ramsey of Open Geo. These shape files are an improved version of those available from Elections BC, again, thanks to Chad Skelton for pointing me in this direction
    5. Elections BC lists 2013 provincial election results information by party by district. However, there is no publicly downloadable mapped source for the election data results. I used the open source GIS desktop software QGIS to open the shape file and add the attribute of BC Liberal percentage to the shape file. I uploaded this shape file to arcgis and layered it with the smart meter refusal rate graduated circles to look for patterns.

    Maps are fun to play with, and I know very very little about them, which is a great combination. Every minute I spent making this map was a learning experience. Comments and feedback, please. I think I will slowly incorporate mapping into my skill set. But I think I will use open source/free solutions in the future.

  • |

    Let all residents vote in Canada

    BC has municipal elections in October this year and I will be voting for the candidates whose policies, values and voting records on housing affordability, harm reduction, and walk/bike/transit friendliness match mine the closest. I might even have an endorsement or three up my sleeve. This year, I will also be asking Victoria’s municipal election candidates where they stand on letting permanent residents vote in our elections.

    In the 2016 census, nearly 2.5 million people identified as non-citizen residents, out of which two million were permanent residents. The permanent residents live here, work here, play here, pay taxes, grow pensions, volunteer, commit crimes (yes, they’re like any other Canadian) and more, just like those with Canadian citizenship. However, they have no say in who represents them municipally, provincially or federally. I find this unfair, so do many people, including the Vancouver city council, who passed a resolution in 2018 (PDF) calling for the province to approve voting by permanent residents. This globe news article provides a good backgrounder.

    In short, municipalities have run into the conservative buzzsaw that is the state of our (mostly) conservative or liberal provincial governments. This won’t change unless more people speak up.

    The opposition is mainly that non-citizens are not sufficiently “invested” in the country, they’re too “new”. The more paranoid ones talk about divided loyalties, and bring up stories of foreigners being flown in to vote. Perhaps they should try getting a visitor visa to Canada (spoiler alert, difficult).  People who judge other people’s belonging or membership, however, usually have other items on their agenda. Let’s just leave it at that.

    From my perspective, extending the vote is common sense, fair and just, and that’s that.

    Permanent residents? The case is simple. They’re like citizens in all ways, except for voting, and having to renew every five years. If you want to make life difficult, you could ask them to renew voter registration every five years too, but really, you shouldn’t. Are you concerned about “loyalties”? If you are, then you should not be letting the thousands of dual British-Canadian passport holders vote.

    How about residents without the permanent residency paperwork? Don’t see why not? If you’re concerned about timing of residency, put a time limit on the voting registration. There are very few non-permanent residents in Canada, half a million at last count, so, impact is small.

    Undocumented? May be difficult, especially with visibility and its consequences. But, I would support it if we can find a solution that protects people while allowing for verifying identity for voting.

    Of course, giving people a vote does not solve most problems, but that’s not the point. We see conservatives south of the boarder ceaselessly chipping away at the right of non-white people to vote. We need to be be going in the opposite direction on representation.

    So, here are the questions on this issue I intend to ask Victoria’s municipal candidates in 2018:

    1. Do you support efforts to extend voting rights to all residents in Victoria?
    2. If you do, what are you willing/able to do to make this happen at the municipal level at least, then at the provincial level and federal levels?

    A “no” on #1 is going to make it difficult to vote for you. A “yes” on #1 without some coherent plan on #2 means that you need to think about it some more.

    Are you with me? Would you be willing to ask prospective candidates the same questions? Should there be additional questions? Do these questions make sense, or should they be reworked?

    Cross-posted from interrobang

     

  • Americanize Me? No Thanks

    The Tyee gets all feisty on the subject of American-Canadian “integration”.

    It all got me to thinking about just why on earth Canadians would want to integrate into the U.S.Let’s be clear. This goes way beyond just having a bad neighbour. It’s about moving in with them.Don’t get me wrong. We can actually feel sorry for folks next door. They weren’t always this bad. But there is just no question that today they are a dangerously dysfunctional family. A lot of them are ill, but the other half refuses to come to their assistance. The old man squanders the family’s considerable income on his gun collection. They foul their own nests and squander their resources.The family behaves as if the neighbourhood’s rules don’t apply to them: they are noisy, pushy and if you try to reason with them they bully you. Hey, it’s not just our neighbourhood — they bully people all over town.

    Americanize Me? No Thanks :: Views :: thetyee.ca

    One more highlight…

    But what about the two decade long increase in U.S. productivity, constantly touted by Bay Street as a model for Canada? According to Doug Henwood of the Guardian newspaper, much of that increase can be traced to the enormous amount of forced, unpaid overtime by both waged and salaried employees. Americans work longer hours per year than those in any other industrialized country

    According to this report, Canadians worked 4 fewer weeks per year than Americans in 2002, which is good. Canada’s right in the middle of industrialized countries as far as hours worked per year goes, no need to emulate the US in that regard.

    Blogged with the Flock Browser

    Tags:

  • Income Inequality = Super VIllains

    From the very awesome Saturday Morning Breakfast Cereal Website, a reminder that income inequality causes more super villains than science, and mashing DNA 🙂  Canada’s Conference Board, which no one would accuse of being socialist, came up with a report yesterday flagging growing inequality in Canada. They flagged inequality as “raising questions of fairness”, and declared it of “moral concern”.

    They are late to the party. The Canadian Centre for Policy Alternatives has been on this beat for years, and has an ongoing project called The Growing Gap about income inequality. Go read The Spirit level by Richard Wilkinson and Kate Pickett of the Inequality Trust in the UK for an epidemiological look at inequality and various social conditions.

    Just wanted to share the awesome cartoon, that’s all 🙂

  • Top Bush Advisors Approved 'Enhanced Interrogation'

    THis banana republic story is not so benign.

    In dozens of top-secret talks and meetings in the White House, the most senior Bush administration officials discussed and approved specific details of how high-value al Qaeda suspects would be interrogated by the Central Intelligence Agency, sources tell ABC News.The so-called Principals who participated in the meetings also approved the use of “combined” interrogation techniques — using different techniques during interrogations, instead of using one method at a time — on terrorist suspects who proved difficult to break, sources said.Highly placed sources said a handful of top advisers signed off on how the CIA would interrogate top al Qaeda suspects — whether they would be slapped, pushed, deprived of sleep or subjected to simulated drowning, called waterboarding.The high-level discussions about these “enhanced interrogation techniques” were so detailed, these sources said, some of the interrogation sessions were almost choreographed — down to the number of times CIA agents could use a specific tactic.

    Sources: Top Bush Advisors Approved ‘Enhanced Interrogation’

    Once again, don’t know what to say…

    Blogged with the Flock Browser

3 Comments

Comments are closed.