Is More Data Always Better?

google think magazine data overload obesity information ideas processing analysisThere has been a discovery in the online marketing and data/statistics world in the last few years. We have had more websites, products and tools created online than we can possibly keep track of. The terms to describe this deluge of activity we have been hearing the most are “data overload” and “information overload” from both companies and consumers. This Google Magazine uses the term Data Obesity to describe this phenomenon.

They ask the question, why is more data always better?

I think the idea of “more data us better” is common from people who lived before the Internet was prevalent. We had to work hard to find data. Researching something meant going to a library and looking in a card catalog (or maybe something called Gopher) and then finding your way around the Dewey decimal system to find that book. And then sometimes they didn’t even have the book because it was checked out or possibly it was just filed wrong because nobody understood the Dewey decimal system.

On a related note recently we got invited to my cousin’s wedding in Santa Fe New Mexico. My dad promptly went to the library and checked out 3 books on Santa Fe and New Mexico. I cringed. He asked how to find out the flights to book something without a travel agent. I realized I have been traveling since 2000 this way and he stopped traveling about that time so he never has. I introduced him to Travelocity, it was mind blowing and a bit of data overload compared with the OAG book he used to use in the 80’s.

The point here is that finding data was really difficult. People had control over its distribution because it was in print. When it became more freely accessible due to Google and other companies efforts we assumed this would be good, because people could remember where to find it and use it whenever we wanted. We never thought it would get this big so fast. Now travel sites are overwhelming, they have too many choices and there are too many of them trying to get you to opt into something you don’t want while being over charged for bringing a suitcase on a flight. This is just one example of how data has gone exponential so quickly.

Others of us have come to a data overload conclusion when they have 200 emails in several in-boxes, 1000+ rss reader posts from feeds waiting, several work projects, 500+ Facebook wall posts in their feed and hundreds of tweets that have gone un-read. This is among a climate where you have to follow-up with projects 5-10 times to get things done, post blogs/tweets/FB status updates daily to keep on people’s radar, empty the DVR so it doesn’t get overloaded and auto delete something you really wanted, listen to the radio on the way to work just in case something big happens and still find time to scoop the litter box before it gets full and the cats poop on the floor.

And the real purpose in all those tweets/FB posts and feeds is that you business changes yearly and if you don’t know about the latest trend and some real insights about it before your boss asks about it, you won’t have a job for all that long. (in digital marketing)

Having data overload be a “good” problem to have from some people’s perspective (as in that it is growth oriented). The democratization of publishing combined with tracking methodology and databases have all contributed to this problem, giving everyone a voice, a potential following of readers, a data trail to analyze and method to say something important online 24/7/365.  And then we have an even bigger problem of processing what is being said, figuring out if it is important or not and sharing/processing/saving it in some way if it is. Acting on that data is way down the line and many of us don’t even get there.

And this isn’t even the big problem with data overload. Where will we store it all? Why do tweets disappear from search so quickly? Because there are millions of them and the failwhale is full. According to the ThinkQuarterly UK, there are 800 Exabytes of data/information created every two days. It took humans from the beginning of civilization until 2003 to create the first 800 Exabytes, and we’re on a roll now.

Where does all this seemingly random data go? How will we know what it says without having to go into a database table and read specific field information? Where are the software tools to manage all this and still give humans the ability to customize the out put in ways that match the behavior or business purposes that we really need? Does any of this stuff ever get deleted?

These are all huge questions we have to answer as more people publish, share, create, track and do business online. We also have to weigh the possibilities of sharing data openly and locking it behind walls as well as how will people comprehensively find what they need when they want to as well as gauge the validity/accuracy of the information presented?

I’m betting on paid services for personal and business data management/archiving & Analysis tools. We will pay for good analysis, good data access & processing and good reliability/backups when we feel the pain of missing good insight, losing good data and just too much happening. Both personally and professionally. But unless you know how to work with SAP, SPSS, SQL, Oracle or a bunch of other systems data management is largely out of your control at this point. They are the librarians of our digital data and they need to find a workable way to Dewey decimal system it back into order and allow us to use it as humans need to.

WebTrends won’t export data, what’s wrong?

I thought I would share another WebTrends Analytics morsel of information since it is so hard to find information about this analytics software that is quick and concise.

Today I was working from home and our self hosted software would not let me download the WebTrends reports that a client requested. It would abort the process and return to the login landing page each time.

We’re using WebTrends self hosted 8.1 software (not the most recent, yet still solid) and we found that WebTrends 8.1 does not play well with Internet Exporer 8.

We found that if I ran my browser in standard IE8 settings it would not export data and the popup of data processing screen was supressed and the system couldn’t complete the request.

There is a setting in the IE8 browser though that is called “compatibility view” that fixes this problem. Just set it to run in compatibility mode for the data site or all sites if you want and your analytics data is available for download again.

On another note, our recently update McAfee security and virus protection software is also blocking the javascript prompted popup window where the data is usually exported and I can’t download any data at work anymore either. We haven’t found a solution to this problem because the security settings get reset to the standard again when the system finds that the administrator has changed them, usually within a 1/2 hour. No word on if the powers that be would make an exception for my computer somehow or if our maintenance systems even allow that.  

It’s going to be a fun month.

WebTrends Email Stats Reports How To Setup

I love that WebTrends is a good solid web analytics reporting solution, but I really find the setup process for just about anything with this system to be very confusing and lengthy. I’m sure there is a reason for this (could be data integrity processes or cost savings) but I really just need a step by step list when I need to get something done quickly and someone to tell me where these oddball parts of the process exist. Therefore I’m writing a list to explain this process so I have it written down and other people can find this info too.

(technical note I’m using webtrends software 8.1, not the webtrends hosted solution)

Today the task at hand is setting up automated reports of webtrends data to be sent monthly by email. The duration of the data collected and the frequency of the reporting schedule are both flexible, it can be daily, weekly, monthly, quarterly or yearly.

The first step is to go to the administration menu from your login. There go to Report Designer and Templates. You can select one of their templates, I needed to create a new one.

Then name your template. Go to next, select the content by adding (and naming) a new chapter, then adding content to that chapter from the add report link on the menu above. Select the “built in report” list from the drop down to get the standard metrics available in webtrends. Check the boxes of the metrics you want included, I would say 4-8 per report is enough before you have too much data for someone to really use. You can make changes to the layout, although I was not looking for that level of detail now.

Click next at the bottom of the page. Then you have some configuration settings, like for wrapping text lines on long urls (ok) and how many rows of data in the reports (20-50 max for readability, top 5 is good).

Click next again and give profiles access to this report. I noticed mine are already given universal access and grey-ed out so nothing much to do with this screen. Then click save.

Next you then go back to the profiles list (admin menu and web analysis and reports & profiles) and edit the profile you want to get this report to add the report to the profile. This is one of those steps I think is redundant and should be automated or brought into the setup process before this because its confusing. You wave over the profile in the list (don’t click it) and get a menu with “actions” and edit is one of them.

From there go to reports in the top menu and on the drop down go to report templates. Click the box by your report to select it, ignore the second checkbox that is labeled default because it will change the default reporting style in the profile to this new report, and that isn’t the intention here.

Then go back to the admin menu a third time and to the scheduler menu (bottom) and then schedule jobs and click the button for a new job. This is the email setup part. Under job type select scheduled report and follow through the pieces of menu from left to right as you fill out each section. First select your profile you want reported on, next give the report a name and assign it to a user (yourself). (note this is also how to disable the emails with the check box below, no idea why this is hidden here). Report type: general report. Output type can me a database, pdf, excel/csv or pdf. I chose pdf because it looks professional and we don’t have to install Microsoft office/word on the server in order to export it. Its the only option that does not require that except the database. Number of data rows to report is up to you, I usually do top 20.

Next add the report destinations, this is where you need the email info. Add your email as the from, add theirs as the to address. Also, cc yourself on these reports so you get them too. Add the SMTP server address (if you don’t have the SMTP address it will hold up all of your other scheduled jobs, so don’t set this up without it.) So, the software knows where to connect to send it from. (contact IT about this if you don’t have it) You can also FTP it if you like your data that way, or save to a folder on the server. (not as exec friendly though) 

Under templates, complete view is ok. Under reports, here you select the reports you want to include. These are a duplicate of the ones you selected above, maybe redundant but this is literally the process we took on the phone with the WebTrends helpdesk people. Report type: standard again, date range: its up to you. Scheduling is next on the menu, you can’t run it on the 1st of the month because data may not have compiled yet in all time zones so the 2nd of the month is the first you can run a monthly report with the most recent previous month’s data. Ditto lag time for dailies, weeklies etc. Run once or run weekly/monthly/daily, as you choose.

The host binding section he literally told me to ignore. So I have no idea what that means. Then you get a summary page at the end and click save.

You just wait now and see if everything gets delivered correctly. It is good that the report is only generated once per month on the date you specify as a job that processes, so it can run data in the past (vs only from the point you created the report, forward like custom reports do because they create their own database table) and it won’t clog up your processing queue with a lot of memory/processing because it’s just once.

I wish there were short concise directions for setting up webtrends email reports like this on the web already but I realize that nothing is easy or self explanatory with database systems or webtrends. It’s just part of the territory until next generation tools come around, and no I don’t mean Google Analytics (which is almost as confusing now to beginners). Someday this has to get simpler in process so more people can use it.

Top 5 Web Analytics Metrics

chicago analytics consultant naperville ILI’ve been working with (Google/WebTrends/Omniture) Analytics data for 4 years now and the requests for Analytics data usually come in 2 styles.

1. The super basic: just tell me my site is still running, whatever everyone else looks at.

2. The super detailed auditors: tell me each of 180 customer segment’s data sliced and diced 10 ways and the month to month change, YOY change and a dozen other things the software doesn’t calculate for you. This could take months to implement and most of the time they have lost interest in it by the time you get it working properly.

I get frustrated with both. The super simple manager needs to look at more than just visits from month to month. The uber detailed guy needs to hire a developer to implement all that and not make changes each month to how they want data tracked and processed because all the time is spent on implementation and none on analysis and most of the time nobody even looks at all the 180 segments of reports.

They also need to realize that all the systems take the data and summarize it or cut off tracking at a max number of log files, web pages or analysis processes to maintain the integrity and size of the database tables. Try and do a full audit of every page view and click and you will crash WebTrends and re-processing it can take months. Google Analytics doesn’t even give you options to do more than what they summarize. Omniture really tries, but its a slow slow process.

Instead I am supporting the idea that web analytics data is really about trends and not audits. These numbers will never match your server logs perfectly nor your clicks from campaigns and that is OK. I also have listed here 5 metrics to look at and why they are important for your online site. One caveat is that I do not work for an e-commerce website so that has not been our focus. The focus is on conversion to application for recruitment purposes for companies. 

1. Visits – yes month over month traffic is important. What is more important is to look at the difference in traffic and drill down into what gained or lost traffic in the way of pages/content on the site and what sources changed in their contribution of the total traffic. This is actionable where as just visits aren’t. Also check back with the costs for each of these budget areas and compare the cost per visit provided by each.

2. Referrers – in a nutshell you should know how much traffic is coming from search, direct and your advertising/marketing plans online and offline. Within those groups you can drill down further but the direct category is always problematic because many analytics packages track page pop-up forms as new visits as well as returning to the site after a conversion process. Also remember that a session is usually 30 min, after that its reset as new.

3. Implementation – no this isn’t a metric but it is a focus you should have on a monthly basis to make sure new sites, pages get tracking added, new campaigns get tracked and that you keep researching new technology developments with your analytics package that may change everything. Having a good web developer along that has access to the servers and can make these changes is key if you’re not a developer (and no developers don’t make good analysts, a best case scenario is a dynamic duo where they are paired up and both work on projects together and learn from eachother) and the helpdesk type services available through Google are non-existent so good luck there interpreting the overly simplified online tutorials that don’t match what your clients want or answer your client’s specific needs/questions. WebTrends and Omniture are slightly better with web support but they expect you to pay a lot for it. A good independent consultant may be the fastest most reliable way to go here.

4. What people search for on your site. This can be tricky to implement but if you get this data it can be very telling. if people can’t find something on your site and search for it, you get a window into what they were thinking. this may tell you that the content you have isn’t what they want or that it isn’t as navigable as you thought. New product ideas also come from this data.

5. Where people exit from your site. This is classic application drop off analysis within any online linear process. But guess what? People don’t always think linear-ly. Expect some of this data to drop off in chunks but a small amount to drop off at all points for unknown reasons.  Its more actionable to focus on the large chunks and look at each page and the click maps for them but sometimes only so much optimization is possible here without doing real life usability testing with 5-10 people.

I’m sure there are more things that people can look into with geographic data and time on site but sometimes I think those are less actionable because you have little control over where your ads run because geo-targeting doesn’t always work well (excluding more than it includes) and time on site can be good or bad at short and long times. The content/pages that are popular on your site are also important but this is one of those custom setups that each division will need tracking by their geo-location and they never admit that so much traffic cross pollinated from each other’s campaigns. You have to read into the specific needs of your client to see if these apply and how to evaluate them without over complicating the reports. I really believe you should look at 5 key metrics or less in a report, more than that is not actionable and is distracting from your purpose/process of improvement. 

There is also a difference between researching a question/metric once, and doing it monthly when it never changes. I don’t believe its a good use of time to report on time on site if its been consistent month over month for the last 2 years. Check in once a year and leave the other data to be reported monthly, save the analyst’s energy for the new questions that need answering and trust your site.

What else do you think is applicable? Any feedback?

The Negatives of Social Networking Media

All the world is a Buzz about Facebook & Twitter these days. It’s almost like MySpace circa 2007, Google circa 2003 or Microsoft circa 1998. I don’t doubt the success, innovation or long-term viability of these social networking sites but I have seen that there are flaws in the system that mean that things won’t be perfect with the business along the way and we’re in for a bumpy road. Basically my point is that for all these sites give us in entertainment, social connections and opportunity they also have some negatives that are almost the equal and opposite pendulum action.

1. Time Suck – all social networking sites are using your time that you used to devote to other things. Maybe in some cases this is actually a better use of your time (instead of TV) but in most cases its time spent that you used to use for researching new information for work projects,  time actually spent talking with people in person (family/friends) or time spent doing things that really need to be done at work or home. Once the brain gets trained that you can go socialize instead of work at those times of day it’s a habit extremely hard to break. For all of us procrastinators looking for instant gratification its a real problem keeping up with work and affects the overall productivity of companies and the country as a whole. Internet access is much more prevalent and has far more users during the business day than it does at night, so there’s the proof. Unless your job is trolling these sites for sales prospects by “connecting” and making “relationships” with your customers, its a waste of time to spend more than 15 min a day.

2. Privacy – Of all the details analyzed about consumer privacy online (on Facebook) in the last few weeks the most suprising thing I’ve seen is that people really don’t care about their information online. Sure, nobody is going to post a ss number or cc number on their profile (duh) but they don’t really seem to realize the power of logging all their social interactions in one database and selling access to retailers and cpg companies who have even larger databases of information to analyze and strategize with. Is it really as fun when most of your friends are companies selling you things all the time? Twitter already has morphed into the largest opt in direct marketing platform I’ve ever seen. If people keep using it at this rate it will surpass email. The other obvious issues come with the work life balance thing and when people friend work makes and think nobody will see them rant about work or post drunk pictures on a sick day, but then again I’ve heard that its just people naturally selecting themselves out of the working pool.

3. Logic – the other issues I’ve seen coming for a while have to do with how everything that is built from large databases online with lots of consumer data seems to not work properly. There is always some algorithm developed by a science tech guy based on some theoretical calculus and it doesn’t provide relevant results. Which brings me to a repeating theme of data right now: we don’t really know what to do with it yet. Nobody knows enough real info about their customers to target them. (who has a budget for that?) And the database people just like to say they improved things a statistically insignificant amount with an algorithm tweak. The marketing strategy/process should always start with offline real life information about people and products and then develop an algorithm to show you information in that way. I don’t know why it’s always done backwards but it will keep our results irrelevant and marketing dollars wasted for a long time to come.

Ways Google Has Changed Media Consumption Behaviors

I was glancing at Google Fast Flip today and it struck me that they have been successful not only in providing what people want but in some ways changing human media consumption behavior.

We all know that Google has turned the media world upside down with the humble text ad because of it’s ad matching relevance and pay-per-click business model.

They have up-ended the rest of the media world because they have influenced people to stop using it. This may be completely un-intentional, but I think it has happened.

The obvious way is that Google has  gained brand preference as a reference tool and a information source on limitless topics. But there is another behavior that they have changed is not usually talked about.

This change in how people consume information is that they can scan headlines now and glean what has happened in the world without actually viewing the ads around the content. (or visiting the content site, via rss, email, search engine, aggregator or google news) This has been bad for online ad inventory (although some may say we need less inventory to drive up prices, not more) and worse for recouping the cost of producing the content.

I don’t think that Google is stealing anything like copyrighted material by linking headlines from Google News, the search engine or screen shots Google Fast Flip. That would be like saying you are stealing copyrighted material by cutting out an article about a local festival coming up and posting it on the break room bulletin board for your coworkers to see.

I do think there does need to be revenue sharing for content sharing on some level though. How this should come about, I haven’t the slightest clue yet. And it can’t happen in the search engine because it seems to vast to fully comprehend let alone orchestrate.

I do think Google wants to be in the media business without actually producing any content, and they don’t usually ask for exclusivity with that content. Google wants to provide more products for consumer use and consumption of information branded offline. If they offer basic content for free on these product/services and upgraded content for a fee they should share the fee with the content providers. The rates may depend on usage and of course demand, and they will probably always be in flux. (no more rate card anything)

Yet I think it’s important that these shared fees (content payments) should be as low as Adsense revenue share since Adsense revenue is largely regarded as welfare for website owners. It needs to be enough to incentivize content providers to really feel like Google is a partner in their business and devoted to a positive business relationship.

The alternative may be that someday you have to pay a large content creator to crawl its site and republish parts of the content. Yes sharing is good, but if the content borrower doesn’t bring in enough revenue (analytics can tell you if your google news readers view, click or buy things) then is it profitable to be hosting the traffic from that source? (yes, hosting costs a ton of money for large content sites) I guess everyone thought they could replace millions of dollars in branding with a simple search engine relevance project and all their traffic generation problems would be solved. It’s never that easy. You have to own the relationship with your customer, you can’t outsource that to Google or anyone else.

Trust is also one of the BIG hurdles Google has to overcome to really being a star in the B2B space. Google has always believed that any process can be automated by a computer and nobody needs to talk to a human because humans are either too expensive or busy engineering things. This seems to enrage some humans, mostly the ones that run large companies. Also, No customer service and No sales people that can actually answer your questions along with ridiculous inflated PPC rates have actually eroded their text ad client base in the last 2-3 years. (and that whole display thing isn’t really looking great for ROI either when you consider people under 30 don’t respond to them at all)

So, in order for Google to really keep that growth going, they need to compensate content creators when re-publishing their content on/in their branded products in the future or the content creators with the greatest authority won’t be there for very long. Yes, some laid-off journalists are blogging but in 20 years how many will be left doing any journalism at all if it doesn’t pay and very few newspapers exist?

I also think all businesses need to stop every few months and think about the future. We’re too busy overloaded with tasks from laid off coworkers to really do this, but in a profitable world we would make time to consider where things are going in 3,6,12 and 24 months out (not a swat analysis, those take too long and are somewhat cumbersome) and really think about what they think the business should be doing to compete and win and innovate.

Why I dislike Large Blogs

I love blogs. I have been blogging since 2002 when my friend Mugsy emailed me and told me to sign up for LiveJournal. A lot has changed about blogging since then, but the revolutionary idea that if you can type, you can publish easily in a word-processing-like interface on the internet has not. The method of blogging to share knowledge by and for non-programming type people is still spreading to the corners of the globe and helping people’s voices be heard in ways we never thought possible.

At the same time I am growing more frustrated with the technorati and the overload of emails, posts, rss feeds and spam arriving on my accounts daily. I am trying my best to stay on top of the active topics in  the  user generated content world as it has forked into many roads that include blogging, social networking, social ads, microblogging and a whole host of a million little startups with other concepts they want to share with the world. (more than can be kept up with or can survive even if they do all innovate)

I have had to scale back my online content consumption several times over the years when it was in danger of taking over my life and all my time. But lately this getting married thing has taken a large chunk of time out of my life too, (even after the wedding) and as a result I am trying to glean all my updates and news knowledge into smaller and smaller bits of time. (apparently being married means I have to do work around the house and spend a lot of time trying to motivate my husband to stop watching hours of TV and do things around the house. Life just got more complicated and we have to learn how to cook, fix things, do laundry and empty the cat-poop-box with much larger quantities now). My work is also very busy (analytics and metrics seem to go nuts in recessions) and no spare time is to be had anywhere in the schedule.

Therefore, I have gone through many iterations of un-subscribe weeks in my email boxes and cut back drastically on email newsletters, of which once I found very enlightening. Most marketing/advertising/analytics/metrics/SEO/SEM email newsletters  these days aren’t as willing to share any real actionable info without you spending a lot of $ so out they go.

I tried to update myself by trying an RSS reader again (3rd try) and I think its been a few months but I am overwhelmed by that too. Its way to easy to get more than 1,000 unread items in the reader and when it doesn’t tell me the exact number anymore I am less motivated to tackle it because it seems impossible.

I have found Google Reader to be good for sunday afternoon fun feed reading and more personal fun  topics/blogs though. Home design is a great topic in the reader since you really have to see it all to learn.

On the other hand I am re-subscribing to some email newsletters and just un-subscribing altogether to others who insist on posting 30-50 items per day! (assholes!) How is one person supposed to read that many posts per blog per day? It’s impossible and on some level, rude.

I know why they do this. It is partially a play to keep new items being published every few hours to keep the Internet addicts coming back for more traffic and it is also a play for search engine dominance by having more content in the engine for every possible term than anyone else. These teams of writers churn out mostly regurgitated posts about content repurposed from other blogs without much new insight. Some do deliver genuine news and content you can use but scanning through 50 posts is way slower than scanning 5 emails. The content and pics seem to load soooo sloooowly and an email you read, scan and go to what you want quickly. Big offenders of this are ReadWriteWeb (on volume and not separating feeds), Silicon Valley Insider (regurgitating and trying to predict the future even though they’re usually wrong), SEO Roundtable, Apartment Therapy (OMG, holy re-post everyone elses content and fill up with summary posts daily to waste everyones time, generate page views and sell ads), Jalopnik (jebus stop showing us every detail of the 24 hours of Lemons in every city across the country and asking us what our favorite imaginary dream car in a movie with Bruce Willis: waste of space, use summary feeds please! On a cable bandwidth line it takes forever to load all these damn images!) and Media Post (phhbbtt). ALL THESE BLOGS have been banned from my RSS Reader. Some have been demoted to email updates but others are just gone.

Also, I’m not programmed to think to go see my rss feeds yet either so I often forget about them for several days after a good several hour scanning session finally getting the numbers down to below 200 new items. then I return the next time to see 1,000+ again and feel defeated. In contrast I have OCD about keeping a clean email box, and completely forget about facebook until I am completely bored. I guess that is a sign of my age bracket. (34)

I wish that this spammy fluf put out there to fill space could be eliminated. I also wish that these blogs would split their feeds into sections so you would be able to just get the posts you were interested in. Like if new original content and re-purposed other people’s content were separated in 2 feeds, it would be a big help.

I would also recommend that they stop doing summary posts. They piss me off. I wait a minute or 2 for something to load in the darn reader only to see its the same posts from the local editions of the same blog.  Poo, if that happens 15 times in a day I could have spent that time sleeping and then I’m annoyed. 

These blogs also do this because they are in some get-rich-quick rush to make money as a profitable business before Google figures it out and bans them or something. Yes, blogs have an elitism to them that says, duh, if I can make a slice of the money publishing from what the Tribune used to, I am going to do this as fast and as hard as I can. And it over saturates the web with watered down content that is just filler mostly, even if it does increase ad impressions and some adsense revenue if you’re into web-welfare payments.

I also would like to recommend that if you want to start a blog you keep the posts to no more than 2-3 a day and resist the urge to just regurgitate other people’s posts and link to them saying how great they are. Research things you are really interested in and share your own unique experiences. Any web-bot can be an aggregator, what we need more of is real people sharing experiences and knowledge to make social media stick and not die out because of spam/splogs and info-overload. It is these people who become trusted advisors and get the visitors who come back again and again.

And this is also better for the rest of us who have to go clean the cat-poop-box and have a life offline now that they are married.

Update 10/29/09

http://scobleizer.posterous.com/why-i-dont-use-google-reader-anymore

I guess Robert Scoble agrees with me to a point, though he blames Google Reader for a bad format and experience and not the blog owners for copious amounts of useless content hiding the good stuff. I guess there is always room for improvement and certain people discover it before others depending on how they use the info/product.

Update 11/5/09

How much content is too much content? Read Write Web chronicles these mega content sites and their race to populate the web all by themselves by posting 200+ posts per day. We should call it the Answers.com business model.

http://www.readwriteweb.com/archives/the_age_of_mega_content_sites.php

The Apple iPhone wasn’t a miracle just a repurposed design from arrogant salespeople

 

It really needs a glove with the case built in for the left hand.

It really needs a glove with the case built in for the left hand.

I just got an iPhone.

 Since all the hype has died down about these iPhones 2 years later, and people have accepted this device as the most amazing thing ever I thought I would post my reactions to this nice but not miraculous device.

The first thing that I realized when I got this iPhone was that its a video iPod. (of which I also own) It is a repurposed design of a former product. That isn’t revolutionary at all.

It’s like someone at Apple said, wow I like my iPod so much I’d like to make calls from it and ditch my phone. And they did it. All the technology was already developed for a former device. Some new things did have to be added and re-engineered. But there is so much re-purposed from 5-7 years ago, the development costs were probably not that high because they knew pretty close how to use the materials to do this from past experience.

Now I see this Apple tablet image in the news and think they are re-purposing it again on a larger scale. I get the if it’s not broke don’t fix it idea, but their marketing and PR hype is a bit off.

I think these functions work really well:

  • The touch screen is better than the old Palm Treo one and more intuitive. I am impressed at how they solved the QUERTY problem with a touch screen.
  • I think the apps are also very good and its nice that they share the love with the app companies that develop them. I don’t think $5 an app is a bad price for what they deliver and plus you should think before you download a ton of apps and a cost helps you do that. The alternative is that your HD gets full and crashes quickly.
  • It syncs with Yahoo email very well, which is what I use for one of my accounts. It turns out that email is very doable on a small screen.
  • I like the pull the corners effect to read web pages and increase the size of the fonts so you can click a link. This is very intuitive.
  • The GPS is pretty good. I watched my phone show a blip of my location on a map that was about 2 seconds behind where we really were as we drove home. That is pretty good bouncing off a sattelite that fast. I think the directions from where we are to an address will be very helpful in the future.
  • Doing the convergence thing and having the phone, music player, GPS, camera and email all together works great.

I think these things need work:

  • The rss feeds don’t always work on the iPhone. Not that it doesn’t literally work, but these are items I’d like to read in more depth, and on a tiny screen its hard. Also all the links go out to the web and I am finding that I can’t get that data very easily in Chicago.
  • The web issue is still an issue with web enabled phones. I hated that things took so long to download on my old Treo 650 and 4.5 years later its still an issue with the iPhone. (heck its an issue on my computer sometimes with Google reader)
  • I think people who have iPhones use them on the go a lot and the backup for the wireless network are free wireless networks. Which means you’re in trouble if you want to download an rss feed in google reader online. (meaning the bandwidth exceeds the ATT mobile network and that is sometimes spotty with its coverage)
  •  The Metra commuter train and Chicago CTA don’t have free WiFi on their trains and busses and you can’t always find one when you are on the street either. (neither do our cars) So, there are a lot of times/places I look down at my phone and can’t connect to anything (phone or internet network). fail.
  • I feel like we’ve developed content and a device for reading things in real time that wants to be downloading info/updates 24/7/365 and the networks still look like swiss cheese or a spider web, with gaping holes in them. We need more ubiquitous universal access before these devices can really be life changing.
  • The touch screen is great but then switching to a physical button for on/off seems counter intuitive. Why not make all the functions be a part of the touch screen? I keep looking for an off button in the screen itself. 
  • The battery life is horrendus. If I read email and rss feeds on the train and bus between home and work I use 50% of my battery life. Holy Monkeys, this needs a better battery or a plug that pops out the side that you can stick in any outlet you find.
  • I also like that Steve Jobs has the kind of what I say goes power and involvement in the details to make his products good on many levels and keep the design level very high. It’s impressive he has been able to hang on to that power in a large company, it is rare to see and keeping one person in charge makes decision making faster, easier and true to the original purpose. Its how things get done if that person is well rounded in knowledge and willing to enforce what they preach.
  • There is also the annoying problem that on any field you need to enter text you can’t click to put the cursor anywhere on the field to start typing except the end. If you want to change one letter you have to backspace the entire field until its blank and start over. We need to have a click to cursor ability/function, do apples just not do that?
  • The me.com thing they sell as an add-on is cool but way way overpriced. I cited that 1 yr of Flickr unlimited access is $25 and 1 yr of full LiveJournal access is $25. Why is syncing my phone to the web $100 for the year? Assholes. I did get a small discount and got it for $65.
  • The Apple sales guy was over the top. I really hope I never have to go back to that Naperville Apple Store again. He was about 18 and very arrogant. He made me (age 34) feel stupid for not knowing everything about the iPhone or web phones and his Apple Brand Arrogance and demeaning tone was disgusting. Why ask us about our computers at home? Why rip on them in front of us? When you don’t even own one? Admit most people have windows machines and then say why you might consider the Apple, don’t just say everything else sucks. OMG, and don’t explain everything for 2 hours when I just want to buy the damn phone. Dragging things out forever and then asking 7 times if we want to buy the apple care program that I didn’t want. And when someone says they will look it up online and then decide later, don’t say look it up now on this Apple, that is a high pressure sales technique and if I didn’t need a phone that day I would have walked out of the store at that moment. Totally unethical and wrong to do to a customer while you are looking over their shoulder. So, at all costs avoid Apple sales assholes that admit they don’t even own any of the Apple products they sell.  Just buy stuff online if needed. 

The basic thing is that the phone was worth the $288 that I paid (for the 16 gig). I paid like $300 for the Treo 650 in 2005. I think if this works for a few years it will be ok, and worth the purchase. But it really doesn’t need the hype or the arrogance.

SEO Update from Chicago

Everything just got a bit harder with the new Google Caffeine update for the search engine. If you haven’t heard about it yet you can check out the API to see how your website will rank in the new engine compared to the old engine.

I would say that most people began to understand the old engine in a logical way from experimentation over time and many businesses thought they were just “following the rules” building sites in a way that fit with that logic. Now the new engine will be completely different and all that work will be gone. I looked at some sites and saw how they will compare between the 2 and the results are a challenge.

One site went from 12th to 44th for a key search term. Another went from 5th to 23rd. It is almost universal that everyone who develops a business model around search will be hurt by the change whether they are spammy or not.

I am all for reducing and removing spam/affiliate networks/link schemes from google to reveal the real content but the actual companies with the products/services/tools that businesses and professionals use will be hurt by the update and some may suffer financially as a result. Google just doesn’t have the human ability and reasoning skills in a robot algorithm to tell whether a site is spam or not. They’re going after spam and hurting other legitimate businesses.

Investing in marketing might be something we start looking at like investing in stocks/bonds/401K/the market. They have had long standing recommendations on asset allocation between stocks/bonds/international funds/currency and other types of investments. They associate risk levels with each one and say things like; invest the percentage in bonds that matches your age or diversify and reallocate to maintain that level of diversification between investment types 2-3 times per year.

Investment Strategy with Marketing may look the same someday. SEO might bring in X% of revenue and cost Y% of budget but is highly risky, so you don’t invest as much in it, because it is all potentially going to vaporize when Google decides to update. Things like Branding on TV and Radio and Outdoor are more expensive and not trackable, but companies have been using them for decades and they are very low risk. You spend that money on awareness and people know who you are after that. PR is another wild card and social networking (viral) marketing is another component with low cost and high risk.

Companies may want to diversify their marketing and advertising dollars based on risk as well as the ROI because within a few clicks of a mouse in California, the entire web changes and all your efforts may go up in smoke. This idea definitley favors the old methods and in some ways, internet banner ads. Display advertising on the internet is way undervalued right now and people are also starting to look at ads online like they used to on TV. They are actually paying attention sometimes. The conversion rates have gone down on average, but for mainstream brands and trusted sites they are near 5% (up from .01% years ago) when you include post impression data (people who never clicked, but went to your site anyway).

So, I guess the mood I am feeling today is one that is cautious optimism about old advertising methods in light of Google pulling the rug out from under companies, in the way they always do. It doesn’t help that adwords pay per click costs are as high as $20 for many mainstream words and can go as high as $100 perclick. Then when the conversion rates are so low, nobody will pay that. Most of my clients are abandoning ppcads and someday may do the same with SEO. It just doesn’t pay.

Why the Microsoft & Yahoo Search Deal Sucks

I blogged about why I thought that the Microsoft and Yahootalks were not going to yield anything useful last year and was satisfied that they stopped wasting time trying to buy each other out of financial trouble. Now it has been widely reported that Microsoft has gained access to Yahoo in a search partnership deal. This is somewhat better but again, the executives have not listened to the public.

1. This Yahoo-Microsoft deal still sucks for several reasons. One being that Microsoft Ad Center is the ad display engine being used in the partnership and not Yahoo’s Panama. Neither have the depth or ease of use of AdWords. Anyone who has ever placed any pay per click search ads in their life would choose Panama over Microsoft Ad Center as the system to use. Maybe MAC makes more money but there are too many limits on bids, keyword availability and restrictions on running your ads to make it widely accepted.

2. The recent Netflix prize showed how much collaboration benefits organizations rather than competition. The revenue share partnership deal usually shares no information about technology or business strategy at all between companies. Its a you win, I loose, I’ll just pay you for handling this for me-approach to solving a problem, that doesn’t work in the long term.

The Netflix prize was recently awarded when a group of individual competitors and small teams banded together to use all their ideas in combination to finally get above the 10% improvement mark in matching/suggestion technology and submit their top result. In the last day before the time was up, another group of researchers banded together and topped the previous best submission also by combining all their ideas together at once.

Then in the last 12 hours the first team did come back with another submission just slightly better,  to win,  but the overall idea/lesson is still the same. If you really want to improve on consumer products and experience with really complex technical problems like search and suggestions, you have to collaborate rather than compete.

Yahoo and Microsoft would do a whole lot better against Google if they got the Bing folks together with the Yahoo search folks and started collaborating on this daily via videocam rather than doing an affiliate marketing type deal. This deal is evidence that Microsoft is being run by the lowest common denominator these days (and loosing a lot of money that way) and Yahoo’s CEO won’t be around long. She has made a decision that helps her contain and cut costs of running her company in the short term and that decision has sacrificed the long term marketability of her product.

In fact Yahoo was a search company primarily. People only used email, Yahoo news and other functions like Yahoo Answers because of the search engine they knew. If you take that away you don’t have an identity as a company. And they will lose a lot more search market share and preference by outsourcing to Bing even if they get paid a little bit more profitably in the next 2 quarters. This is pretty much the death of Yahoo. It is really sad.

New Media and New Information Paradigms

I have been hearing about the demise of the newspapers, the rise of search/social networking/new media and the internet fragmentation concept for years now. (almost a decade?) And I just read about it again today with the newspapers secretly meeting to try and sort out monetization methods to save their business. At the same time I am a Guinea pig living through this time of change/shift in how people find information, use information and consume things. Here are some of my observations although not in a concise dissertation format yet. 

  • We are at an odd time in internet evolution, on pause between big developments. We got email, IM, web sites, RSS feeds, Blogs, social networking and now Twitter. We don’t need more services or ways to interact on the web. We need better all inclusive ways to connect and consume all in one. Ways to make the experience more relevant and more inclusive of many kinds of content at the same time. Not wasting our time.
  • I can’t help but notice that at 33 I have never really “read” a newspaper. This indicates to me that newspapers were not that important back in the 1980’s to my generation when their profits were healthy and the internet was but a dream for most of us. (Except being something to line litter boxes and bird cages with.) I hate the size format, I hate the ink and I always have. I actually like the ads though, especially the Sunday fliers. 
  • Weeks go by without my watching any TV. This started about 3 years ago when I got high speed internet. It’s not that I don’t like TV, I just don’t have time to sit for 2 hours plus and I know if i sit down I won’t get up and get anything accomplished in the evening/weekend. And I don’t like overly repetitive things. I was watching the sell that house shows on HGTV to get ideas about how to sell mine and after about 3 I got it and didn’t need to watch any more. Reruns aren’t nostalgic to me really, more just boring. And reruns is all Cable TV is about.
  • The only TV I will drop everything for is Top Gear UK. When it is in Season we trek over to my parent’s house and watch wwith extended family weekly. Everybody drops everything to watch that show. It makes you laugh, it makes you dream of fancy cars and it inspires you to take grand adventures regardless of what the outcome is.
  • This leads me to a general cluelessness about a lot of local and newsworthy (?) events. Things like buses that are Hijacked and what the weather will be tomorrow. I also find that these things weren’t essential to me in the first place. I carry an umbrella, what’s the big deal?
  • I find myself focusing on things I’m interested in. Maybe this is the political polarization people speak of? I read my marketing emails/newsletters/blogs as well as home design blogs and write my own blog as well. I check status on Facebook/Twitter/Flickr and maybe update if I have something interesting to say. And I work a lot. I also am always investigating 2-3 new directions for my work/career. Not all of them pan out, but they help me figure out what is evolving that I need to know about.
  • I do still use the phone (yes the land line). It is the best way to reach my parents and Steve’s parents. Steve’s parents email but mine are not really into it. And we try and go visit once a week in person. In person time still matters.
  • I am a book reader because I am a train commuter. I have been for years now and it has created a small library of business/marketing/analysis books. I order from amazon when I see something I like and then go consult the pile of books for something new.
  • And that is all I have time for. Now with a husband (fiancee really for one more month), 3 cats, 4 litter boxes, a yard, wedding planning, condo selling, house hunting, family organizing, laundry, food shopping & cooking I am overbooked. I don’t even get to skype/call my friends very often. A party invite seems really daunting these days with the schedule we keep.
  • I wonder about new media uses and if we will really care about anything not personally relevant to us in the future? Will a police chase matter to everyone in Chicago or just the people who live by the highway where it happens? Will we be less distract-able by sensational news and distracting entertainment? Will we be able to channel the news, information and analysis we really need into our lives and ignore the products/content we really don’t care about?
  • On the other side of the coin, how will we ever discover new things? I find myself looking to find out what is happening on the internet a few times a week and look to Google News and the Yahoo home page. Not the Trib. Yet somehow the list at these sites is always limited and not really anything relevant either.
  • There has to be something in-between a completely open fire hose of information and one select rss feed with just content from one niche area. There has to be some middle ground between being hijacked by ads for 20 minutes of a 60 minute program on TV and not knowing at all where to find a dress for my rehearsal dinner when my usual 5 clothing websites didn’t pan out. (who has time to go to a mall?) ((and why does Google shopping suck when the main search is generally good??))
  • People won’t pay for news. Period. They will pay for some kind of extra relevant cool service though. They will pay for innovation, new products that are noticeably better for some reason. Things that simplify your life.
  • Ads should not be integrated more with content as if they were the content. It blurs the line in what is really true and what is marketing speak. And although they may pay the bills for a while, people will eventually figure it out and abandon that medium that does this.
  • We need another search player. Google is not enough and although they do some things well, I am not a fan of everything they create. I would like more companies to work on real time indexing of information as well as historical archiving to keep information accessible if anything happens to Google’s accessibility. At some point people will be so hooked they will be able to charge for a (low cost) subscription to the search engine itself. 
  • More people need web enabled phones with internet use active. I just read yesterday that out of 57 million people in the US with internet capable mobile phones only 18 million have internet enabled! (netpop stat comparing us to China) 31.5% of the people with internet use phones don’t even pay for internet access? (only 13% of all the cell phones total) This is a huge hurdle to making info more relevant and accessible because people carry their phones everywhere. Things like bigger screens, flatter profiles and easier software app use on these phones will help the adoption rates improve. 
  • Identity management and security is also a problem. We might like something like OpenID but only if sites still allow anonymous comments too. Privacy and being able to say something important without being hunted down in person for your opinion necessary for getting people to adopt this identity management software and make our lives easier between all the hundreds of web sites and e-commerce activities we do in a day and consolidating that information for our own personal use.   
  • Data mining is going to have to improve. If statistics are wrong 25% of the time like stated in the Numerati book, we really need to combine automated data crunching with human decisions about data more often. Numbers are meaningless without someones explanation. This completely changes what and how data is configured, crunched and reported and can determine/undermine your results even if you manage to collect it perfectly.
  • All this plus the only way out of a recession is through innovation. We’re waiting.

TopGear Weddings and Marketing

Those are three things I seem to be talking about this morning.

1. I am slightly jealous that the TopGear crew already incorporated themselves into someone’s wedding and therefore probably won’t be able to find a way into mine at Cantigny in the suburbs of Chicago. Bummer. Maybe we should rent the corvettes then? As an homage to TopGear and our love of cars? Read the full story here at the Daily Mail from the UK. And the Sun UK. Maybe we can do some kind of challenge in getting from the wedding ceremony to the reception? If any of the TG crew reads this blog thanks for including my ideas if and when that ever has possibly happened.

2. Wedding Planning is arduous and totally consuming of every second of free time you have when you are this close to the final date. I haven’t been updating this blog because there are so many things to manage. Oh and did I mention the I have to move out of my condo in 3 weeks also? It finally sold after 6 months of marketing and price lowering. Maybe moving would be a good TopGear challenge? Just don’t let them plan a wedding, that would be disasterous. No amount of compensation for mucking up would help fix that after the fact.

Between figuring out who will be attending, seating charts, making things like name cards and menu cards, making tiny bows on wedding favors, picking the set lists for the music, meeting with the church minster, and the soloist, seeing a test run of the flowers, getting the gown hemmed, insisting that the groomsmen and fathers to finally go rent their damn tuxes already, and matching the table runners and who knows what the f else, I have no time. It is a bit frustrating already. Now that I think about it, I am about ready to offer to turn it over to the TG folks out of frustration and a lack of sleep. I almost don’t care how it turns out, I just want my life back.

3. It hasn’t helped that I have been swamped with work either during this time, so I haven’t been able to blog about new online marketing trends either which is what I do for a living and should be easy and quick to write about. But I am working 12 hour days for difficult clients right now, so this isn’t happening either.  Anyway, it will be a while until this blog is updated regularly again, but I do plan to be back starting July 12th.

Update; the only TG tie in at my wedding was that we had a TopGear Table and a Nurbergring Nordschlefe Table. We also had a Star Wars table a Les Chats Table and a bunch of others named after our hobbies and interests.

Can ordinary people manage the risk in the stock market for their retirement?

I am beginning to think there is no way an average American can invest in the market and make any money for their retirement in a 401K. I was reading this morning that 5 and 10 year returns in the portfolios of most mutual funds are negative now when they calculated in the huge losses from recessions in 2001 and 2008 and the beginning of 2009. (Q1 hasn’t been kind) 

As an investor (for my 401K) I look at that and say: yuck! Why would I put my money in something that has no long term value?

My fiance sent me this article saying that now 20 and 30 years are the benchmarks for best overall performance in mutual funds and stocks in the market. Yikes! 20-30 years? Who has that much time before retirement? Who can invest for that long anyway?

When you consider that most people’s salary starts dropping when they reach their 50’s (because employers don’t value old employees and can’t spend time/money updating their skills) you really have 25 years max to work with as far as investments for retirement.

You start your first real paying job with a 401K at age 25 and you may not be fully employable by age 50 although you will likely live to the age of 80 or 90.  There’s your 25 years to save and invest for 30-50 years of retirement.

I also think there is something else going on here affecting the 20-30 year market profit numbers. The US Markets benefited from a long term technology/innovation and growth curve from WWII to the 1980s. Personally, I think that was a one time deal and we will never see that kind of long term prosperity again.

Why? 1. Because we don’t understand enough about technology to innovate on that level again to create that much growth. 2. Because the US has higher paid workers than anywhere else in the world and everything gets manufactured and produced (and serviced) somewhere else. 3. Because we’re too complacent and have too much entitlement as a country of workers. Work creates wealth, not shell games with securities.

That brings up another point: We’ve been playing a shell game with our economy since the 1980’s. De-regulate, re-regulate, stimulus, fix, fund, trade, outsource, sell, leverage, whatever… It’s all a shell game to us worker bees and the internet has been the only significant improvement in technology to create new industries and jobs in the last 20 years. We need more than that to survive and prosper as a nation and a world.

I don’t know about you but I can’t stand to take that much risk with my money. I have some in a 401K but mostly my retirement is locked in a 5 year CD IRA at 5.25% that was a promotion this fall when banks wanted more cash reserves. I changed companies in 2006 and rolled over the old 401K to a bank in 2007 because I knew the 10 year recession was coming soon and I didn’t want to risk timing it.

There will always be people who game the market and come out ahead, but those of us without finance degrees, huge money to invest in undervalued markets or inside scoops will never really profit on the whole. Many of us will get out exactly what we put in and maybe less considering our lack of  investment prowess. So, in that level of risky why not just put it in the bank? Positive 3-5% sounds a lot better than negative 40%.

I hate the inflation argument that says that 3-5% isn’t enough to make money after inflation. Guess what? Inflation has been very low and inflation doesn’t stop when you have negative returns either. I’d rather have some money dependably than none at all when prices are higher. 

You may be asking why I want more innovation and less investment in the market? Doesn’t investment in the market lead to more innovation?

NO. Most of the mutual finds and stocks you can buy that are highly rated are in huge old (one trick pony) risk averse companies that have already peaked and can’t figure out how to do anything new. They sell shares to raise cash and then have old people make decisions like the old days. Venture Capital,  new small businesses and Universities are the place where innovation happens. If I could invest in those, I would. But then again I don’t have millions of dollars and apparently I won’t any time soon.

What are the best proven ways to fund your retirement and create wealth then?

1. Have a side job for extra income you can save (part-time weekends or evenings a few nights a week)

2. Own rental property for extra income (you need to live near it for this to work)

3. Have fewer kids if you’re contemplating having a family (ok we don’t always control this, and we love kids, but nobody is going to debate that they are expensive) 

4. Own a smaller home (smaller mortgage = smaller amount in interest paid (lost) to the bank)

5. Don’t go into debt on credit cards or car loans (hello! 25% interest, MONTHLY! on some cards)

6. Live frugally generally, keep your cars 10 years, don’t buy new clothes every month and don’t buy big ticket items like TVs and Computers every few years. Spread out the expenses over the long term.

7. Share what you have with others. Seriously, knowledge, help with projects, donating time and donating items you no longer need, as well as hand me downs between families help kids and neighbors live better within their means and help the community live better too.

8. Take care of your health. Eat less junk, lower fat, lower salt, lower carbs. Exercise daily. Take vitamins. Don’t work in an industry that has a side effect of cancer. Visit the doctor regularly and if something comes up treat it early, it will cost so much less in the long run. Heath issues start in your 30’s and get more frequent in the 40’s, 50’s and 60’s. Expect to pay more every decade for health costs in your life/budget.

These are all real tactical changes we can make to save more money monthy and yearly that will get better returns than the stock market and help prepare for inflation. What else do you think can help?

Chicago CTA Rant – Where are the Busses? Commuting Problems

I have been a commuter in Chicago for about 3 years now. I was initially excited to abandon my car in it’s parking space during the week and walk to the EL train and then to work every day. I have saved a bucket-load of cash not paying for gas or parking downtown since I have worked in that area. I was able to get to work in 1 hour from door to door, and it would be faster if I caught the CTA Train right when I got to the station. It was never more than a 10 minute wait for a green line though.

All these things changed recently when I moved in with my Fiance in Warrenville. (I had been living in Oak Park for the last 7 years) Now I am only tied to downtown Chicago by the METRA trains. Which is very frustrating since the BNSF only comes in to Union Station which is all the F way over west of the loop and not walkable to Michigan Avenue. 

This means you have to fill that gap with more public transport since cabs are too expensive to take every day. Your choices are the CTA elevated Trains which aren’t really by Union Station or Michigan Avenue either or the CTA Buses. Everyone said the Buses were the way to go. And for all the ranting about Metra, the CTA Buses have ended up being far more problematic than the Train. (although the train has been so packed the last 2 days that people have been standing in the isles in all the cars)

This morning for example it was a 1/2 hour wait for a 121 bus by Union Station. WTF? They are supposed to run every 12-15 minutes per the CTA Site. Last night was no better. I caught the 151 bus to Union Station for a change (most days I wait a 1/2 hour for that at 6 pm also) and then there was no Train until 6:50 pm. I spent a 1/2 hour sitting in the train station doing nothing. Where was the 6:20 BNSF?

That is the first time a METRA train has been missing but the CTA buses are there at about a 50% rate . I can walk to the train station in a 1/2 hour, but if I can get a bus it only takes 15 minutes (even stopping on every block). But if I knew there would not be a bus for a 1/2 hour I would just F-ing walk.

I get to start working from home on Fridays this week. I won’t miss the 1.5-2 hour commute each way.

How have your experiences been with Chicago CTA & METRA commuting?