About one year ago, everything changed for me and for our community.
A tragedy that struck home so hard it shook us to our core.
A dear friend, brilliant mind, adored father, respected colleague … the list goes on, left us in a way that hits straight to the heart and wakes you up like very few other events can.
I certainly woke up that day. That alarm screamed as loud as it could and I still hear it to this day.
I know I wasn’t alone. So many of my peers experienced similar emotions, sensations, and reactions.
We Could No Longer Ignore the Problem
Sadly, this wasn’t the first tragedy we’d encountered that year – we lost other friends and colleagues as well.
But we knew we couldn’t stand to lose any more amazing people.
We couldn’t look away. We couldn’t just carry on anymore.
So we started talking.
I have been blown away by our internet marketing community. Many of us have never even met face to face and yet the comradery, the friendship, the support among us run rampant!
Never before have I seen a group of people come together so quickly and so openly as when we were forced to face this tragedy.
Groups were formed. Calls were made. Texts were sent. Face-to-face get-togethers were had. Columns like this one were created.
And the best part of it all? It didn’t stop!
We saw the need to stay connected. We recognized that we are a family that needs to support each other. And, perhaps most of all, we saw that we were not alone in our struggles.
It has been amazing to see the openness and honesty that has become so commonplace over the past year. I have seen people that once felt they couldn’t risk being seen without their mask on break down and lay themselves out in the most vulnerable ways.
I include myself in that list. I have become more able to reveal myself to the world around me. That has only been made possible by others sharing in that journey with me.
In leading up to this piece, I knew that I wanted to really find a way to focus on the positive changes that our community has seen because of Jordan Kasteler.
I wanted to honor him in a way that really brought some form of good to this incredible loss that we all experienced due to his passing.
Where Are We Now? Thoughts from Our Community
I reached out and asked a few people in our community if they would share some words of how they have been changed for the better as well as how they have seen our community as whole making changes to support each other over the past year.
Here is what they had to say:
“Working days, nights, and weekends was normal for me a few years ago. However, at that time I couldn’t say that I was really happy. I didn’t understand at the time that my work-life balance was completely off, and I now know that that could have developed into something truly horrifying.
I eventually reached such an emotionally unstable point that I hit a time where one week I was super productive, but the following week I felt hugely demotivated and absolutely miserable. (I know this is a familiar story with many others as well, I hear people telling similar stories and sharing similar experiences regularly.)
Over the past while, I have been working diligently to save myself from this emotional trap. This new focus has led me to investing more time into things that are not related to work and putting more time into the things that help to create a happier life for myself.
I can see that more people in our community are becoming more aware of the need to make this sort of a switch to their schedules and priorities as well, which is brilliant to see!”
“In the past year, I have noticed a massive shift in our community not being ashamed to reach out and ask for help, advice, or just a kind word. I feel like masks have been dropped, and people are not embarrassed to discuss what make them “real”; I love it!
I think many people used to feel they had to have public persona that was acceptable, and now they know we all have issues and it is OK to talk about.
I have a picture of Jordan out that I see every day. I moved past the guilt and the pain when I looked at it, and he is now a daily reminder to stay present with my friends as much as I can.
And, it is a reminder to me to stay focused on my well-being as well. I tend to overwork and do too much for everyone and end up exhausted. I take steps now to take care of me more than ever before.”
“Though I’ve been in the industry for years, I’m still a somewhat newer member of the SEO community. Call it fear of rejection, social anxiety, whatever, I’ve always been nervous to put myself in a position to be judged by my peers.
It really wasn’t until I was invited to an amazing Facebook group made up of a small close-knit group of industry peers focusing on supporting each other through the day-to-day struggles that I realized that nearly everyone shared the same fears, anxieties and experiences that I have.
What a relief it is to know there is a place where we share what we are feeling and have so much empathy! Finally I have a place I can turn to where people understand me.
Even if I don’t share as much as others, I have peace of mind knowing there are people there ready and willing to listen and help, where there’s no judgement, just open arms.”
“We’ve definitely made a lot of progress over the past year as a community. However, if I’m being completely honest, we still have a long way to go. I’m still hearing about issues of bullying. I’m seeing people piling on people they disagree with on Twitter.
While, thankfully, these are in the minority, the polarization and black-and-white thinking needs to stop. The judging and assuming needs to stop. The trolling and “mob mentality” needs to stop.
We need to stop fighting each other and start lifting each other up – treating everyone like human beings. Nobody is perfect, but I hope we will continue to see more people be able to let go of their hate and negativity to accept love and positivity into their lives. I know that will continue to be our aim with Friday Focus – to remind everyone that they are not alone in their struggles.
Ultimately, though, I am so happy to be a part of something so positive in our community – and it’s great to see so many others jumping onboard, too.”
Kim Krause Berg:
“It’s easy to assume that your peers are generally doing better than you, making more money than you, and are super successful in every way. It is only in the past few years that I realized this is baloney.
I respect people who remove their masks and show who they really are. We are people with lives and struggles, heartache, depression, and pain.
In the past year I have opened up more and made new friendships as a result. We have more in common with each other than we might think.”
“Over the past year I’ve seen an incredible shift in our community.
Social media itself breeds an environment where we see only the best of our peers and post the best of ourselves and being in marketing, needing to be on social media, needing to market ourselves on social media and seeing only the best version of those trained in presenting the best version of themselves – one can feel very alone in difficult times. Compounding that we face an often isolated profession where even sitting beside someone, we are focused on a screen and all they contain.
Sadly, we all know too well what that leads to, and over the past year we collectively recognized that we are human. That those around us are human. That others need support and perhaps most importantly, that we do too.
We finally heard the words spoken all too often after those tragic events, “If only they had asked for help.” And we took it upon ourselves to do so.
We finally knew to listen, to watch and to find out how those around us were doing, lest we face the loss of another friend who we would have dropped everything for, ‘If only they had asked for help.’
The community has grown it’s heart and soul over the past year.
There is still a lot to do. There are still many who don’t know where to turn. Many who don’t know who to talk to. But each time we reach out and each time we talk about challenges openly, share our own and listen to theirs … each time we do that, the community grows it’s heart a little more.
It has been a incredible year of change. While we will forever mourn the spark, the now burning fire keeps us all warmer.”
“One thing that has changed dramatically in our industry over the last year, is that as individuals, we’ve become a lot more vocal about asking for help when we need it.
I think most people are more than willing to help each other. They just have to know that someone needs help. Now that people are starting to open up more about their personal struggles, the community is able to better support them.”
I want to take this opportunity to thank all of you – whether I know you in person, whether I know you online, even if I don’t know you at all –- thank you for being here.
Thank you for caring and sharing and being a part of the positive change that we are all working so hard at creating.
Keep being a force for good in our community.
Together we will make a difference.
This piece is written in memory, honor, recognition, and gratitude of Jordan Kasteler. For all that he gave us, shared with us, taught us and left us with. We are eternally grateful.
***PLEASE DO NOT STRUGGLE ALONE! Reach out, ask for help and know that you are valued. CLICK HERE for a list of phone numbers for Suicide Hotlines around the world.***
The majority of consumers (80% – 90%) routinely consult reviews before buying something, whether online or off. The powerful influence of reviews on purchase behavior has spawned a cottage industry of fake-reviews, a problem that is growing on major sites such as Amazon, Google and Yelp, among other places.
Just over 2% of reviews submitted were fake. TripAdvisor is one of those other places, where reviews form the core of the company’s content and the principle reason consumers visit. How much of the review activity on TripAdvisor is fraudulent? In its inaugural TripAdvisor Transparency Report the company says that 2.1% of all reviews submitted to the site in 2018 were fake. (A total of 4.7% of all review submissions were rejected or removed for violating TripAdvisor’s review guidelines, which extend beyond fraud.)
73% blocked by machine detection. Given the volume of review submissions TripAdvisor receives – more than 66 million in 2018 – that translates into roughly 1.4 million fake reviews. TripAdvisor says that 73% of those fake reviews were blocked before being posted, while the remainder of fake reviews were later removed. The company also says that it has “stopped the activity of more than 75 websites that were caught trying to sell reviews” since 2015.
TripAdvisor defines “fake review” as one “written by someone who is trying to unfairly manipulate a business’ average rating or traveler ranking, such as a staff member or a business’ competitor. Reviews that give an account of a genuine customer’s experience, even if elements of that account are disputed by the business in question, are not categorized as fake.”
The company uses a mix of machine detection, human moderation and community flagging to catch fraudulent reviews. The bulk of inauthentic reviews (91%) are fake positive reviews TripAdvisor says.
TripAdvisor says that the review fraud problem is global, with fake reviews originating in most countries. However, it said there was a higher percentage than average of fake reviews “originating from Russia.” By contrast, China is the source of many fake reviews on Amazon.
Punishing fake reviews. TripAdvisor has a number of penalties and punishments for review fraud. In the first instance of a business being caught posting or buying fake reviews, TripAdvisor imposes a temporary ranking penalty.
Upon multiple infractions, the company will impose a content ban that prevents the individual or individuals in question from posting additional reviews and content on the site. It also prevents the involved parties from creating new accounts to circumvent the ban.
In the most extreme cases, the company will apply a badge of shame (penalty badge) that warns consumers the business has repeatedly attempted to defraud them. This is effectively a kiss of death for the business. Yelp does something similar.
Why we should care. Consumer trust is eroding online. It’s incumbent upon major consumer destinations sites to police their reviews aggressively and prevent unscrupulous merchants from deceiving consumers. Yelp has been widely criticized for its “review filter” but credit the company for its long-standing efforts to protect the integrity of its content.
Google and Amazon, in particular, need to do much more to combat review spam and fraud. Hopefully TripAdvisor’s effort and others like it will inspire them to.
About The Author
Greg Sterling is a Contributing Editor at Search Engine Land. He writes about the connections between digital and offline commerce. He previously held leadership roles at LSA, The Kelsey Group and TechTV. Follow him Twitter or find him on LinkedIn.
When optimizing our websites for crawlability, our main goal is to make sure that search engines are spending their time on our most important pages so that they are regularly crawled and any new content can be found.
Each time Googlebot visits your website, it has a limited window in which to crawl and discover as many pages and links on your site as possible. When that limit is hit, it will stop.
The time it takes for your pages to be revisited depends on a number of different factors that play into how Google prioritizes URLs for crawling, including:
XML sitemap inclusion.
Position within the site’s architecture.
How frequently the page changes.
The bottom line is: your site only gets Googlebot’s attention for a finite amount of time with each crawl, which could be infrequent. Make sure that time is spent wisely.
It can be hard to know where to start when analyzing how well-optimized your site is for search engine crawlers, especially when you work on a large site with a lot of URLs to analyze, or work in a large company with a lot of competing priorities and outstanding SEO fixes to prioritize.
That’s why I’ve put together this list of top-level checks for assessing crawl hygiene to give you a starting point for your analysis.
1. How Many Pages Are Being Indexed vs. How Many Indexable Pages Are There on the Site?
Why This Is Important
This shows you how many pages on your site are available for Google to index, and how many of those pages Google was actually able to find and how many it determined were important enough to be indexed.
2. How Many Pages Are Being Crawled Overall?
Why This Is Important
Comparing Googlebot’s crawl activity against the number of pages you have on your site can give you insights into how many pages Google either can’t access, or has determined aren’t enough of a priority to schedule to be crawled regularly.
3. How Many Pages Aren’t Indexable?
Why This Is Important
Spending time crawling non-indexable pages isn’t the best use of Google’s crawl budget. Check how many of these pages are being crawled, and whether or not any of them should be made available for indexing.
4. How Many URLs Are Being Disallowed from Being Crawled?
Why This Is Important
This will show you how many pages you are preventing search engines from accessing on your site. It’s important to make sure that these pages aren’t important for indexing or for discovering further pages for crawling.
5. How Many Low-Value Pages Are Being Indexed?
Why This Is Important
Looking at which pages Google has already indexed on your site gives an indication into the areas of the site that the crawler has been able to access.
For example, these might be pages that you haven’t included in your sitemaps as they are low-quality, but have been found and indexed anyway.
6. How Many 4xx Error Pages Are Being Crawled?
Why This Is Important
It’s important to make sure that crawl budget isn’t being used up on error pages instead of pages that you want to have indexed.
Googlebot will periodically try to crawl 404 error pages to see whether the page is live again, so make sure you use 410 status codes correctly to show that pages are gone and don’t need to be recrawled.
7. How Many Internal Redirects Are Being Crawled?
Why This Is Important
Each request that Googlebot makes on a site uses up crawl budget, and this includes any additional requests within each of the steps in a redirect chain.
Help Google crawl more efficiently and conserve crawl budget by making sure only pages with 200 status codes are linked to within your site, and reduce the number of requests being made to pages that aren’t final destination URLs.
8. How Many Canonical Pages Are There vs. Canonicalized Pages?
Why This Is Important
The number of canonicalized pages on your site gives an indication into how much duplication there is on your site. While canonical tags consolidate link equity between sets of duplicate pages, they don’t help crawl budget.
Google will choose to index one page out of a set of canonicalized pages, but to be able to decide which is the primary page, it will first have to crawl all of them.
9. How Many Paginated or Faceted Pages Are Being Crawled?
Why This Is Important
Google only needs to crawl pages that include otherwise undiscovered content or unlinked URLs.
Pagination and facets are usually a source of duplicate URLs and crawler traps, so make sure that these pages that don’t include any unique content or links aren’t being crawled unnecessarily.
As rel=next and rel=prev are no longer supported by Google, ensure your internal linking is optimized to reduce reliance on pagination for page discovery.
10. Are There Mismatches in Page Discovery Across Crawl Sources?
Why This Is Important
If you’re seeing pages being accessed by users through your analytics data that aren’t being crawled by search engines within your log file data, it could be because these pages aren’t as discoverable for search engines as they are for users.
By integrating different data sources with your crawl data, you can spot gaps where pages can’t be easily found by search engines.
Google’s two main sources of URL discovery are external links and XML sitemaps, so if you’re having trouble getting Google to crawl your pages, make sure they are included in your sitemap if they’re not yet being linked to from any other sites that Google already knows about and crawls regularly.
To Sum Up
By running through these 10 checks for your websites that you manage, you should be able to get a better understanding of the crawlability and overall technical health of a site.
Once you identify areas of crawl waste, you can instruct Google to crawl less of those pages by using methods like disallowing them in robots.txt.
You can then start influencing it to crawl more of your important pages by optimizing your site’s architecture and internal linking to make them more prominent and discoverable.
Last week we reported that Google has updated its algorithms to give original reporting preferred ranking in Google search. So when John Shehata, VP of Audience Growth at Condé Nast, a major publishing company, posted on Twitter that Yahoo is outranking the original source of the article, Google took notice.
The complaint. Shehata posted on Twitter, “Recently I see a lot of instances where Google Top Stories ranking syndicated content from Yahoo above or instead of original content. This is disturbing especially for publishers. Yahoo has no canonicals back to original content but sometimes they link back.”
As you can see, he provided screen shots of this happening as evidence.
No canonical. John also mentioned that Yahoo, who is legally syndicating the content on behalf of Conde Nast, is not using a canonical tag to point back to the original source. Google’s recommendation for those allowing others to syndicate content is to have a clause requiring syndicators must use the canonical tag to point back to the source the site is syndicating from. Using this canonical tag indicate to Google which article page is the original source.
The issue. Sometimes those who license content, the syndicators, post the content before or at the same time as the source they are syndicating it from. That makes it hard for Google or other search engines to know which is the original source. That is why Google wrote, “Publishers that allow others to republish content can help ensure that their original versions perform better in Google News by asking those republishing to block or make use of canonical. Google News also encourages those that republish material to consider proactively blocking such content or making use of the canonical, so that we can better identify the original content and credit it appropriately.”
Google’s response. Google Search Liason Danny Sullivan responded on Twitter: “If people deliberately chose to syndicate their content, it makes it difficult to identify the originating source. That’s why we recommend the use of canonical or blocking. The publishers syndicating can require this.”
This affects both web and News results, Sullivan said. In fact, th original reporting algorithm update has not yet rolled out to Google News, it is just for web search currently:
Solution. If you allow people to syndicate your content, you should require them to use the canonical tag or make them block Google from indexing that content. Otherwise, do not always expect Google to be able to figure out where the article originated from, espesially when your syndication partners publish the story before or at the same time that you publish your story.
Why we care. While the original reporting change is interesting in this case, it is somewhat unrelated. If the same article is published on two different sites at the same time, both sites can appear to the search engines as the original source. If these sites are syndicating your content legally, review or update your contracts to require syndicators to either use canonical tags or block their syndicated content from indexing altogether. If syndicators are stealing your content and outranking you, Google should be better at dealing with that algorithmically, otherwise, you can file a DMCA takedown request with Google.
About The Author
Barry Schwartz is Search Engine Land’s News Editor and owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on SEM topics.