3

Google Bard vs. the New Bing

 1 year ago
source link: https://moz.com/blog/google-bard-vs-new-bing
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client
Search engines 5511dd3
Tom Capper
By: Tom Capper March 29, 2023

Google Bard vs. the New Bing

The author's views are entirely his or her own (excluding the unlikely event of hypnosis) and may not always reflect the views of Moz.

This week I’ve been fortunate enough to get access to both Google Bard and the New Bing, so a day later, I’m here to share my first impressions.

What is the new Bing?

“The new Bing” is the product of Microsoft’s unholy alliance with OpenAI, makers of the now infamous ChatGPT. This development promises to have seismic effects on the search ecosystem, with Microsoft’s CEO saying they’re happy to accept “demonetization” of search in their pursuit of market share, and Google extremely concerned about the threat ChatGPT technology poses as an alternative to their core search business.

Of course, by now we’ve all also seen various viral posts and tweets showing just how dangerous it can be to use chat AI as a search engine, but that’s a topic for another day. For now, the point is that Bing is making moves.

old-bing-badgers.png?w=1181&auto=compress%2Cformat&fit=crop&dm=1680050324&s=8c51ec363b48899d201e1bf3b3bbff2c

When I perform a search on “old bing” now, I can see this box inviting me to try the new one. You’ll notice a key detail here: it’s only available in Microsoft Edge. Yikes. Big Microsoft Energy. Fortunately for you, the reader, I have dusted off everyone’s fourth-favorite browser so you don’t have to.

Performing the same search in the new Bing, I can see identical organic results, but rather different features:

new-bing-badgers.png?w=1177&auto=compress%2Cformat&fit=crop&dm=1680050327&s=e48970f39c9f31d379cbfd27ac744e1c

The “mustelid masters” box above the organic results is new, and contains AI-generated text with a voice-to-speech capability. It’s a six-part story, with sometimes surprising accompanying imagery:

new-bing-badger-wrestling.png?w=630&auto=compress%2Cformat&fit=crop&dm=1680050332&s=b4622067a27bfa0de2cc3e7ba251ffdc

You can see here that a picture of wrestling has been sourced to accompany the text about badgers wrestling. These AI-generated boxes don’t appear for most queries — only clear and uncontroversial informational intents.

The phrase “Mustelid masters” itself seems to be original to this box.

zIueQnCLCUCCOGtUCGpSJMP_R_YfyLs9RvADs_QUGC63rC1DGcu2eUqYpEd3cZC1TbyRgUM_hIQR83JomNp129Ev4HaPgsb0H8xpvYxMd9MNdLdBGqxds7nRea0ULBjGJrULYYDF0xdYMQSoztdyfNs

Lastly, one of the tabs in the story cites the Wisconsin Badgers, and a page which is entirely unrelated to the content at hand, so perhaps Bing is also citing its sources for disambiguation here?

0SHHT4m6N2bNWlkeQLBpkWikzj7vH7W8ZM-Iidp-9_H48ubOv728B_5Wmn0FFYUPdZR1sPfG-EEEuPeOQ5RcR5iqfaPSX_NW_CkzpArOkhQPwWxaUA8D4vQphN-Ie7fZHS39oxJv4jVpC2MfprOhqFI

You’ll notice the addition of an “Open Website” button next to the top result on the SERP — perhaps a way of compensating a little for loss of organic click through rate?

The “chat” tab is also present on old Bing, but just shows you a message telling you to go to Microsoft Edge.

unlock-conversational-search-on-msoft-edge.png?w=1161&auto=compress%2Cformat&fit=crop&dm=1680050320&s=6036f48e71a62ab060bbf97ff31ac7ba

The phrase “conversational search” here is interesting, given this was a phrase Google introduced in 2013.

If we do use Microsoft Edge, we see a chatbot interface in this tab, but with some nice additions. Switching over to this from a regular search result pre-loads my previous query from organic search:

HmBTz6a394zwB50z2-mPKripzwDw9fjZJ2Jpf38FnxPs-Jc8s3cMXiF7dlWNqca1hE3O0Z4y-PatjWK8TUNxP5neG-iKtbiPhdS3rxaSO5f7AkZ5E2esbdQvBg6eGk-NrU62laNpjXmpEkcwYrcEfw

There’s a bunch of different modes available at the top, and also citations in the search results — both welcome improvements over the likes of ChatGPT.

Now, how about Bard?

What is Google Bard?

ULV4NKLHbeyCeDrL-gpQHrumsOjlw0IJfSSoaMSBgWWniX03CN_hQLyIyxvcTJO-JePkUNwpQ7Id_SJ-F41l1dYN1XiRMCalWfd0yu_Tcu2YJMX4tc4ZvrcOYRx1wwuYYj69DxJ7ybyNNlBCbkLk1A

Well, not very self-confident, for one. But that’s probably a good thing.

bard-start-screen.png?w=1202&auto=compress%2Cformat&fit=crop&dm=1680050340&s=d4607582458a1d9ddc1250f919c0632e

Bard is also, right now, not anywhere near as integrated with search. In their announcement on February 6th, Google teased Bard in a way that made it look very much like a SERP feature, similar to Bing:

rDsFG0HB-B3885mkrRJjcxv04Y8gzwXr0f4iAGQ4SlvVQNO3xOlpWqE40vMUOFqRQjRUV6mJjYaGKtb1CcLjZKBdhLYu0HYZ0Gy6DbFs5z3__beBpnY_q1RFc2ZDhGyHlyQE7i-qn-TKyO93gUNe9g

However, the version we have to play with now is more of a dedicated chatbot interface.

It was probably already the case that Google was pushed to move far sooner than they hoped with this technology, and of course they have much more to lose from messing with organic search than Bing does. So, it shouldn’t be a surprise to see the slower and more cautious approach.

bard-badgers.png?w=1247&auto=compress%2Cformat&fit=crop&dm=1680050343&s=680d8e93bbd206b468dcdfeddc1e79b3

Now, it probably should be noted that chatbots are not really designed for me to just enter a one word keyword like “badgers”, like I might do in organic search. But, like Bing’s chat tab, I get something resembling an informational result. So, let’s compare side by side.

Bard vs. new Bing, side-by-side

bing-bard-badgers-side-by-side-left.png?w=939&auto=compress%2Cformat&fit=crop&dm=1680050870&s=6626d26a4f2b78a136f3e1be4523c03b
bing-bard-badgers-side-by-side-right.png?w=951&auto=compress%2Cformat&fit=crop&dm=1680050901&s=618f4220fe5906b7558a47a930a957bc
Click here to see the full side-by-side comparison.

The most obvious difference, at least to an SEO’s eye, is the presence of citations in the Bing result. Not knowing where source information comes from is one of the biggest challenges for users when dealing with this kind of technology, so that’s a huge differentiator.

hRfxqbvWtZulFOlPASyJeZ88J-3E7BGo4EHJ9MR1ufDgJXedid0CL-zkYMRX13PvuVp3Wuby_nJhrECUMawxDSk6G3L79g7ey7f8PcM8rF_ViQE5Bsjt6SSNJNdTEXUxwu4SaWK2LfZYik0p2q8TJ6I

Bard does claim to include citations. My colleague Mike was able to trigger them, and captured it in this clip. It’s definitely far, far less ubiquitous than on Bing.

That said, I like that the framing of Google’s solution — with multiple draft answers presented and “enter a prompt here” — makes it clearer I’m dealing with something that is not a source of unassailable truth.

I was also intrigued by the localization of Bing’s result. It mentions the UK in its response, which is where I’m searching from, and shows UK websites in the citations. So I asked them both a follow-up question about my location:

6ev8mSgSe1UQFqLfsiUzrbTGCbDS7OfifoHsmKaVtKToVnJyK5Q_zq4DwUU_jvDOCvMoIRUCuLlmVnjMahWrd-pnh46t34SaJVUxhdqJOlDJ9zYa43hXI2NS6nR0B8Fb4jwSveiaZBbVG6LZ2RU6gI0
bz0iHUMQqM24ACFGyCENk0Tabk5Shb29z7kDNyhz9_6LbchEmB83LcCCtP3BphrOkoslQsdHoQhq76Q2m2VIU5EL12_1myGKnEKkOPsLA2c8De61xmLyihTAdmOVjFVAHx6_xETeHQWt_C1eZlN_0Bw

Bing repeats itself, but Bard just seems to assume I’m in the US. Unfortunate.

Slightly commercial query

Many SEOs will be more interested in how technology like this might fit into their marketing funnel. Let’s try a classic top-of-funnel query:

bing-bard-top-video-games-side-by-side-left.png?w=934&auto=compress%2Cformat&fit=crop&dm=1680050909&s=2a1c3cb69055193ecfc7afcfe5fbbd63
bing-bard-top-video-games-side-by-side-right.png?w=947&auto=compress%2Cformat&fit=crop&dm=1680050924&s=8b806e02c77e743351be95ee7bedb0c2

Click here to see the full side-by-side comparison.

There isn’t really an objective answer here, but both results are broadly sensible. That said, the Bing answer is both a narrower list and far richer.

Interestingly, neither result seems deterministic.

new-bing-vs-new-bing-top-video-games-side-by-side-left.png?w=941&auto=compress%2Cformat&fit=crop&dm=1680050939&s=c294d4b933be3b0ff6923e4b3aad3970
new-bing-vs-new-bing-top-video-games-side-by-side-right.png?w=935&auto=compress%2Cformat&fit=crop&dm=1680050943&s=c6369d21f3993c046aa75f111caecfb7

Click here to see the full side-by-side comparison.

Bing can produce different answers to the same question in different windows, and so can Google.

bard-vs-bard-top-video-games-side-by-side-left.png?w=954&auto=compress%2Cformat&fit=crop&dm=1680050891&s=7a5ac2ab2407da221f8067571244416b
bard-vs-bard-top-video-games-side-by-side-right.png?w=950&auto=compress%2Cformat&fit=crop&dm=1680050897&s=65b9ca3f9d04039af5248e09f0b99c17

Click here to see the full side-by-side comparison.

This may be a contentious point when SEOs start optimizing for these results, and want to measure their results. Of course, regular organic rankings can vary massively between locales and even days of the week, but generally speaking, if you search twice from the same computer (in private browsing windows etc) you’ll get the same results. Not so here.

Conspiracy theories

conspiracy-side-by-side-left.png?w=934&auto=compress%2Cformat&fit=crop&dm=1680050926&s=052ff99ea0efd716026d2e063600866a
conspiracy-side-by-side-right.png?w=939&auto=compress%2Cformat&fit=crop&dm=1680050929&s=47ba471fa087b484bbfcd5fa624b9e76

Click here to see the full side-by-side comparison. 

Neither solution fell for some obvious conspiracy theory bait, which is encouraging to see. I actually don’t mind at all Google’s more cautious “I can’t assist with that” here. I wasn’t able to provoke a similar reaction out of Bing for any query, but I also wasn’t able to provoke it to say anything abhorrent - I’m sure others will, though.

What next for SEOs?

For both platforms there are major questions before SEOs can really engage and consider them an important part of their work.

For Bing, will this have adoption? Most SEOs have not made the habit of optimizing for Bing in recent years, but there is already talk of increased Bing market share.

For Bard, how, if at all, will this be integrated in search? The current platform is clearly marked as an experiment, and is more like ChatGPT than it is like the mock ups Google showed us in February. Or will users be encouraged to use it as its own thing?

For both platforms, there are big questions about how SEOs might go about optimizing to get their clients mentioned, and indeed favorably mentioned in results - there are lots of nefarious possibilities here, and Wikipedia is probably the most obvious. Once mentioned, how does one measure this? When I clicked through to my own site from Bing’s chat tab, it just appeared like any other Bing organic traffic. Rank tracking is an interesting problem too, and you can be sure that Moz and STAT will be posting in future about how we’re handling these features — watch this space!

About Tom Capper —

I head up the Search Science team at Moz, working on Moz's next generation of tools, insights, and products.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK