Magento Store Manager Blog

Store Manager for Magento news and announcements

Set Magento 2 Noindex and Nofollow Tags

What Is the Purpose of Noindex and Nofollow Tags?

When you're starting a new project on dev server or make some transactional pages, you may need to hide some of your pages or whole website from search engines not to be indexed beforehand. The best way to tell robots visiting your site not to index or follow your content is to use robots.txt file and nofollow and noindex meta tags in html head of the page(s). Magento website allows you to configure such kind of settings from the admin panel with no code used.

What Is robots.txt File And Why Do You Need It?

Let's say, some web robots want to visit your site https://store.emagicone.com and index or track its content. Before starting the indexation the robots will first enter your https://store.emagicone.com/robots.txt file and check it. This file is located in the root of your Magento site and contains the instructions for those robots on how to process or not to process your site.

Setting Noindex and Nofollow in Magento 2.1.x

  1. Find admin panel on the left side of your Magento installation and enter 'Stores' section;
  2. Under 'Settings' press 'Configurations' and go to 'General settings' - 'Design'.
    On the right you will find 'Search Engines Robots' settings.
  3. Uncheck 'Use system value' box to activate 'Default Robots' drop-down menu.
  4. There are four 'Default Robots' options available:
    • INDEX, FOLLOW - allows web robots to index your site and track it for changes;
    • NOINDEX, FOLLOW - instructs robots not to index your site, but allows to track it for changes;
    • INDEX, NOFOLLOW - instructs robots to index your site, but not to check it for changes furtherly.
    • NOINDEX, NOFOLLOW - forbids the robots neither to index nor to track you site.

    You can select the option basing on your purposes or use 'Edit custom instruction of robots.txt File' field, in case you need to block access to some specific folders or URLs.

  5. Input the following directives for robots into this field depending on your needs:
  6. To block all robots from certain folders:

    User-agent: *
    Disallow: /folder name

    To block specific robots from certain folders:

    User-agent: robot name
    Disallow: /folder name

    To block some bots to access one folder, but allow to access another one:

    User-agent: robot name
    Disallow: /folder name Allow: /folder name

Method 2

There is another way to block robots from processing your web pages from admin panel:

  1. From admin panel on the left select 'Content' section. Under 'Elements' select 'Pages'. You will find a table containing all pages of your store.
  2. Select 'Edit' option from the 'Select' drop-down menu on the right.
  3. Expand 'Design' section and find 'Layout Update XML' field. In order to prevent this page from indexing and following, insert the following code into this field:
Method 3: Setting Noindex/Nofollow For Specific Magento 2 Categories And Products

The above indicated code can also be used to configure permissions to some of your category or product pages whether in 2.1.x or in 2.2. These settings can be reached this way:

    Blocking product page:
  1. Select 'Products' from 'Catalog' section on the admin panel. Press 'Edit' on the right side of the product field. Scroll down and find 'Design' section. Expand it and enter this piece of code into 'Layout Update XML' field:
Blocking category page:

Select 'Categories' from 'Catalog' section and select necessary category from the list on the right. Find 'Design' section and enter the above indicated code into 'Layout Update XML' field.

How to Set Up Noindex/ Nofollow in 2.2.0, 2.2.1 and 2.2.2?

  1. Find 'Content' section on Magento admin panel and select 'Configuration' under 'Design' subsection. You will find there a table containing all your storeviews.
  2. Select the storeview you need to modify Noindex/Nofollow Settings for and Press 'Edit' in the 'Action' column.
  3. Scroll down and expand 'Search Engine Robots' settings. Select necessary 'Default Robots' option or use 'Edit custom instruction of robots.txt File' field to change access settings for some specific folders.
  4. Uncheck 'Use system value' box to enable 'Default Robots' drop-down menu.
  5. Select necessary option or use 'Edit custom instruction of robots.txt File' field to block access to specific folders or URLs.

  6. Input the following instructions for robots into this field basing on your needs:
  7. To block all robots from certain folders:

    User-agent: *
    Disallow: /folder name

    To block specific robots from certain folders:

    User-agent: robot name
    Disallow: /folder name

    To block some robots to access one folder, but allow to access another one:

    User-agent: robot name
    Disallow: /folder name Allow: /folder name

Conclusions: Do I Need to Block Access to Some of My Links?

Definitely, yes. It is essential for an online store owner to be able to manage access to some of his/her site’s folders or URLs by forbidding or allowing web robots to index or follow them. Beside limiting access for unknown crawlers, you can considerably improve your SEO by applying these restrictions.

The thing is that, when filling your site with content, you probably strive to optimize it for Google as much as possible in order to show up in the first positions of search results. Although, some of your site links might have some negative influence on your Google rate, so it would be appropriate to disallow search engine robots to index or track them.

Magento provides its users with a majority of ways to manage site access in few clicks directly from admin panel. Take advantage of any of them and keep your web store protected from any undesirable indexing or tracking.

Cracking Easter Deal from eMagicOne

Easter is on its way! This is a big occasion that allows you to get a good deal for must-haves. Keeping with this tradition, many e-savvy deal hunters have already started looking around for freebies and amazing products at attractive prices.

To celebrate this festive holiday, eMagicOne has also prepared for you something that will treat your taste. This is better than chocolate!

It’s perfect time for you to save big on the best Magento extensions developed by eMagicOne.

Cracking Easter Deal

We're excited to offer you our products with up to 30%* OFF!
Discount code: ESTR-E83A-OFFR

Shop Now
as the offer is limited!**

Highlights of the Offer

  • Discount is decreasing by 5% each working day.*
  • Online redemption is required. Discount cannot be returned, booked or back-dated!
  • It cannot be combined with any other offers.
  • Applicable to products only (services are not part of this promo).

Don’t let this opportunity to slip away! There’s no excuse for waiting any longer. Get the best deal today.

Happy Easter!

May your Easter basket be full of joy, happiness and pleasant moments! Keep safe and have a good holiday!

Get A Perfect Match for Your Magento This Valentine’s Day

Dear customers,

As the day to celebrate love gets closer, we wish your life to be full of love and joy, kindness and tenderness!

Software Made With Love

eMagicOne loves you and we all work hard to make you happy. We develop our Magento extensions with care and do our best to make your lives easier with our software.

If you did not have the chance to experience this, give a try to our Magento solutions and you will definitely fall in love with them!

Deal That Will Win Your Heart

This romantic event has also inspired us to make this day brighter with a special gift:

In celebration of Valentine’s Day,
Grab 14% off without delay!
Follow your heart,
Applying this code in the cart:

[LOVE-F2WU-LOVE]

Lovely Time

Feel the magic of sweet savings for 1 heart-filled week till Friday, February 16th!

Note, the number of coupons is limited! Check how many are left at:

https://www.mag-manager.com/order/

A Perfect Match

Don’t wait for cupid’s arrow, get perfect extensions that match for your Magento store this Valentine’s Day.

Here is what you can choose from:

  • Store Manager for Magento - to manage your store easier than ever before and be one step ahead of competitors.
  • QuickBooks Integration - to ease accounting syncing between Magento and QuickBooks with a few clicks.
  • eBay Integration - to sell more creating lists at eBay auction without recurring fees.
  • Amazon Integration - to join world famous marketplace Amazon directly from your Magento.
  • PDF Catalog Creator - to create colorful printable catalogs and lookbooks with your products to send to clients or partners.
  • IceCat Integration - to enrich your goods with high-quality images and detailed descriptions from Open or Full IceCat catalog.

So treat your yourself! Because eMagicOne software will be a perfect Valentine for your Magento.

With Love,

eMagicOne Team

=====

Offer Details

  • 1 order = 1 coupon. Online redemption is required. Coupon is considered as redeemed when an order is completed, funds were charged and the license is generated. In case you apply coupon in the cart and do not complete checkout process, the discount won't be active once the usage is expired. Order is processed within a few minutes. In case your order has not processed yet, please place a new order (in case of duplicate, we will return the duplicated charged sum).
  • This code is not valid with other offers or discounts and cannot be combined with them.
  • The number of coupons is limited. The availability of codes one can check on our website https://www.mag-manager.com/order.
  • The discounts are time-limited and cannot be back-dated after they expire. Unused discounts are not refunded or returned in any way.
  • Discount does not apply to any services (only to products).

Magento to Amazon Integration Addon Became More Functional

A bunch of new features and improvements have been implemented into the new version of Store Manager’s Amazon Integration Addon. Find out new possibilities of Magento to Amazon integration and take advantage of the increased functionality of the module.

Enhanced version of Amazon Integration addon (v.1.0.0.252) is compatible with Store Manager for Magento starting from version 3.11.0.2063. In order to update the module, you have to update Store Manager first.

Using new features of the addon you can:
  • Handle Amazon product listings;
  • Track recently accomplished operations;
  • Schedule and perform tasks;
  • Set shipping methods in the process of products synchronization.

Besides, new version of Magento to Amazon Integration addon provides you with:

Improved products mapping management

Now mapping will be based on the values priority and availability and all the fields to be mapped can be selected at one stroke. Besides, newly added items to product listings can be automatically assigned to the existing ones.

Improved category management

You can use category search filter (either when adding new products to listings) and view the list of suggested categories.

Improved orders management

All orders list can be uploaded using orders grid paginator (one page treated as one request);

Extended product export capabilities

You can choose from what field to export product quantity. Besides, it can be exported to specific rules.

New authorization method implemented

From now on Amazon Integration module requires its users to log into it by inputting MWS (Marketplace Web Service) AuthToken. This token is used to give the developer access to your account (for example, make the account accessible for eMagicOne). Read more on how to get an MWS AuthToken here.

Find the full list of improvements here.

Try the renewed version of Magento to Amazon Integration module and take advantage of the wide arsenal of instruments now!

Magento 2: Get Product IDs Exported to CSV

Need to export from your Magento 2 products with IDs to CSV file? Generally, for inventory management inside Magento, like different catalog updates, SKU is used as unique product identifier. So necessity to get CSV with Magento entity IDs usually emerges in special situations, for instance, when you want to integrate with some third-party system or management solutions.

Magento 1 VS Magento 2 Export Product IDs

In Magento 1 there was included the possibility to do the task with Dataflow profiles export. Magento 2 Export/Import is deprived of the default functionality to get the list of product IDs.

magento 2 export ids

Naturally, if you have enough tech background, you can retrieve all of products via API or create some custom script to accomplish the task. If you do not have idea how to cope with it, in this tutorial I will show you the way to do it without changing Magento core files or hiring a developer to assist you.

The easiest and the most common approach is CSV export. Yes, it was mentioned above that it is not possible using out-of-the-box export means, that it why it is necessary to expand default functionality with enhanced possibilities using extension.

Store Manager for Magento app is a perfect solution for that. Why? It works equally good with both Magento 1 and Magento 2, does not require to be installed on your shop as you can connect remotely and the best thing is that you can use all the features of the software free for 14 days without limitations.

Get File Containing Magento 2 Product IDs Using Store Manager!

Select Collection of Products With IDs to Be Exported

The application includes wide management possibilities, so you can make use of advanced filters to receive a collection of all products IDs, get those of products from particular category, retrieve goods IDs associated with configurable, bundle or grouped products, etc.

magento 2 export entity ids

Export IDs Along with Other Necessary Product Details

Store Manager for Magento allows to decide what columns you want to include in the output export file. So apart from the collection of product IDs, you can also export necessary product-related fields, like SKU, name, category, some specific attributes, prices, quantity etc.

To select data to be exported simply drag necessary column from the left and drop them to the right pane of the window at the following step:

magento 2 export entity ids and skus

Automate Magento 2 CSV Export to Make It Regular

In case export of product IDs and related details is not one-off occasion, it is a good idea to automate the procedure and make it running without your involvement each regular period of time. This is especially true in case you need CSV with products IDs for integration with external systems.

Store Manager for Magento has built-in AutoExport functionality that allows to set up scheduled task without special efforts. You just need to configure export settings once and indicate when exactly and how often your further exports should be performed.

magento 2 export ids automatically

Export Product IDs from Magento 2 Store to CSV FREE!