UserToCategories
Attributes for recommendation boosting
- additionalType: array · Additional Interactions
_interactions A list of additional interaction records. You can use this fields to simulate user interactions without actually writing them to the interaction dataset.
- typeenumconst:product_detail_page_viewrequired
Used when a user views the detail page of a product. Viewing a product detail page usually indicates a user is interested in the product to certain degree, especially, when the
durationof the page view is long. Whendurationof the page view is very short (< 5 seconds),product_detail_page_viewmay indicate neural or negative interest in the product.values- product
_detail _page _view
- anonymousType: string · Anonymous Id
_id max length:1024A pseudo-unique substitute for the User Id. We use
anonymous_idto identify a visitor who has not signed in.anonymous_idcan be implemented using mechanisms such as cookies or browser localStorage. Ifanonymous_idis not given, we will default it toSHA1(<API key>:<IP address>:<user agent>:<date>). When a visitor signs in and theuser_idandanonymous_idare both present, theanonymous_idwill be linked to theuser_idalong with the past interactions associated with it. - contextType: object · Context
Dictionary of extra information that provides useful context about an interaction. We use context information to make recommendations tailored not only for each user, but also for their current browsing context. For example, a user browsing on a desktop may have different browsing behavior than a user browsing on mobile phone. As another example, a user who gets to the site via a certain campaign you run on Facebook may have very different interests than a user who visits your site directly.
Context information is also useful for personalization for entirely new visitors, as we can immediately personalize their experiences based on their context alone (e.g. the referrer or the campaign they clicked through).
Example:
{"context": { "campaign": { "name": "spring_sale", "source": "Google", "medium": "cpc", "term": "running+shoes", "content": "textlink" }, "truncated_ip": "1.1.1.0", "locale": "en-US", "region": "US East", "page": { "url": "https://example.com/miso-tshirt-123ABC", "referrer": "https://example.com/", "title": "My Product Page" }, "user_agent": "Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:47.0)" }, "custom_context": { "other_context_var_1": "value_1", "other_context_var_2": "value_2" } } - durationType: number · Duration
How long (in seconds) the user stayed on this page, or consumed (listened, read, or watched) a product. This field is optional, but it's very important in scenarios where consumption duration matters, including
product_detail_page_view,category_page_view,watch,listen, andread. For example, if a user only views or consumes a product for less than 5 seconds, that user is probably not interested in the product. On the other hand, if a user stays on a page for a while, it usually means they are seriously engaging with or considering the product. Whendurationis absent, we will use the timestamp of the next interaction to infer a rough duration value.Example:
{"duration": 61.5} - misoType: string · Miso IdFormat: uuid
_id Miso-generated unique Id for each recommendation or search result. Maintaining this Id for subsequent page views is important to Miso's performance, as we use
miso_idto track and fine-tune the performance of personalization and search results. When a user clicks on a recommendation or search result, you should pass the associatedmiso_idto the next page view, and associate themiso_idwith the interactions that take place on the page (e.g.product_detail_page_view,add_to_cart,add_to_collection,like, etc.). In this way, Miso will learn which recommendations work and which didn't.Example:
{"misoId": "123e4567-e89b-12d3-a456-426614174000"} - productType: array string[] · Product Group Ids
_group _ids max length:512The product groups the user is interacting with. You only need this field if you model product variants using
product_idandproduct_group_id(see Product API). If so, you should use this field, when a user is interacting with a product group rather than a specific product variant, for example, when the user is viewing the master page of a T-shirt (i.e. a product group), but has not selected the specific size or color (i.e. a product variant) yet.In such situations, the
product_idis not applicable because we only know the user is interested in this T-shirt (a product group), but don't know which particular product variant the user is interested in. Therefore, we useproduct_group_idsto capture such interactions in place ofproduct_ids.In the situations where specific
product_idsare available, for example, when user selected a particular size of the T-Shirt, useproduct_idsinstead.Example:
{"product_group_ids": ["123ABC"]} - productType: array string[] · Product Ids
_ids max length:512Products or content the user is interacting with. This field is required by almost all the interaction types. We use
product_idsto refer to the product / content records that you upload to Miso. Therefore, it is important to keep this consistent between the two datasets.Example:
{"product_ids": ["123ABC-BLACK", "123EFG-YELLOW"]} - timestampType: string · TimestampFormat: date-time
The ISO-8601 timestamp specifying when the interaction occurred. If the interaction just happened, leave it out and we will default to the server's time. If you're importing data from the past, make sure you provide a timestamp. It is recommended to include milliseconds in the timestamp to provide a higher time resolution.
Example:
{"timestamp": "2018-11-07T00:25:00.073876Z"} - userType: string · User Id
_id max length:512Identifies the signed-in user who performed the interaction. We will use
user_idto link Interaction records to your User records. Therefore, it is important to keep this consistent between the two datasets.For visitors who have not signed in, seeanonymous_id.
- anonymousType: string · Anonymous Id
_id The anonymous visitor who made the query and for whom Miso will personalize the results. Either
user_idoranonymous_idneeds to be specified for personalization to work. - boostType: string · Boost Fq
_fq Defines a query in Elasticsearch query-string syntax (Lucene) that can be used to boost a subset of products to the top of the ranking, or to specific boost positions (See
boost_positionsparameter below.) For example, the query below will promote all the relevant products whose brand isNiketo the top of recommendation list:{ "boost_fq": "brand:\"Nike\"" }For a slightly more complex example, the query below will promote the Nike products which have also been tagged as
ON SALEto the top of the ranking:{ "boost_fq": "brand:\"Nike\" AND tags:\"ON SALE\"" }It is worth mentioning that, Miso will only boost products that are relevant and have high likelihood to convert, and will not boost a low performance product only because it matches the boosting query.
Depending on your boosting rules, in certain cases, you would like to prevent recommendation results from being too monotone due to boosting. With Miso, you have two tools to do so.
First, you can specify
boost_positionsto place promoted products at specific positions in the ranking. For example, the query below will place boosted products only at the first and fourth places in the ranking (positions are 0-based), and place the remaining products in their original ranking, skipping these two positions.{ "boost_fq": "brand:\"Nike\" AND tags:\"ON SALE\"", "boost_positions": [0, 3] }The second tool is
diversification.diversificationparameter, on a best-effort basis, will try to maintain a minimum distance between products that have the same attributes. For example, the following query will place products made by the same brand apart from each other.{ "boost_fq": "brand:\"Nike\" AND tags:\"ON SALE\"", "diversification": { "brand": {"minimum_distance": 1} } } - boostType: array integer[] · Boost Positions
_positions Defines a list of 0-based positions you want to place the boosted products at.
For example, the query below will promote products whose brand is
Nikeas the top and second recommendations:{ "boost_fq": "brand:\"Nike\"", "boost_positions": [0, 1] }If
boost_positionsis not specified (which is the default behavior), all the boosted products will be ranked higher than the rest of the products. - boostType: string · Boost Rule Name
_rule _name Name of the boosting rule. Use this to identify a boosting rule in _boosted_rules in the response
- boostType: array object[] · Boost Rules
_rules Define a list of boosting rules that will be applied to the search or recommendation results simultaneously.
boost_rulesparameter is particularly useful when you want to boost more than one sets of products, and promote each of them to different positions. For example, the query below will promote products whose brand isNiketo the top and second results, and products whose brand isAdidasto the third and fourth results:{ "boost_rules": [ { "boost_fq": "brand:\"Nike\"", "boost_positions": [0, 1] }, { "boost_fq": "brand:\"Adidas\"", "boost_positions": [2, 3] } ] }- boostType: string · Boost Fq
_fq Defines a query in Elasticsearch query-string syntax (Lucene) that can be used to boost a subset of products to the top of the ranking, or to specific boost positions (See
boost_positionsparameter below.) For example, the query below will promote all the relevant products whose brand isNiketo the top of recommendation list:{ "boost_fq": "brand:\"Nike\"" }For a slightly more complex example, the query below will promote the Nike products which have also been tagged as
ON SALEto the top of the ranking:{ "boost_fq": "brand:\"Nike\" AND tags:\"ON SALE\"" }It is worth mentioning that, Miso will only boost products that are relevant and have high likelihood to convert, and will not boost a low performance product only because it matches the boosting query.
Depending on your boosting rules, in certain cases, you would like to prevent recommendation results from being too monotone due to boosting. With Miso, you have two tools to do so.
First, you can specify
boost_positionsto place promoted products at specific positions in the ranking. For example, the query below will place boosted products only at the first and fourth places in the ranking (positions are 0-based), and place the remaining products in their original ranking, skipping these two positions.{ "boost_fq": "brand:\"Nike\" AND tags:\"ON SALE\"", "boost_positions": [0, 3] }The second tool is
diversification.diversificationparameter, on a best-effort basis, will try to maintain a minimum distance between products that have the same attributes. For example, the following query will place products made by the same brand apart from each other.{ "boost_fq": "brand:\"Nike\" AND tags:\"ON SALE\"", "diversification": { "brand": {"minimum_distance": 1} } } - boostType: array integer[] · Boost Positions
_positions Defines a list of 0-based positions you want to place the boosted products at.
For example, the query below will promote products whose brand is
Nikeas the top and second recommendations:{ "boost_fq": "brand:\"Nike\"", "boost_positions": [0, 1] }If
boost_positionsis not specified (which is the default behavior), all the boosted products will be ranked higher than the rest of the products. - boostType: string · Boost Rule Name
_rule _name Name of the boosting rule. Use this to identify a boosting rule in _boosted_rules in the response
- boostingType: array string[] · Boosting Tags
_tags When
boosting_tagsis given, and there are pre-defined boost rules have the same tag(s), those boost rules will be matched, regardless if the criteria is met or not.Useful when want to force trigger specific boost campaign.
- customType: object · Custom Context
_context Dictionary of custom context variables for the current browsing session. You can specify context variables specific to your websites or apps in a
{"KEY":VALUE}format, whereKEYmust be a string, andVALUEcan be:- a
bool - a
stringor anarray of string - a
numberor anarray of numbers - an
array of objects null
In certain cases, Miso will take these variables into account when generating results.
- a
- dedupeType: boolean · Dedupe Product Group Id
_product _group _id Whether to dedupe product based on
product_group_id. Ifdedupe_product_group_id=true, Miso will prevent products with the sameproduct_group_idfrom showing multiple times in the search or recommendation results.This is particular useful when one product has multiple variants (for example, different sizes, colors, or materials), and you only want to show this product only once in the search or recommendation results. Miso will then return the variant that is most likely to be of the user's interest.
- engineType: string · Engine Id
_id The engine you want to get results from. When you have more than one engine, you can use this parameter to specify the specific engine you want to get results from. If not specified, the default engine will be used.
- excludeType: array string[] · Exclude
An array of
product_idsof products you want to exclude from search results. - flType: array string[] · Fl
List of fields to retrieve. For example, the following request retrieves only the
titlefield of each product along with theproduct_id, which is always returned.{"fl": ["title"]}You can also match field names by using
*as a wildcard. For example, the query below retrieves thetitleand any custom attributes under theattributesdictionary.{"fl": ["title", "attributes.*"]}The following retrieves all the available fields:
{"fl": ["*"]}For the lowest latency, use an empty array to retrieve just the
product_idfield (which is the default).{"fl": []} - fqType: string · Fq
Defines a query in Elasticsearch query-string syntax (Lucene) that can be used to restrict the superset of products to return, without influencing the overall ranking.
fqcan enable users to drill down to products with specific features based on different product attributesFor example, the query below limits the search results to only show products whose size is either
MorSand brand isNike:{"fq": "size:(\"M\" OR \"S\") AND brand:\"Nike\""}You can use
fqto apply filters against your custom attributes as well. For example, the query below limits the search results to only products whosedesignerattribute isCalvin Klein{"fq": "attributes.designer:\"Calvin Klein\""}fqcan also limit search results by numerical range. For example, the following query limits the results to products that haverating >= 4.{"fq": "rating:[4 TO *]"} - geoType: object · Geo
When set, filter result to include only products within certain geographic range from given point will be returned, or to boost product within the same range.
Product should have a field that holds the location of the product,
locationis used by default, but other field can also be used.Distance can be in miles or kilometers. If
distance_unitis not set,milewill be used.For example, to limit results to products within 100 miles of New York city:
{ "geo": { "filter": [{ "lat": 40.73061, "lon": -73.93524, "distance": 100 }] } }To boost products within 2 kilometers around Alcatraz Island according to
locfield:{ "geo": { "boost": [{ "field": "loc", "lat": 37.82667, "lon": -122.42278, "distance": 2, "distance_unit": "km" }] } }- boostType: array object[] · Boost
When set, boost products within certain geographic range from given point.
- filterType: array object[] · Filter
When set, filter result to include only products within certain geographic range from given point.
- productsType: integer · Products Per Category
_per _category Number of products to return for each category. For example, the following query will return 5 products for each category we recommend:
{"products": 5}Note that, a large number of
products_per_category(say >= 20) will increase query latency (up to around 200ms) because we need to perform more computation for each of the recommended categories. If you only need category recommendations, you should setproducts_per_categoryto 0 to reduce latency. - rootType: array string[] · Root Category
_category If
root_categoryis specified, we will only recommend categories that are direct children of each of the root category. For example, the following query will recommend the products of category that is under["Clothes"]category:{"root_category": ["Clothes"]}For another example, the following query will recommend the products of category that is under
["Clothes", "Dresses"]category{"root_category": ["Clothes", "Dresses"]}If
root_categoryis not specified, we will recommend the top level categories. - rowsType: integer · Rows
Number of recommended categories to return
- typeType: string · Type
The type of products to return. Use this parameter to make the API return only a certain type of products (see Product APIs).
This is particularly useful for sites that have multiple types of products: For example, on a marketplace site, YOu may model merchandise and store as two types of products. You can then use type parameter to limit the recommendation or search results to return only one kind of them.
For instance, the following query will return only store products:
{"type": "store"}For another example, on a travel website, you might have: hotel, thing to do, and restaurant, three kinds of products. You can use
typeparameter to limit results to one kind of them. For instance, the following query will limit the results to only hotels product:{"type": "hotel"} - userType: object · User Cohort
_cohort The user cohort you want to cold-start the recommendation with. For example, the following query will make recommendations based on the preferences of the users whose
country="United States", andgender="Female"in the User Profile dataset.{ "user_cohort": { "country": "United States", "gender": "Female" } }- property
Name - Type: boolean
- userType: string · User Hash
_hash The hash of
user_id(oranonymous_id) encrypted by your Secret API Key.user_hashis required to prevent unauthorized API access if you are making API calls with a Publishable API Key.You should generate the user_hash via HMAC scheme: you encrypt the desired user_id (or anonymous_id) with your Secret API Key on your backend server, and then let the front-end code send the generated user_hash to Miso APIs to verify the identity of the API caller.
As long as the Secret API Key is kept secret, the user_hash prevents a malicious attacker from making unauthorized API calls or impersonating any of your users.
Miso APIs accept the case-incentive "hex digest" of user hash, a sample Python 3 code to generate it on your backend server is as follow:
import hashlib import hmac YOUR_MISO_SECRET_API_KEY = "039c501ac8dfcac91" key_bytes = YOUR_MISO_SECRET_API_KEY.encode() user_id = "USER_123" # or anonymous_id user_id_bytes = user_id.encode() user_hash = hmac.new( key_bytes, user_id_bytes, hashlib.sha256).hexdigest() # user_hash is "7eb04da5e..."You can find more examples for other languages in this Github Gist
- userType: string · User Id
_id The user who made the query and for whom Miso will personalize the results. For an anonymous visitor, use
anonymous_idinstead.
