Anomaly Detector v1.1-preview.2

The Anomaly Detector service detects anomalies and trace root causes automatically in time series data. It supports several functionalities:

  • Detecting anomalies in single time-series, including entire, last and change point detection. With this univariate anomaly detection capability, business customers can discover incidents and establish a logic flow for root cause analysis.
  • Detecting anomalies in multiple time-series. This set of multivariate anomaly detection APIs in Anomaly Detector analyze dependencies and inter-correlation changes between different signals. It enables customers to gather a group of related time-series and detect failures in a system level.
  • Indicate root causes that contribute the most on an aggregated anomaly point. Accurate dimension can be drilled down for both one measure and multiple measures. Meaningful interpretation is also provided.

To ensure online service quality is one of the main reasons we developed this service. Our team is dedicated to continuing to improve the Anomaly Detector service to provide precise results.

This Univariate Anomaly Detection is currently available in:

This Multivariate Anomaly Detection is currently available in:

  • East US - eastus.api.cognitive.microsoft.com
  • East US 2 - eastus2.api.cognitive.microsoft.com
  • South Central US - southcentralus.api.cognitive.microsoft.com
  • UK South - uksouth.api.cognitive.microsoft.com
  • West Europe - westeurope.api.cognitive.microsoft.com
  • West US 2 - westus2.api.cognitive.microsoft.com

The Root Cause Analysis is currently available in:

  • West US 2 - westus2.api.cognitive.microsoft.com
  • Central US EUAP - ameuse2.api.cognitive.microsoft.com

Multivariate Anomaly Detection - Detect Multivariate Anomaly

Submit detection multivariate anomaly task with the trained model of modelId, the input schema should be the same with the training request. Thus request will be complete asynchronously and will return a resultId for querying the detection result.The request should be a source link to indicate an externally accessible Azure storage Uri (preferably a Shared Access Signature Uri). All time-series used in generate the model must be zipped into one single file. Each time-series will be as follows: the first column is timestamp and the second column is value.

Select the testing console in the region where you created your resource:

Open API testing console

Request URL

Request parameters

string

Format - uuid. Model identifier.

Request headers

string
Media type of the body sent to the API.
string
Subscription key which provides access to this API. Found in your Cognitive Services accounts.

Request body

Detect anomaly request.

{
  "source": "{your_sas_url}",
  "startTime": "2020-10-01T13:30:00+00:00",
  "endTime": "2020-10-07T03:00:00+00:00"
}
{
  "description": "Detection request.",
  "required": [
    "source",
    "endTime",
    "startTime"
  ],
  "type": "object",
  "properties": {
    "source": {
      "description": "Source link to the input variables. Each variable should be a csv with two columns, `timestamp` and `value`. The file name of the variable will be used as its name. The variables used in detection should be exactly the same with those used in the training phase.",
      "type": "string",
      "example": "{your_sas_url}"
    },
    "startTime": {
      "format": "date-time",
      "description": "A required field, indicating the start time of data for detection. Should be date-time.",
      "type": "string",
      "example": "2019-04-01T00:15:00Z"
    },
    "endTime": {
      "format": "date-time",
      "description": "A required field, indicating the end time of data for detection. Should be date-time.",
      "type": "string",
      "example": "2019-04-01T00:40:00Z"
    }
  },
  "example": "{\r\n  \"source\": \"{your_sas_url}\",\r\n  \"startTime\": \"2020-10-01T13:30:00+00:00\",\r\n  \"endTime\": \"2020-10-07T03:00:00+00:00\"\r\n}"
}

Response 201

Submit a multivariate model detection task successfully.

Response 400

Possible Errors:

  • ModelNotExist
    The model does not exist.
  • ModelNotReady
    The model is not ready yet.
  • BadArgument
    The 'source' field is required in the request.
    The 'startTime' field is required in the request.
    The 'endTime' field is required in the request.
    Invalid Timestamp format.
  • VariableNotExist
    The corresponding file of the variable does not exist.
  • MergeDataFailed
    Data provided could be merged to a dataframe. Possibly due to wrong folder structure or data format, invalid column names.
    Folder structure may be changed after compression. Please check the structure is desired after extraction.
    Please refer to the sample data to prepare your own data.
  • ColumnNotFound
    Could not find column "timestamp" in the merged dataframe.
  • NumColumnsMismatch
    Number of columns of merged data does not match the number of variables.
  • CorruptedData
    Data provided could be processed. Possibly due to wrong folder structure or data format, invalid column names.
    Folder structure may be changed after compression. Please check the structure is desired after extraction.
    Please refer to the sample data to prepare your own data. 

{
  "code": "ModelNotExist",
  "message": "The model does not exist."
}
{
  "required": [
    "code",
    "message"
  ],
  "type": "object",
  "properties": {
    "code": {
      "description": "The error code.",
      "type": "string"
    },
    "message": {
      "description": "The message explaining the error reported by the service.",
      "type": "string"
    }
  }
}

Response 403

The certificate you provided is not accepted by server.

Response 405

Method Not Allowed.

Response 500

Internal Server Error.

Code samples

@ECHO OFF

curl -v -X POST "https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect"
-H "Content-Type: application/json"
-H "Ocp-Apim-Subscription-Key: {subscription key}"

--data-ascii "{body}" 

using System;
using System.Net.Http.Headers;
using System.Text;
using System.Net.Http;
using System.Web;

namespace CSHttpClientSample
{
    static class Program
    {
        static void Main()
        {
            MakeRequest();
            Console.WriteLine("Hit ENTER to exit...");
            Console.ReadLine();
        }
        
        static async void MakeRequest()
        {
            var client = new HttpClient();
            var queryString = HttpUtility.ParseQueryString(string.Empty);

            // Request headers
            client.DefaultRequestHeaders.Add("Ocp-Apim-Subscription-Key", "{subscription key}");

            var uri = "https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect?" + queryString;

            HttpResponseMessage response;

            // Request body
            byte[] byteData = Encoding.UTF8.GetBytes("{body}");

            using (var content = new ByteArrayContent(byteData))
            {
               content.Headers.ContentType = new MediaTypeHeaderValue("< your content type, i.e. application/json >");
               response = await client.PostAsync(uri, content);
            }

        }
    }
}	
// // This sample uses the Apache HTTP client from HTTP Components (http://hc.apache.org/httpcomponents-client-ga/)
import java.net.URI;
import org.apache.http.HttpEntity;
import org.apache.http.HttpResponse;
import org.apache.http.client.HttpClient;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.client.utils.URIBuilder;
import org.apache.http.impl.client.HttpClients;
import org.apache.http.util.EntityUtils;

public class JavaSample 
{
    public static void main(String[] args) 
    {
        HttpClient httpclient = HttpClients.createDefault();

        try
        {
            URIBuilder builder = new URIBuilder("https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect");


            URI uri = builder.build();
            HttpPost request = new HttpPost(uri);
            request.setHeader("Content-Type", "application/json");
            request.setHeader("Ocp-Apim-Subscription-Key", "{subscription key}");


            // Request body
            StringEntity reqEntity = new StringEntity("{body}");
            request.setEntity(reqEntity);

            HttpResponse response = httpclient.execute(request);
            HttpEntity entity = response.getEntity();

            if (entity != null) 
            {
                System.out.println(EntityUtils.toString(entity));
            }
        }
        catch (Exception e)
        {
            System.out.println(e.getMessage());
        }
    }
}


<!DOCTYPE html>
<html>
<head>
    <title>JSSample</title>
    <script src="http://ajax.googleapis.com/ajax/libs/jquery/1.9.0/jquery.min.js"></script>
</head>
<body>

<script type="text/javascript">
    $(function() {
        var params = {
            // Request parameters
        };
      
        $.ajax({
            url: "https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect?" + $.param(params),
            beforeSend: function(xhrObj){
                // Request headers
                xhrObj.setRequestHeader("Content-Type","application/json");
                xhrObj.setRequestHeader("Ocp-Apim-Subscription-Key","{subscription key}");
            },
            type: "POST",
            // Request body
            data: "{body}",
        })
        .done(function(data) {
            alert("success");
        })
        .fail(function() {
            alert("error");
        });
    });
</script>
</body>
</html>

#import <Foundation/Foundation.h>

int main(int argc, const char * argv[])
{
    NSAutoreleasePool * pool = [[NSAutoreleasePool alloc] init];
    
    NSString* path = @"https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect";
    NSArray* array = @[
                         // Request parameters
                         @"entities=true",
                      ];
    
    NSString* string = [array componentsJoinedByString:@"&"];
    path = [path stringByAppendingFormat:@"?%@", string];

    NSLog(@"%@", path);

    NSMutableURLRequest* _request = [NSMutableURLRequest requestWithURL:[NSURL URLWithString:path]];
    [_request setHTTPMethod:@"POST"];
    // Request headers
    [_request setValue:@"application/json" forHTTPHeaderField:@"Content-Type"];
    [_request setValue:@"{subscription key}" forHTTPHeaderField:@"Ocp-Apim-Subscription-Key"];
    // Request body
    [_request setHTTPBody:[@"{body}" dataUsingEncoding:NSUTF8StringEncoding]];
    
    NSURLResponse *response = nil;
    NSError *error = nil;
    NSData* _connectionData = [NSURLConnection sendSynchronousRequest:_request returningResponse:&response error:&error];

    if (nil != error)
    {
        NSLog(@"Error: %@", error);
    }
    else
    {
        NSError* error = nil;
        NSMutableDictionary* json = nil;
        NSString* dataString = [[NSString alloc] initWithData:_connectionData encoding:NSUTF8StringEncoding];
        NSLog(@"%@", dataString);
        
        if (nil != _connectionData)
        {
            json = [NSJSONSerialization JSONObjectWithData:_connectionData options:NSJSONReadingMutableContainers error:&error];
        }
        
        if (error || !json)
        {
            NSLog(@"Could not parse loaded json with error:%@", error);
        }
        
        NSLog(@"%@", json);
        _connectionData = nil;
    }
    
    [pool drain];

    return 0;
}

<?php
// This sample uses the Apache HTTP client from HTTP Components (http://hc.apache.org/httpcomponents-client-ga/)
require_once 'HTTP/Request2.php';

$request = new Http_Request2('https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect');
$url = $request->getUrl();

$headers = array(
    // Request headers
    'Content-Type' => 'application/json',
    'Ocp-Apim-Subscription-Key' => '{subscription key}',
);

$request->setHeader($headers);

$parameters = array(
    // Request parameters
);

$url->setQueryVariables($parameters);

$request->setMethod(HTTP_Request2::METHOD_POST);

// Request body
$request->setBody("{body}");

try
{
    $response = $request->send();
    echo $response->getBody();
}
catch (HttpException $ex)
{
    echo $ex;
}

?>
########### Python 2.7 #############
import httplib, urllib, base64

headers = {
    # Request headers
    'Content-Type': 'application/json',
    'Ocp-Apim-Subscription-Key': '{subscription key}',
}

params = urllib.urlencode({
})

try:
    conn = httplib.HTTPSConnection('*.cognitiveservices.azure.com')
    conn.request("POST", "/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect?%s" % params, "{body}", headers)
    response = conn.getresponse()
    data = response.read()
    print(data)
    conn.close()
except Exception as e:
    print("[Errno {0}] {1}".format(e.errno, e.strerror))

####################################

########### Python 3.2 #############
import http.client, urllib.request, urllib.parse, urllib.error, base64

headers = {
    # Request headers
    'Content-Type': 'application/json',
    'Ocp-Apim-Subscription-Key': '{subscription key}',
}

params = urllib.parse.urlencode({
})

try:
    conn = http.client.HTTPSConnection('*.cognitiveservices.azure.com')
    conn.request("POST", "/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect?%s" % params, "{body}", headers)
    response = conn.getresponse()
    data = response.read()
    print(data)
    conn.close()
except Exception as e:
    print("[Errno {0}] {1}".format(e.errno, e.strerror))

####################################
require 'net/http'

uri = URI('https://*.cognitiveservices.azure.com/anomalydetector/v1.1-preview.2/multivariate/models/{modelId}/detect')
uri.query = URI.encode_www_form({
})

request = Net::HTTP::Post.new(uri.request_uri)
# Request headers
request['Content-Type'] = 'application/json'
# Request headers
request['Ocp-Apim-Subscription-Key'] = '{subscription key}'
# Request body
request.body = "{body}"

response = Net::HTTP.start(uri.host, uri.port, :use_ssl => uri.scheme == 'https') do |http|
    http.request(request)
end

puts response.body