Skip to content

Amazon EMR API

by amazonaws.com

API keyHTTPSCloud Platforms
Open documentation ↗

Overview

Amazon EMR is a web service that makes it easier to process large amounts of data efficiently. Amazon EMR uses Hadoop processing combined with several Amazon Web Services services to do tasks such as web indexing, data mining, log file analysis, machine learning, scientific simulation, and data warehouse management.

Amazon EMR is a cloud platforms API from amazonaws.com. Requests are authenticated with an API key. It is served over HTTPS. Its OpenAPI description documents 53 endpoints.

At a glance

Authentication
API key
HTTPS
Yes
CORS
Unknown
Base URL
http://elasticmapreduce.amazonaws.com
Version
2009-03-31
Endpoints
53
Spec updated
2020-04-21

Make a first request

Replace the placeholders; the documentation says exactly where credentials go.

cURL
curl -X POST "http://elasticmapreduce.amazonaws.com/#X-Amz-Target=ElasticMapReduce.AddInstanceFleet" \
  -H "Accept: application/json" \
  -H "X-API-Key: YOUR_API_KEY"
JavaScript
const response = await fetch("http://elasticmapreduce.amazonaws.com/#X-Amz-Target=ElasticMapReduce.AddInstanceFleet", {
  method: "POST",
  headers: {
    "Accept": "application/json",
    "X-API-Key": "YOUR_API_KEY",
  },
});
const data = await response.json();
console.log(data);
Python
import requests

response = requests.request(
    "POST",
    "http://elasticmapreduce.amazonaws.com/#X-Amz-Target=ElasticMapReduce.AddInstanceFleet",
    headers={
    "Accept": "application/json",
    "X-API-Key": "YOUR_API_KEY",
    },
    timeout=30,
)
print(response.json())

Endpoints

MethodPathWhat it does
POST/#X-Amz-Target=ElasticMapReduce.AddInstanceFleet<p>Adds an instance fleet to a running cluster.</p> <note> <p>The instance fleet configuration is available only in Amazon EMR versions 4.8.0 and later, excludi
POST/#X-Amz-Target=ElasticMapReduce.AddInstanceGroupsAdds one or more instance groups to a running cluster.
POST/#X-Amz-Target=ElasticMapReduce.AddJobFlowSteps<p>AddJobFlowSteps adds new steps to a running cluster. A maximum of 256 steps are allowed in each job flow.</p> <p>If your cluster is long-running (such as a H
POST/#X-Amz-Target=ElasticMapReduce.AddTagsAdds tags to an Amazon EMR resource, such as a cluster or an Amazon EMR Studio. Tags make it easier to associate resources in various ways, such as grouping clu
POST/#X-Amz-Target=ElasticMapReduce.CancelStepsCancels a pending step or steps in a running cluster. Available only in Amazon EMR versions 4.8.0 and later, excluding version 5.0.0. A maximum of 256 steps are
POST/#X-Amz-Target=ElasticMapReduce.CreateSecurityConfigurationCreates a security configuration, which is stored in the service and can be specified when a cluster is created.
POST/#X-Amz-Target=ElasticMapReduce.CreateStudioCreates a new Amazon EMR Studio.
POST/#X-Amz-Target=ElasticMapReduce.CreateStudioSessionMappingMaps a user or group to the Amazon EMR Studio specified by <code>StudioId</code>, and applies a session policy to refine Studio permissions for that user or gro
POST/#X-Amz-Target=ElasticMapReduce.DeleteSecurityConfigurationDeletes a security configuration.
POST/#X-Amz-Target=ElasticMapReduce.DeleteStudioRemoves an Amazon EMR Studio from the Studio metadata store.
POST/#X-Amz-Target=ElasticMapReduce.DeleteStudioSessionMappingRemoves a user or group from an Amazon EMR Studio.
POST/#X-Amz-Target=ElasticMapReduce.DescribeClusterProvides cluster-level details including status, hardware and software configuration, VPC settings, and so on.
POST/#X-Amz-Target=ElasticMapReduce.DescribeJobFlowsdeprecated<p>This API is no longer supported and will eventually be removed. We recommend you use <a>ListClusters</a>, <a>DescribeCluster</a>, <a>ListSteps</a>, <a>ListIn
POST/#X-Amz-Target=ElasticMapReduce.DescribeNotebookExecutionProvides details of a notebook execution.
POST/#X-Amz-Target=ElasticMapReduce.DescribeReleaseLabelProvides EMR release label details, such as releases available the region where the API request is run, and the available applications for a specific EMR releas
POST/#X-Amz-Target=ElasticMapReduce.DescribeSecurityConfigurationProvides the details of a security configuration by returning the configuration JSON.
POST/#X-Amz-Target=ElasticMapReduce.DescribeStepProvides more detail about the cluster step.
POST/#X-Amz-Target=ElasticMapReduce.DescribeStudioReturns details for the specified Amazon EMR Studio including ID, Name, VPC, Studio access URL, and so on.
POST/#X-Amz-Target=ElasticMapReduce.GetAutoTerminationPolicyReturns the auto-termination policy for an Amazon EMR cluster.
POST/#X-Amz-Target=ElasticMapReduce.GetBlockPublicAccessConfigurationReturns the Amazon EMR block public access configuration for your Amazon Web Services account in the current Region. For more information see <a href="https://d
POST/#X-Amz-Target=ElasticMapReduce.GetClusterSessionCredentialsProvides temporary, HTTP basic credentials that are associated with a given runtime IAM role and used by a cluster with fine-grained access control activated. Y
POST/#X-Amz-Target=ElasticMapReduce.GetManagedScalingPolicyFetches the attached managed scaling policy for an Amazon EMR cluster.
POST/#X-Amz-Target=ElasticMapReduce.GetStudioSessionMappingFetches mapping details for the specified Amazon EMR Studio and identity (user or group).
POST/#X-Amz-Target=ElasticMapReduce.ListBootstrapActionsProvides information about the bootstrap actions associated with a cluster.
POST/#X-Amz-Target=ElasticMapReduce.ListClustersProvides the status of all clusters visible to this Amazon Web Services account. Allows you to filter the list of clusters based on certain criteria; for exampl
POST/#X-Amz-Target=ElasticMapReduce.ListInstanceFleets<p>Lists all available details about the instance fleets in a cluster.</p> <note> <p>The instance fleet configuration is available only in Amazon EMR versions 4
POST/#X-Amz-Target=ElasticMapReduce.ListInstanceGroupsProvides all available details about the instance groups in a cluster.
POST/#X-Amz-Target=ElasticMapReduce.ListInstancesProvides information for all active EC2 instances and EC2 instances terminated in the last 30 days, up to a maximum of 2,000. EC2 instances in any of the follow
POST/#X-Amz-Target=ElasticMapReduce.ListNotebookExecutionsProvides summaries of all notebook executions. You can filter the list based on multiple criteria such as status, time range, and editor id. Returns a maximum o
POST/#X-Amz-Target=ElasticMapReduce.ListReleaseLabelsRetrieves release labels of EMR services in the region where the API is called.
POST/#X-Amz-Target=ElasticMapReduce.ListSecurityConfigurationsLists all the security configurations visible to this account, providing their creation dates and times, and their names. This call returns a maximum of 50 clus
POST/#X-Amz-Target=ElasticMapReduce.ListStepsProvides a list of steps for the cluster in reverse order unless you specify <code>stepIds</code> with the request or filter by <code>StepStates</code>. You can
POST/#X-Amz-Target=ElasticMapReduce.ListStudioSessionMappingsReturns a list of all user or group session mappings for the Amazon EMR Studio specified by <code>StudioId</code>.
POST/#X-Amz-Target=ElasticMapReduce.ListStudiosReturns a list of all Amazon EMR Studios associated with the Amazon Web Services account. The list includes details such as ID, Studio Access URL, and creation
POST/#X-Amz-Target=ElasticMapReduce.ModifyClusterModifies the number of steps that can be executed concurrently for the cluster specified using ClusterID.
POST/#X-Amz-Target=ElasticMapReduce.ModifyInstanceFleet<p>Modifies the target On-Demand and target Spot capacities for the instance fleet with the specified InstanceFleetID within the cluster specified using Cluster
POST/#X-Amz-Target=ElasticMapReduce.ModifyInstanceGroupsModifyInstanceGroups modifies the number of nodes and configuration settings of an instance group. The input parameters include the new target instance count fo
POST/#X-Amz-Target=ElasticMapReduce.PutAutoScalingPolicyCreates or updates an automatic scaling policy for a core instance group or task instance group in an Amazon EMR cluster. The automatic scaling policy defines h
POST/#X-Amz-Target=ElasticMapReduce.PutAutoTerminationPolicy<note> <p>Auto-termination is supported in Amazon EMR versions 5.30.0 and 6.1.0 and later. For more information, see <a href="https://docs.aws.amazon.com/emr/la
POST/#X-Amz-Target=ElasticMapReduce.PutBlockPublicAccessConfigurationCreates or updates an Amazon EMR block public access configuration for your Amazon Web Services account in the current Region. For more information see <a href=
POST/#X-Amz-Target=ElasticMapReduce.PutManagedScalingPolicyCreates or updates a managed scaling policy for an Amazon EMR cluster. The managed scaling policy defines the limits for resources, such as EC2 instances that c
POST/#X-Amz-Target=ElasticMapReduce.RemoveAutoScalingPolicyRemoves an automatic scaling policy from a specified instance group within an EMR cluster.
POST/#X-Amz-Target=ElasticMapReduce.RemoveAutoTerminationPolicyRemoves an auto-termination policy from an Amazon EMR cluster.
POST/#X-Amz-Target=ElasticMapReduce.RemoveManagedScalingPolicyRemoves a managed scaling policy from a specified EMR cluster.
POST/#X-Amz-Target=ElasticMapReduce.RemoveTags<p>Removes tags from an Amazon EMR resource, such as a cluster or Amazon EMR Studio. Tags make it easier to associate resources in various ways, such as groupin
POST/#X-Amz-Target=ElasticMapReduce.RunJobFlow<p>RunJobFlow creates and starts running a new cluster (job flow). The cluster runs the steps specified. After the steps complete, the cluster stops and the HDF
POST/#X-Amz-Target=ElasticMapReduce.SetTerminationProtection<p>SetTerminationProtection locks a cluster (job flow) so the EC2 instances in the cluster cannot be terminated by user intervention, an API call, or in the eve
POST/#X-Amz-Target=ElasticMapReduce.SetVisibleToAllUsers<important> <p>The SetVisibleToAllUsers parameter is no longer supported. Your cluster may be visible to all users in your account. To restrict cluster access u
POST/#X-Amz-Target=ElasticMapReduce.StartNotebookExecutionStarts a notebook execution.
POST/#X-Amz-Target=ElasticMapReduce.StopNotebookExecutionStops a notebook execution.
POST/#X-Amz-Target=ElasticMapReduce.TerminateJobFlows<p>TerminateJobFlows shuts a list of clusters (job flows) down. When a job flow is shut down, any step not yet completed is canceled and the EC2 instances on wh
POST/#X-Amz-Target=ElasticMapReduce.UpdateStudioUpdates an Amazon EMR Studio configuration, including attributes such as name, description, and subnets.
POST/#X-Amz-Target=ElasticMapReduce.UpdateStudioSessionMappingUpdates the session policy attached to the user or group for the specified Amazon EMR Studio.

Questions

Does the Amazon EMR API need an API key?

Yes. The Amazon EMR API uses API key authentication; the documentation explains how to get credentials.

Does the Amazon EMR API support HTTPS?

Yes, the Amazon EMR API is served over HTTPS.

How many endpoints does the Amazon EMR API have?

Its OpenAPI description lists 53 endpoints in version 2009-03-31. All of them are shown on this page.

What are alternatives to the Amazon EMR API?

Other Cloud Platforms APIs include Remote Settings PROD, Linode API, DigitalOcean API, Vercel API, Platform API.

Compare alternatives →

Remote Settings PROD

Cloud Platforms

Firefox is a free web browser backed by Mozilla, a non-profit dedicated to internet health and privacy.

No auth19 endpoints

Linode API

Cloud Platforms

## Introduction The Linode API provides the ability to programmatically manage the full range of Linode products and services. This reference is designed to assist application developers and system administrators. Each endpoint includes descriptions, request syntax, and examples using standard HTTP requests. Response data is returned in JSON format. This document was generated from our OpenAPI Specification. See the <a target="_top" href="https://www.openapis.org">OpenAPI website</a> for more information. <a target="_top" href="/docs/api/openapi.yaml">Download the Linode OpenAPI Specification</a>. ## Changelog <a target="_top" href="/docs/products/tools/api/release-notes/">View our Changelog</a> to see release notes on all changes made to our API. ## Access and Authentication Some endpoints are publicly accessible without requiring authentication. All endpoints affecting your Account, however, require either a Personal Access Token or OAuth authentication (when using third-party applications). ### Personal Access Token The easiest way to access the API is with a Personal Access Token (PAT) generated from the <a target="_top" href="https://cloud.linode.com/profile/tokens">Linode Cloud Manager</a> or the [Create Personal Access Token](/docs/api/profile/#personal-access-token-create) endpoint. All scopes for the OAuth security model ([defined below](/docs/api/profile/#oauth)) apply to this security model as well. #### Authentication | Security Scheme Type: | HTTP | |-----------------------|------| | **HTTP Authorization Scheme** | bearer | ### OAuth If you only need to access the Linode API for personal use, we recommend that you create a [personal access token](/docs/api/#personal-access-token). If you're designing an application that can authenticate with an arbitrary Linode user, then you should use the OAuth 2.0 workflows presented in this section. For a more detailed example of an OAuth 2.0 implementation, see our guide on [How to Create an OAuth App with the Linode Python API Library](/docs/products/tools/api/guides/create-an-oauth-app-with-the-python-api-library/#oauth-2-authentication-exchange). Before you implement OAuth in your application, you first need to create an OAuth client. You can do this [with the Linode API](/docs/api/account/#oauth-client-create) or [via the Cloud Manager](https://cloud.linode.com/profile/clients): - When creating the client, you'll supply a `label` and a `redirect_uri` (referred to as the Callback URL in the Cloud Manager). - The response from this endpoint will give you a `client_id` and a `secret`. - Clients can be public or private, and are private by default. You can choose to make the client public when it is created. - A private client is used with applications which can securely store the client secret (that is, the secret returned to you when you first created the client). For example, an application running on a secured server that only the developer has access to would use a private OAuth client. This is also called a confidential client in some OAuth documentation. - A public client is used with applications where the client secret is not guaranteed to be secure. For example, a native app running on a user's computer may not be able to keep the client secret safe, as a user could potentially inspect the source of the application. So, native apps or apps that run in a user's browser should use a public client. - Public and private clients follow different workflows, as described below. #### OAuth Workflow The OAuth workflow is a series of exchanges between your third-party app and Linode. The workflow is used to authenticate a user before an application can start making API calls on the user's behalf. Notes: - With respect to the diagram in [section 1.2 of RFC 6749](https://tools.ietf.org/html/rfc6749#section-1.2), login.linode.com (referred to in this section as the *login server*) is the Resource Owner and the Authorization Server; api.linode.com (referred to here as the *api se

Bearer token350 endpoints

DigitalOcean API

Cloud Platforms

# Introduction The DigitalOcean API allows you to manage Droplets and resources within the DigitalOcean cloud in a simple, programmatic way using conventional HTTP requests. All of the functionality that you are familiar with in the DigitalOcean control panel is also available through the API, allowing you to script the complex actions that your situation requires. The API documentation will start with a general overview about the design and technology that has been implemented, followed by reference information about specific endpoints. ## Requests Any tool that is fluent in HTTP can communicate with the API simply by requesting the correct URI. Requests should be made using the HTTPS protocol so that traffic is encrypted. The interface responds to different methods depending on the action required. |Method|Usage| |--- |--- | |GET|For simple retrieval of information about your account, Droplets, or environment, you should use the GET method. The information you request will be returned to you as a JSON object. The attributes defined by the JSON object can be used to form additional requests. Any request using the GET method is read-only and will not affect any of the objects you are querying.| |DELETE|To destroy a resource and remove it from your account and environment, the DELETE method should be used. This will remove the specified object if it is found. If it is not found, the operation will return a response indicating that the object was not found. This idempotency means that you do not have to check for a resource's availability prior to issuing a delete command, the final state will be the same regardless of its existence.| |PUT|To update the information about a resource in your account, the PUT method is available. Like the DELETE Method, the PUT method is idempotent. It sets the state of the target using the provided values, regardless of their current values. Requests using the PUT method do not need to check the current attributes of the object.| |PATCH|Some resources support partial modification. In these cases, the PATCH method is available. Unlike PUT which generally requires a complete representation of a resource, a PATCH request is is a set of instructions on how to modify a resource updating only specific attributes.| |POST|To create a new object, your request should specify the POST method. The POST request includes all of the attributes necessary to create a new object. When you wish to create a new object, send a POST request to the target endpoint.| |HEAD|Finally, to retrieve metadata information, you should use the HEAD method to get the headers. This returns only the header of what would be returned with an associated GET request. Response headers contain some useful information about your API access and the results that are available for your request. For instance, the headers contain your current rate-limit value and the amount of time available until the limit resets. It also contains metrics about the total number of objects found, pagination information, and the total content length.| ## HTTP Statuses Along with the HTTP methods that the API responds to, it will also return standard HTTP statuses, including error codes. In the event of a problem, the status will contain the error code, while the body of the response will usually contain additional information about the problem that was encountered. In general, if the status returned is in the 200 range, it indicates that the request was fulfilled successfully and that no error was encountered. Return codes in the 400 range typically indicate that there was an issue with the request that was sent. Among other things, this could mean that you did not authenticate correctly, that you are requesting an action that you do not have authorization for, that the object you are requesting does not exist, or that your request is malformed. If you receive a status in the 500 range, this generally indicates a server-side problem. This means that we are having

Bearer token290 endpoints

Vercel API

Cloud Platforms

Vercel combines the best developer experience with an obsessive focus on end-user performance. Our platform enables frontend teams to do their best work.

Bearer token112 endpoints

Platform API

Cloud Platforms

The [REST API specification](https://www.ably.io/documentation/rest-api) for Ably.

HTTP Basic22 endpoints

Azure Data Lake Storage

Cloud Platforms

Azure Data Lake Storage provides storage for Hadoop and other big data workloads.

No auth10 endpoints

Listed from APIs.guru (CC0).