Let's take a look at some concepts and terminology that you need to know in order to follow the use cases.
WSO2 Cloud's user model
You can register to all of the WSO2 Public Cloud offerings (e.g., the Integration Cloud, the API Cloud) using a valid email address, and create multiple organizations under the same login. The system creates a unique tenant domain name for each organization you create. The user who creates an organization is assigned admin rights to it.
In WSO2 Public Cloud, users are authorized by their email addresses and are decoupled from organizations and tenant domains. This allows one user to be in multiple organizations (tenant domains) at the same time and log in to each organization using a single email address. If users are added to more than one organization, they are prompted to select the organization before logging in to its Cloud.
Diagram: WSO2 Cloud's user model
API Cloud components
The API Cloud comprises of the API Publisher, Store, Gateway and the Key Manager. Given below is a description of each component:
- API Gateway: Secures, protects, manages, and scales API calls. It is a simple API proxy that intercepts API requests and applies policies such as throttling and security. It also gathers API usage statistics.
- API Key Manager: Handles all security and key-related operations. API Gateway connects with the Key Manager to check the validity of OAuth tokens when APIs are invoked. The Key Manager also provides a token API to generate OAuth tokens that can be accessed via the Gateway.
When the API Gateway receives API calls, it contacts the Key Manager service to verify the validity of the tokens and do security checks. For example, when the Gateway receives a log call, it forwards the calls to the Key Manager server. You must pass username, password, consumer key and consumer secret key with it to register. All tokens used for validation are based on OAuth 2.0 protocol. Secure authorization of APIs is provided by the OAuth 2.0 standard for key management. The API Gateway supports API authentication with OAuth 2.0 and enables IT organizations to enforce rate limits and throttling policies.
When the API Gateway receives API invocation calls, it similarly contacts the API Key Manager service for verification. This verification call happens every time the Gateway receives an API invocation call if is not enabled at the Gateway level. For this verification, the Gateway passes an access token, the API and its version to the Key Manager.
Communication between API Gateway and Key Manager happens either through a Web service call or a Thrift call. The default communication protocol is Apache Thrift, which is an RPC framework used to develop scalable, cross-language services. Thrift is much faster than SOAP over HTTP communication.
- API Publisher: Enables API providers to publish APIs, share documentation, provision API keys and gather feedback on API features, quality, and usage. The API Publisher is opened automatically when you sign in to the API Cloud.
- API Store: Enables API consumers to discover API functionality, subscribe to APIs, evaluate them and interact with API publishers. Any user can view the Stores of all tenants registered in the Cloud. If you know the name of the tenant, you can access its store using the URL
- Additionally, statistics are provided by the monitoring component, which integrates with WSO2 Data Analytics Server.
Users and roles
The API Cloud offers distinct community roles that are applicable to most enterprises:
- APICloudPublisher: a publisher manages a set of APIs across the enterprise or business unit and controls the API lifecycle, subscriptions, and monetization aspects. The publisher is also interested in usage patterns for APIs and has access to all API statistics.
- APICloudSubscriber: a subscriber uses the API store to discover APIs, read the documentation, and forums, rate/comment on the APIs, subscribes to APIs, obtain access tokens, and invoke the APIs.
An API is the published interface, while the Service is the implementation running in the backend. APIs have their own lifecycles that are independent of the backend Services they rely on. This lifecycle is exposed in the API publisher Web interface and is managed by the API publisher role.
The following stages are available in the default API lifecycle:
- CREATED: API metadata is added to the API Store, but it is not deployed in the API gateway and therefore, is not visible to subscribers in the API Store.
- PROTOTYPED: the API is deployed and published in the API Store as a prototype.A prototyped API is usually a mock implementation made public in order to get feedback about its usability. Users can invoke the API without a subscription.
- PUBLISHED: The API is visible in the API Store and available for subscription.
- DEPRECATED: When an API is deprecated, new subscriptions are disabled. But the API is still deployed in the Gateway and is available at runtime to existing subscribers. Existing subscribers can continue to use it as usual until the API is retired.
- RETIRED: The API is unpublished from the API gateway and deleted from the store.
- BLOCKED: Access to the API is temporarily blocked. Runtime calls are blocked and the API is not shown in the API Store anymore.
An application is a logical collection of APIs. An application is primarily used to decouple the consumer from the APIs. It allows you to :
- Generate and use a single key for multiple APIs
- Subscribe multiple times to a single API with different SLA levels
You subscribe to APIs through an application. Applications are available at different SLA levels and have application-level throttling tiers engaged in them. A throttling tier determines the maximum number of calls you can make to an API during a given period of time.
The API Cloud comes with a pre-created, default application. You can also create your own applications.
An access token is a simple string that is passed as an HTTP header of a request. For example, "
Authorization: Bearer NtBQkXoKElu0H1a1fQ0DWfo6IX4a ." Access tokens authenticate API users and applications, and ensure better security (e.g., prevent DoS attacks ). If a token that is passed with a request is invalid, the request is discarded in the first stage of processing. Access tokens work equally well for SOAP and REST calls.
There are two types of access tokens:
User access tokens
Tokens to authenticate the final user of an API. User access tokens allow you to invoke an API even from a third-party application like a mobile app. You generate/renew a user access token by calling the Login API through a REST client. For more information, see Token API.
Application access tokens
Tokens to authenticate an application, which is a logical collection of APIs. They allow you to access all APIs associated with an application using a single token, and also subscribe multiple times to a single API with different SLA levels. Application access tokens leverage OAuth 2.0 to provide simple key management.
The steps below describe how to generate/renew application access tokens:
- Log in to the API Store.
Click the Applications menu and then click the application to open it. For example,
Under the Production Keys tab, scroll down and click Regenerate.
Throttling allows you to limit the number of successful hits to an API during a given period of time, typically in cases such as the following:
- To protect your APIs from common types of security attacks such as
- To regulate traffic according to infrastructure availability.
- To make an API, application or a resource available to a consumer at different levels of service, usually for monetization purposes.
See Working with Throttling in the WSO2 API Manager documentation for detailed information about throttling, throttling limits, policies etc.
API visibility and subscription
Visibility settings prevent certain user roles from viewing and modifying APIs created by another user role.
- Public: the API is visible to all users (registered and anonymous), and can be advertised in multiple stores (central and non-WSO2 stores).
- Visible to my domain: the API is visible to all users who are registered to the API's tenant domain.
Restricted by Roles: The API is visible to its tenant domain and only to the user roles that you specify. Accepted roles are admin, publisher, subscriber, and appclouduser.
Given below is how visibility levels work for users in different roles:
publisherroles can see all APIs in their tenant store even if you restrict access to them. This is because those roles have permission to view and edit all APIs in the API Publisher, and therefore, does not have to be restricted in the Store.
- Anonymous users can only see APIs that have visibility as
- Registered users can see
- public APIs of all tenant domains
- all APIs in the registered user's tenant domain as long as the API is not restricted to a role that the user is assigned to
An API's visibility is directly related to the API's subscription availability because you cannot subscribe to something you don't see in the Store. The diagram below depicts this relationship:
An API is made up of one or more resources. Each resource handles a particular type of request and is analogous to a method (function) in a larger API.
API resources accept following attributes:
|OAuth Scopes||OAuth scopes|
A URL pattern can be one of the following types:
The terms url-mapping and uri-template come from Synapse configuration language. When an API is published in the API Publisher, a corresponding XML definition is created in the API Gateway. This XML file has a dedicated section for defining resources. See examples below:
Parametrizing the URL allows the API Manager to map the incoming requests to the defined resource templates based on the message content and request URI. Once a uri-template is matched, the parameters in the template are populated appropriately. As per the above example, a request made to http://gatewa_host:gateway_port/api/v1/texas/houston sets the value of
Also, see http://tools.ietf.org/html/rfc6570 on URI templates.
|HTTP Verb||The HTTP methods that specify the desired action to be performed on the resource. These methods can be GET, POST, PUT, DELETE or OPTIONS. Multiple methods can be selected.|
The authentication type of each HTTP method of the resource. You can give one of the following:
Note that for the resources that have HTTP verbs (GET, POST etc.) requiring authentication (i.e., Auth Type is not NONE), set None as the Auth type of OPTIONS. This is to support CORS (Cross Origin Resource Sharing) between the API Store and Gateway.
The auth type is cached in the API Manager for better performance. If you change the auth type through the UI, it takes about 15 minutes to refresh the cache. During that time, the server returns the old auth type from the cache.
Once a request is accepted by a resource, it will be mediated through an in-sequence. Any response from the backend is handled through the out-sequence. Fault sequences are used to mediate errors that might occur in either sequence. The default in-sequence,out-sequence, and fault sequences are generated when the API is published.
Swagger API Console
WSO2 API Store provides an integrated Swagger UI, which is part of the Swagger project. You can use it for interactive API documentation and to invoke APIs.
Swagger is a 100% open source, standard, language-agnostic specification and a complete framework for describing, producing, consuming, and visualizing RESTful APIs, without the need of a proxy or third-party services. Swagger allows consumers to understand the capabilities of a remote service without accessing its source code and interact with the service with a minimal amount of implementation logic. Swagger helps describe services in the same way that interfaces describe lower-level programming code.
The API Publisher has integrated Swagger to facilitate simple, interactive API documentation and invocation. The documentation is given in a Swagger API definition, which is the JSON representation of the API that is created using the information provided at the time the API is created. The Swagger JSON files are saved in the registry. You can edit the API definition using the Edit Swagger Definition button in the API Publisher.
Also, see the Swagger 2.0 specification.
Scopes enable fine-grained access control to API resources based on user roles. You define scopes to an API's resource. When a user invokes the API, his/her OAuth 2 bearer token cannot grant access to any API resource beyond its associated scopes.
You can apply scopes to an API resource at the time the API is created or modified. In the API Publisher, click the API -> Add menu (to add a new API) or the Edit link next to an existing API. Then, navigate to the Manage tab and scroll down to see the Add Scopes button. A screen such as the following appears:
|Scope Key||A unique key for identifying the scope. Typically, it is prefixed by part of the API's name for uniqueness but is not necessarily reader-friendly.|
|Scope Name||A human-readable name for the scope. It typically says what the scope does.|
The user role(s) that are allowed to obtain a token against this scope. E.g., manager, employee.
To illustrate the functionality of scopes, assume you have the following scopes attached to resources of an API:
Assume that users named Tom and John are assigned the employee role and both the employee and manager roles respectively.
Tom requests a token through the Token API as
grant_type=password&username=nuwan&password=xxxx&scope=news_read news_write. However, as Tom is not in the manager role, he will only be granted a token bearing the news_read scope. The response from the Token API will be similar to the following:
Next, John requests a token as
grant_type=password&username=john&password=john123&scope=news_read news_write. As John has both roles assigned, the token will bear both the requested scopes and the response will be similar to the following:
This means that Tom can only access the GET operation of the API while John can access both as he is assigned to both the employee and manager roles. If Tom tries to access the POST operation, there will be an HTTP 403 Forbidden error as follows:
An endpoint is a specific destination for a message such as an address, WSDL, a failover group, a load-balance group etc.
WSO2 API Manager has support for a range of different endpoint types, allowing the API Gateway to connect with advanced types of backends. It supports HTTP endpoints, URL endpoints (also termed as address endpoint), WSDL endpoints, Failover endpoints, Load-balanced endpoints. For more information about endpoints and how to add, edit or delete them, see the WSO2 ESB documentation.
The system reads gateway endpoints from the
api-manager.xmlfile. When there are multiple gateway environments defined, it picks the gateway endpoint of the production environment. You can define both HTTP and HTTPS gateway endpoints as follows:
If both types of endpoints are defined, the HTTPS endpoint will be picked as the server endpoint.
The API Cloud has a default mediation flow that is executed in each API invocation. There are 3 default sequences engaged as
|in||In-sequence is the first place that will be mediated through, once a request is dispatched to a resource of an API. At the end of the in-sequence the request can be forwarded to a back-end application for further processing.|
|out||Any responses coming from the back-end system are mediated through the out-sequence of the resource of the API.|
Fault sequence is there to handle any errors that may occur while mediating a message through a resource.
When the sequence or the proxy service encounters an error during mediation or while forwarding a message, the message that triggered the error is delegated to the specified fault sequence. Using the available mediators it is possible to log the erroneous message, forward it to a special error-tracking service, and send a SOAP fault back to the client indicating the error. We need to configure the fault sequence with the correct error handling instead of simply dropping messages. For more information, see Error Handling.
Sometimes, the backend implementation of a Web service does not exactly match your desired API design. In that case, you do various message transformations and orchestrate multiple backend services to achieve the design you want.
The API Cloud comes with a powerful mediation engine that can transform and orchestrate API calls on the fly. It is built on the WSO2 ESB and supports a variety of mediators that you can use as building blocks for your sequences. Given below is the list of mediators supported in the API Cloud:
|Core||Call||Invokes a service in non-blocking, synchronous manner.|
|Inserts a reference to a sequence.|
|Drop||Drops a message.|
|Enriches a message.|
|Sets or removes properties associated with the message.|
|Log||Logs a message.|
|Filter||Filter||Filters a message using XPath, if-else type of logic.|
|Validates XML messages against a specified schema.|
|Filters messages using XPath and switch logic.|
|Implements complex routing rules (header-based routing, content-based routing, and other rules).|
|Performs XSLT transformations on the XML payload.|
|Performs XSLT transformations on the message stream.|
|Modifies and rewrites URLs or URL fragments.|
|Performs XQuery transformation.|
|Sets or removes SOAP headers.|
Fault (also called Makefault)
|Creates SOAP Faults.|
|Transforms or replaces message content in between the client and the backend server.|
|Advanced||Cache||Evaluates messages based on whether the same message came to the ESB.|
|Splits a message into a number of different messages by finding matching elements in an XPath expression of the original message.|
|Clones a message.|
|Splits a message.|
|Combines a message.|
|Blocks Web service calls.|
|Executes a set of mediators transactionally.|
|DBReport||Writes data to the database.|
|Retrieves information from the database.|
|Evaluates user actions against a XACML policy.|
|Executes a mediator written in Scripting language.|
Also, see the list of WSO2 ESB Mediators.
You can extend the API Gateway's default mediation flow to do custom mediation by providing an extension as a Synapse mediation sequence. You design all sequences using a tool like WSO2 Developer Studio and then store the sequence in the Gateway's registry. See Change the Default Mediation Flow of API Requests.
Response caching stores the response messages per each API in a cache. It improves performance because the backend server does not have to process the same data for a request multiple times. To offset the risk of stale data in the cache, you can set a time period after which the cache is cleared periodically.
Response caching is automatically disabled in the Cloud. You can enable it when creating a new API or editing an existing API. Go to the API's Manage tab in the API Publisher, and select
Enable from the Response Caching drop-down list and give a time-out period.
When an API call hits the API Gateway, the Gateway carries out security checks to verify if the token is valid. During these verifications, the API Gateway extracts parameters such as access token, API, and API version that are passed to it. Since all traffic to APIs goes through the API Gateway, this verification process can become an overhead if the API name, version, and other validation information are not cached. Therefore, caching is enabled at the Gateway by default.
|TASKS||TASKS are refered to the workflows in WSO2 API Manager that you can configure constraints on top of actions performed. There are four main workflows as User SignUp workflow, Application Creation Workflow, Subscription Creation workflow and Application Registration workflow. Refer Managing Workflow Extensions for more information.|
|SETTINGS||By navigating to SETTINGS tab, you are faclilitated to create new upload newly created tenant themes to on top of publisher, store and admin portal user interfaces.|
THROTTLING POLICIES contains the settings for the throttling configurations of API Manager. Under that,
ADVANCED THROTTLING - Create and Update Advanced Throttling polices. Refer Adding an advanced throttling policy for more information.
APPLICATION TIERS - Create and Update Application level throttling tiers. Refer Adding a new application-level throttling tier for more information.
SUBSCRIPTION TIERS - Create and Update API Subscription level throttling tiers. Refer Adding a new subscription-level throttling tier for more information.
BLACK LIST - blacklist requests by APIs, Applications, Users and IP Addresses. Refer Blacklisting Requests for more information.
|LOG ANALYZER||Refer Analyzing Logs with the Log Analyzer|
API AVAILABILITY - provides statistics of API Availability
MANAGE ALERTS - proivdes configuring alerts for different behaviors of APIs, requests, response times etc. Refer Managing Alerts with Real-time Analytics.