Configure Broker defaults¶
If you have cluster administrator permissions for your Knative installation, you can modify ConfigMaps to change the global default configuration options for Brokers on the cluster.
Knative Eventing provides a config-br-defaults
ConfigMap that contains the configuration settings that govern default Broker creation.
The default config-br-defaults
ConfigMap is as follows:
apiVersion: v1
kind: ConfigMap
metadata:
name: config-br-defaults
namespace: knative-eventing
data:
# Configures the default for any Broker that does not specify a spec.config or Broker class.
default-br-config: |
clusterDefault:
brokerClass: MTChannelBasedBroker
apiVersion: v1
kind: ConfigMap
name: config-br-default-channel
namespace: knative-eventing
In this case, each new Broker created in the cluster would use by default the MTChannelBasedBroker
Broker class and the config-br-default-channel
ConfigMap from the knative-eventing
namespace for its configuration if not other specified in the Brokers eventing.knative.dev/broker.class
annotation and/or .spec.config
(see Developer configuration options).
However, if you would like like for example a Kafka Channel to be used as the default Channel implementation for any Broker that is created, you can change the config-br-defaults
ConfigMap to look as follows:
apiVersion: v1
kind: ConfigMap
metadata:
name: config-br-defaults
namespace: knative-eventing
data:
# Configures the default for any Broker that does not specify a spec.config or Broker class.
default-br-config: |
clusterDefault:
brokerClass: MTChannelBasedBroker
apiVersion: v1
kind: ConfigMap
name: kafka-channel
namespace: knative-eventing
Now every Broker created in the cluster that does not have a spec.config
will be configured to use the kafka-channel
ConfigMap. For more information about creating a kafka-channel
ConfigMap to use with your Broker, see the Kafka Channel ConfigMap documentation.
You can also modify the default Broker configuration for one or more dedicated namespaces, by defining it in the namespaceDefaults
section. For example, if you want to use the config-br-default-channel
ConfigMap for all Brokers by default, but want to use kafka-channel
ConfigMap for namespace-1
and namespace-2
, you would use the following ConfigMap:
apiVersion: v1
kind: ConfigMap
metadata:
name: config-br-defaults
namespace: knative-eventing
data:
default-br-config: |
clusterDefault:
brokerClass: MTChannelBasedBroker
apiVersion: v1
kind: ConfigMap
name: config-br-default-channel
namespace: knative-eventing
namespaceDefaults:
namespace-1:
apiVersion: v1
kind: ConfigMap
name: kafka-channel
namespace: knative-eventing
namespace-2:
apiVersion: v1
kind: ConfigMap
name: kafka-channel
namespace: knative-eventing
Configuring the Broker class¶
Besides configuring the Broker class for each broker individually, it is possible to define the default Broker class cluster wide or on a per namespace basis:
Configuring the default Broker class for the cluster¶
You can configure the clusterDefault
Broker class so that any Broker created in the cluster that does not have a eventing.knative.dev/broker.class
annotation uses this default Broker class:
apiVersion: v1
kind: ConfigMap
metadata:
name: config-br-defaults
namespace: knative-eventing
data:
# Configures the default for any Broker that does not specify a spec.config or Broker class.
default-br-config: |
clusterDefault:
brokerClass: MTChannelBasedBroker
Configuring the default Broker class for namespaces¶
You can modify the default Broker class for one or more namespaces.
For example, if you want to use a KafkaBroker
Broker class for all other Brokers created on the cluster, but you want to use the MTChannelBasedBroker
Broker class for Brokers created in namespace-1
and namespace-2
, you would use the following ConfigMap settings:
apiVersion: v1
kind: ConfigMap
metadata:
name: config-br-defaults
namespace: knative-eventing
data:
# Configures the default for any Broker that does not specify a spec.config or Broker class.
default-br-config: |
clusterDefault:
brokerClass: KafkaBroker
namespaceDefaults:
namespace1:
brokerClass: MTChannelBasedBroker
namespace2:
brokerClass: MTChannelBasedBroker
Note
Be aware that different Broker classes usually require different configuration ConfigMaps. See the configuration options of the different Broker implementations on how their referenced ConfigMaps have to look like (e.g. for MTChannelBasedBroker or Knative Broker for Apache Kafka).
Configuring delivery spec defaults¶
You can configure default event delivery parameters for Brokers that are applied in cases where an event fails to be delivered:
apiVersion: v1
kind: ConfigMap
metadata:
name: config-br-defaults
namespace: knative-eventing
data:
# Configures the default for any Broker that does not specify a spec.config or Broker class.
default-br-config: |
clusterDefault:
brokerClass: MTChannelBasedBroker
apiVersion: v1
kind: ConfigMap
name: kafka-channel
namespace: knative-eventing
delivery:
retry: 10
backoffDelay: PT0.2S
backoffPolicy: exponential
namespaceDefaults:
namespace-1:
apiVersion: v1
kind: ConfigMap
name: config-br-default-channel
namespace: knative-eventing
delivery:
deadLetterSink:
ref:
kind: Service
namespace: example-namespace
name: example-service
apiVersion: v1
uri: example-uri
retry: 10
backoffPolicy: exponential
backoffDelay: "PT0.2S"
Dead letter sink¶
You can configure the deadLetterSink
delivery parameter so that if an event fails to be delivered it is sent to the specified event sink.
Retries¶
You can set a minimum number of times that the delivery must be retried before the event is sent to the dead letter sink, by configuring the retry
delivery parameter with an integer value.
Back off delay¶
You can set the backoffDelay
delivery parameter to specify the time delay before an event delivery retry is attempted after a failure. The duration of the backoffDelay
parameter is specified using the ISO 8601 format.
Back off policy¶
The backoffPolicy
delivery parameter can be used to specify the retry back off policy. The policy can be specified as either linear or exponential. When using the linear back off policy, the back off delay is the time interval specified between retries. When using the exponential backoff policy, the back off delay is equal to backoffDelay*2^<numberOfRetries>
.
Integrating Istio with Knative Brokers¶
Protect a Knative Broker by using JSON Web Token (JWT) and Istio¶
Prerequisites¶
- You have installed Knative Eventing.
- You have installed Istio.
Procedure¶
-
Label the
knative-eventing
namespace, so that Istio can handle JWT-based user authentication, by running the command:kubectl label namespace knative-eventing istio-injection=enabled
-
Restart the broker ingress pod, so that the
istio-proxy
container can be injected as a sidecar, by running the command:kubectl delete pod <broker-ingress-pod-name> -n knative-eventing
Where
<broker-ingress-pod-name>
is the name of your Broker ingress pod.The pod now has two containers:
knative-eventing <broker-ingress-pod-name> 2/2 Running 1 175m
-
Create a broker, then use get the URL of your Broker by running the command:
kubectl get broker <broker-name>
Where
<broker-name>
is the name of your Broker.Example output:
NAMESPACE NAME URL AGE READY REASON default my-broker http://broker-ingress.knative-eventing.svc.cluster.local/default/my-broker 6s True
-
Start a
curl
pod by running the following command:kubectl -n default run curl --image=radial/busyboxplus:curl -i --tty
-
Send a CloudEvent with an HTTP POST against the Broker URL by running the following command:
curl -X POST -v \ -H "content-type: application/json" \ -H "ce-specversion: 1.0" \ -H "ce-source: my/curl/command" \ -H "ce-type: my.demo.event" \ -H "ce-id: 0815" \ -d '{"value":"Hello Knative"}' \ <broker-URL>
Where
<broker-URL>
is the URL of your Broker. For example:curl -X POST -v \ -H "content-type: application/json" \ -H "ce-specversion: 1.0" \ -H "ce-source: my/curl/command" \ -H "ce-type: my.demo.event" \ -H "ce-id: 0815" \ -d '{"value":"Hello Knative"}' \ http://broker-ingress.knative-eventing.svc.cluster.local/default/my-broker
-
You will receive a
202
HTTP response code, that the broker did accept the request:... * Mark bundle as not supporting multiuse < HTTP/1.1 202 Accepted < allow: POST, OPTIONS < date: Tue, 15 Mar 2022 13:37:57 GMT < content-length: 0 < x-envoy-upstream-service-time: 79 < server: istio-envoy < x-envoy-decorator-operation: broker-ingress.knative-eventing.svc.cluster.local:80/*
-
Apply a
AuthorizationPolicy
object in theknative-eventing
namespace to describe that the path to the Broker is restricted to a given user:apiVersion: security.istio.io/v1beta1 kind: AuthorizationPolicy metadata: name: require-jwt namespace: knative-eventing spec: action: ALLOW rules: - from: - source: requestPrincipals: ["testing@secure.istio.io/testing@secure.istio.io"] to: - operation: methods: ["POST"] paths: ["/default/my-broker"]
-
Create a
RequestAuthentication
object for the userrequestPrincipal
in theistio-system
namespace:apiVersion: security.istio.io/v1beta1 kind: RequestAuthentication metadata: name: "jwt-example" namespace: istio-system spec: jwtRules: - issuer: "testing@secure.istio.io" jwksUri: "https://raw.githubusercontent.com/istio/istio/release-1.13/security/tools/jwt/samples/jwks.json"
-
Now retrying the
curl
command results in a403 - Forbidden
response code from the server:... * Mark bundle as not supporting multiuse < HTTP/1.1 403 Forbidden < content-length: 19 < content-type: text/plain < date: Tue, 15 Mar 2022 13:47:53 GMT < server: istio-envoy < connection: close < x-envoy-decorator-operation: broker-ingress.knative-eventing.svc.cluster.local:80/*
-
To access the Broker, add the Bearer JSON Web Token as part of the request:
TOKEN=$(curl https://raw.githubusercontent.com/istio/istio/release-1.13/security/tools/jwt/samples/demo.jwt -s) curl -X POST -v \ -H "content-type: application/json" \ -H "Authorization: Bearer ${TOKEN}" \ -H "ce-specversion: 1.0" \ -H "ce-source: my/curl/command" \ -H "ce-type: my.demo.event" \ -H "ce-id: 0815" \ -d '{"value":"Hello Knative"}' \ <broker-URL>
The server now responds with a
202
response code, indicating that it has accepted the HTTP request:* Mark bundle as not supporting multiuse < HTTP/1.1 202 Accepted < allow: POST, OPTIONS < date: Tue, 15 Mar 2022 14:05:09 GMT < content-length: 0 < x-envoy-upstream-service-time: 40 < server: istio-envoy < x-envoy-decorator-operation: broker-ingress.knative-eventing.svc.cluster.local:80/*