All Questions
Tagged with wso2si or wso2-streaming-integrator
148 questions
0
votes
1
answer
57
views
WSO2 Streaming integrator on multiple cores
I develop WSO2 SI application containing 200+ different queries which process events from single stream. Queries contain multiple conditions, regexes, searches in in-memory tables. A little number of ...
0
votes
1
answer
238
views
WSO2 API Manager Integration with Prometheus and Grafana
I'm trying to integrate Prometheus and Grafana with the latest version of WSO2 API Manager (4.2.0) and I'm following the below mentioned documentation.
https://apim.docs.wso2.com/en/latest/observe/...
- 395
0
votes
1
answer
99
views
WSO2 Stream Processor (SP) Json string cannot be parsed to a json object
Here I have a siddhi application setup like below:
WSO2 SP
I have saved it and started it. I am trying to start an event in the cmd as shown below:
Console log
But I get this error;
error message
Any ...
1
vote
2
answers
90
views
WSO2 Stream Processor (SP) Error "could not initialize carbon deployment engine"
I have an issue with my web IDE. The WSO2 SP or siddhi-tooling-5.1.2 starts up as you would expect and I can open the website. However, in the console upon startup it gives this error.
This is an ...
0
votes
2
answers
121
views
How to perform Mongodb CDC using wso2 streaming integrator?
I'm so confused I don't know how to perform mongo cdc with wso2 streaming integrator. I set up a mongo replicaset follow this doc. I config cdc source like below,
but it doesn't work, I got these ...
- 85
0
votes
1
answer
130
views
how to connect to PostgreSQL using Streaming Integrator
I am trying to build POC on connecting to PostgreSQL using Streaming Integrator with CDC listening mode. I am new to this WSO2 product-Streaming Integrator and I am not getting any example for ...
- 7
1
vote
2
answers
137
views
Browsing H2 Database for WSO2 Streaming Integrator (WSO2 SI)
I am using WSO2 Streaming Integrator (WSO2 SI) with default deployment settings which is based on H2 database, but I am not able to find a way to browse H2 database from http://localhost:8082
As I ...
0
votes
1
answer
135
views
Errors in Siddhi app.Different definition same as output 'define stream
I create a stream to read data from csv and write it in Postgresql it do everything just insert data on db:
my csv consist of 1,test,1
my stream :
@App:name("StockFile")
@App:description('...
- 306
0
votes
1
answer
105
views
Siddhi (wso2sp) - encountering DuplicateDefinitionException when trying to perform multiple insert operations on rdbs store
I have a siddhi app (wso2sp 4.4.0) that fails to deploy as soon as I add a second insert operation on one store. No problem with having one update or insert into followed by a second stream updating ...
- 11
0
votes
1
answer
166
views
com/mongodb/MongoException in Siddhi app mongo-store extension
I'm working in WSO2-SI (streaming integrator) and building some siddhi apps. I came to need to use a mongodb-store extension which is available in siddhi store. I installed the extensions and ...
0
votes
1
answer
257
views
WSO2 streaming integrator - read large files (one million of records) and write to another file
I want to read one million records from a CSV file and write to another CSV file with WSO2 streaming integrator. The problem is the slow speed of reading and writing data, almost 10 per second. WSO2 ...
- 103
0
votes
1
answer
239
views
Trying to stack siddhi on wso2 Stream processor/Stream Integrator
I am running a simple Siddhi application as suggested on WSO2 documentation but I get the following exception. I'm following step 2 of this guide below
https://ei.docs.wso2.com/en/latest/streaming-...
- 23
0
votes
2
answers
3k
views
Kibana - The indices which match this index pattern don't contain any time fields
This is my definition:
@Store(type="elasticsearch", hostname="localhost", username="elastic", password="changeme", port='9200', index.name = 'frauds', index....
- 119
1
vote
1
answer
157
views
How to integrate WSO 2 Stream Processor and Tibco EMS?
Is there a way to let a WSO2 Stream Processor Siddhi application send messages to JMS queue in Tibco EMS? This guide here demonstrates how you can do it with ActiveMQ, but how can I set it up with ...
- 45
0
votes
1
answer
340
views
Is there a way to use WSO2 to make REST API call every minutes?
I am trying to use WSO2 to schedule pooling data call every minutes to a REST API my business has and push that information to our centralize MQTT broker.
I've been reading the documents of the ...
0
votes
2
answers
286
views
How to config datasource in WSO2 Stream Integrator 7.1.0 to auto reconnect mysql
I've tried to setup a datasource connect to MySQL in deployment.yaml of WSO2 SI so that I can use it in my Siddhi apps.
It worked fine as normal but when I restart MySQL, the datasource can not ...
- 11
0
votes
1
answer
86
views
WSO2 API Analytics - how to invoke Abnormal request pattern on purpose
We are having WSO2 APIM (still on 2.6.0) and as a PoC I tried to see the analytics (api-analytics 2.6.0 on MySQL). The analytics are collected, displayed, all seems to work good.
On the DEV ...
- 12.2k
0
votes
1
answer
226
views
WSO2 Streaming Integrator - Siddhi.io Aggregate multiple events into one event
I have a requirement to collect multiple events into a single one and consider it as a single event. The output stream should include the input events as a list.
Basically, when the following events ...
- 1,627
0
votes
1
answer
63
views
Database synchronisation with WSO2 SI
does any one have an idea if Stream Integrator can be used in achieving mysql to mysql synchronisation ¿ where a change on Database A is reflected in B and vice versa.
Thanks in advance
- 225
0
votes
2
answers
195
views
WSO2 Stream processor 4.4.0 - Two file source
Can you help me please?
I'm trying create a simple siddhi app on wso2 sp 4.4.0. I'm trying to load two files from two folders and after loading the data, the file will be deleted but only one folder ...
- 25
0
votes
1
answer
90
views
How to filter in queries of wso2 sp complex json processing
I have a requirement to execute a complex json processing.
I have almost completed but struck with a logic of filtering the events based on an attribute. I know filtering on a normal basis but this is ...
0
votes
2
answers
359
views
Parsing DateTime String from CSV File As Event Timestamp
Using WSO2 SP, my app reads lines from the following CSV file:
20170801 000001237,1.321420,1.321510,0
20170801 000001487,1.321440,1.321530,0
20170801 000001737,1.321450,1.321530,0
20170801 000001987,...
- 75
0
votes
1
answer
244
views
How to Run WSO2 Streaming Integrator Editor
I installed WSO2 Streaming Integrator using Docker Container. There is no word about how to install the editor in this tutorial but I need to have WSO2 SI editor.
please give some points about how to ...
- 419
0
votes
1
answer
171
views
Siddhi App, 'Output Rate Limiting' clause misbehaviour in Joins
I am facing a non-expected behaviour when using the clause output every along with table join clause.
I have an basic app, with one input stream, and 2 tables, which store a different list of values. ...
- 3
1
vote
0
answers
219
views
Error starting Siddhi App in WSO2 Stream Processor: javax/jms/JMSContext
I'm trying to use a queue from Tibco EMS as a source of the Siddhi application.
For that, I used the documentation about ActiveMQ as a reference and generated successfully the OSGi-converted jar for ...
- 121
0
votes
1
answer
307
views
writing siddhi custom function/stream extension getting neither a function extension nor an aggregated attribute extension
I am new to WSO2 Sp and siddhi.
I am trying to create custom siddhi extension. I used the below archetype to generate the skeleton extension and i tried modifying the function and streamfunction ...
0
votes
1
answer
67
views
Is there any plans for WSO2 SP 4.4.0 to upgrade siddhi core version to 5x?
Unable to handle responses using 'regex' http.status.code in Siddhi
In a reply to a question in the above-mentioned link you have said that "WSO2 SP 4.4.0 is based on Siddhi core 4x and is ...
- 45
-1
votes
1
answer
1k
views
WSO2 Stream Processor MySQL CDC connection error by charset class not found
I am reading and doing WSO2 Stream Processor 4.4.0 Tutorial from its tutorial (Capturing+Changes+from+Data+Stores) step by step.
But unfortunately WSO2SP could not get snapshot from database with ...
-1
votes
1
answer
75
views
Is there any Query Builder with Graphical Interface for WSO2 Stream Processor?
I am looking for an Open source Business Intelligent (BI) Solutions for my organization. So I am trying WSO2 Stream Processor and I could not find any graphical Interface for building RDBMS Queries.
...
0
votes
1
answer
500
views
How to parse array-of-arrays with Siddhi
I'm trying to parse a JSON event stream using WSO2 Streaming Integrator / Siddhi but seem unsuccessful in getting the events properly into the stream.
I'm using dockerimage wso2/streaming-integrator:1....
- 3
0
votes
1
answer
80
views
WSO2 StreamProcessor: Is there a way to connect to MQTT using certificates in SiddhiApp
Siddhi Application to be created to connect to source and sink MQTT brokers. Now, while the source is connecting it has certificate to get connected but as far as I know Siddhi IO MQTT has only ...
- 287
0
votes
1
answer
578
views
Why pg_largeobject is growing?
I've got a system (WSO2SP) which uses PostgreSQL. It stores BLOBs and uses pg_largeobject. I don't have control over how the system uses this Postgres feature. The issue is that the table ...
- 374
1
vote
1
answer
106
views
SSL issue WSO2 SP 4.4
I'm getting a ssl handshake error on wso2 SP 4.4 when trying to consume an external api (elastic search). I already imported the certificate and chains into client-truststore.jks but the error ...
- 11
0
votes
1
answer
194
views
WSO2 error when converting Text message to o Siddhi Event
I am using WSO2SP version 4.3.0 with regex extension : siddhi-execution-regex-4.1.2.jar. My code was working fine but whenever i restart my wso2sp instance i start getting error "Exception occurred ...
- 573
0
votes
1
answer
488
views
Extract json from text using SIddhi Execution Json API
I am trying to extract a valid json from text using Siddhi json Execution API. I have downloaded siddhi-execution-json-1.1.1.jar from wso2 store and following the example mentioned in the ...
- 573
1
vote
1
answer
275
views
Regex is not working properly inside WSO2 but giving proper response on java regex tester
I have a json in text format on which i am using regex to extract part of it. My regex is working fine on online java regex tester but same regex is giving me null in wso2 stream processor.
Regex : "(...
- 573
1
vote
1
answer
201
views
Convert text format to json in WSO2 stream processor/ regex for custom text mapping in WSO2SP
I have a wso2 stream processor code where i am receiving input from kafka as text format because debezium mongodb connector gives out a lengthy output and it's not a valid json to send to WSO2. So, i ...
- 573
1
vote
1
answer
134
views
How Siddhi application in WSO2 SP handles an incoming data stream during redeployment?
The topic is too big for me and I'm struggling with identifying a clear question. And I cannot find something in WSO2 Stream Processor documentation.
I've got a deployment of WSO2 SP on one machine. ...
- 374
0
votes
1
answer
100
views
WSO2 not able to receive data from Kafka Topic
I have a WSO2 Stream Processor code running where i have 6 different Kafka topics as @source and respectively 6 Mysql Database connection.
I am able to receive data in 5 topics but one, but the same ...
- 573
1
vote
1
answer
997
views
Unable to handle responses using 'regex' http status codes in Siddhi
I was trying to handle/receive all the responses with the 2xx status codes with the 'regex' http response code '2\d+' but it was not handling it as expected.When I enter the http status code directly (...
- 45
0
votes
1
answer
182
views
Keep only alphanumeric characters in string data
I'm getting string data in a stream and I would like to keep only the alphanumeric characters. I noticed that Siddhi offers a regexp function, as mentioned here. But the thing is it returns a Boolean ...
- 91
1
vote
1
answer
393
views
WSO2 stream processor, json error "contains missing attributes" with kafka
I am using kafka to get data to WSO2 stream processor in Json format, but I am getting the error "contains missing attributes.Hence dropping the message" error on every json file I send to wso2 kafka ...
- 573
0
votes
2
answers
557
views
Access H2 Embedded Database for WSO2 products
I am using stream processor 4.3.0 and need to access the H2 Database for it which comes by default in WSO2 SP application.
Can some please help me here to access/browse the database.
Thanks
- 287
0
votes
0
answers
171
views
Unable to create containers after modifying the base image of wso2sp
I'm trying to install Python in my WSO2SP containers.
This is my Dockerfile present in /alpine/base directory.
# set base docker image to adoptopenjdk alpine based docker image
FROM adoptopenjdk/...
- 91
0
votes
1
answer
83
views
WSO2 Stream Processor oauth2 authorization
I am currently using stream processor and was exploring to use oauth2 authorization while creating siddhi apps
Basically, WSO2 Identity Server can act a Identity provider for authorization for stream ...
- 287
0
votes
1
answer
437
views
WSO2 Stream Processor: unable to parse json messages
I am using stream processor 4.3.0
I have created one siddhi app which has source as mqtt and message type as json
and in sink as well I am using mqtt and message as json. Basically, there is no ...
- 287
0
votes
1
answer
82
views
Unable to access Siddhi.io for checking on the source types
I am working on stream processor 4.3.0 and I need to access Siddhi user guide for checking on the source types and syntax.
For some reason, this site is not reachable for MQTT and RabbitMQ.
https://...
- 287
0
votes
1
answer
68
views
How to upgrade siddhi jars version in w.r.t wso2sp worker container?
I am trying to change the jars inside wso2 4.4.0 worker container to the latest version instead the default one
I have tried to:
replace the jar inside the container
change the jar before building ...
0
votes
1
answer
57
views
How can I use attributes with dots and the at character?
I'm using WSO2 Stream Processor and I need to use a stream that have attributes with '.' and '@'.
There are any way to use them? For example replace that values in incoming events or something like ...
1
vote
2
answers
64
views
WSO2SP Streaming processor , load data from MongoDB
i m trying to load data from mongodb collection.
the collection contains more than 10M documents, and i cannot find any way to limit number of documents to be loaded by SP.
Apparently WsoSO load all ...
- 11