spring-cloud-stream: Stream deployments fail on spring-cloud-dataflow-server-cf -


in our use-case need create , deploy message stream application our private cloud foundry environment. stream application meant listen on rabbitmq queue , trigger task, defined in stream.

to achieve same, using cloud-dataflow-server-cloudfoundry running locally on mac.

below set of commands used achieve it:-

  • set maven remote repo export maven_remote_repositories_repo1_url=https://ftl.abc.com/nexus

  • setup cloud foundry destination -

    export spring_cloud_deployer_cloudfoundry_url=https://api.paas.abc-intl.com/ export spring_cloud_deployer_cloudfoundry_org=paas-apps export spring_cloud_deployer_cloudfoundry_space=dev export spring_cloud_deployer_cloudfoundry_domain=paas.abc-intl.com export spring_cloud_deployer_cloudfoundry_username=abc@xyz.com export spring_cloud_deployer_cloudfoundry_password=password export spring_cloud_deployer_cloudfoundry_skip_ssl_validation=true export spring_cloud_deployer_cloudfoundry_stream_services=rabbitmq_server export spring_cloud_deployer_cloudfoundry_stream_buildpack=java_buildpack_offline export spring_cloud_deployer_cloudfoundry_stream_memory=512 export spring_cloud_deployer_cloudfoundry_task_memory=512 export spring_cloud_deployer_cloudfoundry_url=https://api.paas.abc-intl.com/ export spring_cloud_deployer_cloudfoundry_org=paas-apps export spring_cloud_deployer_cloudfoundry_space=dev export spring_cloud_deployer_cloudfoundry_domain=paas.abc-intl.com export spring_cloud_deployer_cloudfoundry_username=abc@xyz.com export spring_cloud_deployer_cloudfoundry_password=password export spring_cloud_deployer_cloudfoundry_skip_ssl_validation=true export spring_cloud_deployer_cloudfoundry_stream_services=rabbitmq_server export spring_cloud_deployer_cloudfoundry_stream_buildpack=java_buildpack_offline export spring_cloud_deployer_cloudfoundry_stream_memory=512 export spring_cloud_deployer_cloudfoundry_task_memory=512

  • start dataflow server -

    1. build dataflow server cf spring cloud properties as:

      • spring.name=dataflow
      • spring.cloud.config.uri=http://localhost:8888
      • spring.cloud.dataflow.features.tasksenabled=true
      • spring.cloud.dataflow.features.streamsenabled=true
      • spring.cloud.deployer.cloudfoundry.task.tasktimeout=360

    2. start df server cf locally - java -djavax.net.ssl.truststore=/users/apache-maven-3.3.9/conf/keystore.jks -djavax.net.ssl.truststorepassword=password -jar spring-cloud-dataflow-server-cloudfoundry-1.1.0.build-snapshot.jar

  • start df shell
  • import starter apps - stream-applications-rabbit-maven
  • register apps -
    1. app register --name task-processor --type processor --uri maven://org.springframework.cloud.stream.app:tasklaunchrequest-transform-processor-rabbit:jar:1.1.0.build-snapshot
    2. app register --name task-launcher-local --type sink --uri maven://org.springframework.cloud.stream.app:task-launcher-local-sink-rabbit:jar:1.0.4.release
  • create & deploy stream - stream create mymessagestream --definition "rabbit --rabbit.queues=cloud-stream-source --rabbit.requeue=true --spring.rabbitmq.host=host.abc.com --spring.rabbitmq.port=5672 --spring.cloud.stream.bindings.output.contenttype='text/plain' | task-processor --uri=maven://com.example:thumbnail-generator:0.0.1-snapshot | task-launcher-local" --deploy

however deployment fails timeoutexception no clear reason either in dataflow server logs or applications' logs.

the created application in cloud foundry space showing stopped on cf console.

this left me clueless , i've got couple of questions on understand possible root cause:

  1. in case of successful stream deployment, shall status of applications deployed cf stream? these show started or stopped?
  2. the name of deployed applications has couple of random words embedded in e.g. dataflow-nonvaluable-overapprehension-mymessagestream-rabbit. in understanding name given dataflow server instance , inserted make reference. there way customise name? enable me know name of applications in advance , hen run tail on logs.

any thoughts/help appreciated.

in case of successful stream deployment, shall status of applications deployed cf stream? these show started or stopped?

the stream list command display status. if stream deployment successful, status should deployed.

the name of deployed applications has couple of random words embedded in e.g. dataflow-nonvaluable-overapprehension-mymessagestream-rabbit. in understanding name given dataflow server instance , inserted make reference. there way customise name? enable me know name of applications in advance , hen run tail on logs.

you can override random name generation in app name disabling property doing: export spring_cloud_deployer_cloudfoundry_stream_enable_random_app_name_prefix=false

you can control app name using deployer property sets specific prefix:

export spring_cloud_deployer_cloudfoundry_stream_app_name_prefix=myprefix

you can try increasing deployer properties spring_cloud_deployer_cloudfoundry_stream_staging_timeout , spring_cloud_deployer_cloudfoundry_stream_startup_timeout see if app requires more time stage/startup.


Comments

Post a Comment

Popular posts from this blog

asynchronous - C# WinSCP .NET assembly: How to upload multiple files asynchronously -

i using winscp .net assembly uploading files. want upload multiple files asynchronous way. have created method works single upload. public class uploadingdata { private sessionoptions _sessionoptions; private session _session; //connection etc private void onconnected() { foreach (var fileinfo in localfileslist) { var task = task.factory.startnew(() => uploadfilesasync(fileinfo)); } } private async task uploadfilesasync(string file) { string remotefilepath = _session.translatelocalpathtoremote(file, @"/", "/test_data_upload"); var uploading = _session.putfiles(file, remotefilepath, false); //when done await task.run(() => thread.sleep(1000)); } } please suggest me correct way. thanks you can use backgroundworker class this: string[] images = new string[50]; foreach (var path in images) { backgroundworker
Read more

aws api gateway - SerializationException in posting new Records via Dynamodb Proxy Service in API -

i getting "__type": "com.amazon.coral.service#serializationexception" as reply in postman & in test console in api gateway trying post record directly dynamodb using api proxy services.. referring aws article - https://aws.amazon.com/blogs/compute/using-amazon-api-gateway-as-a-proxy-for-dynamodb/ here's mapping { "tablename": "tablenamegoeshere", "item": { "id" : "$context.requestid" "eventname" : "$input.path('$.eventname')", "timestamp" : $input.path('$.timestamp'), "answers": "$util.parsejson($input.path('$.answers'))" } } update: did asked ... , worked if try add array of json objects gives me above same error - here's trying now. please - couldnt find on google well #set($inputroot = $input.path('$')) { "tablename": "answer", "item": {
Read more

asp.net - Problems sending emails from forum -

i have been redesigning site has message board, has been written guy looked after site. it has few problems , written in .asp , uses .mdb files database. you can see whole thing here . feel free post if helps, test thing have set using original files , new database. the basic problem when posts message, supposed email sent them, have posted it. when replies, originator supposed message, replier has been posted. i’d have thought @ point in process there should script/file in postmessage.asp? the postmessage.asp page below. <% option explicit %> <!-- #include virtual="common/adovbs.inc" --> <html> <head> <meta http-equiv="content-type" content="text/html; charset=windows-1252"> <meta name="generator" content="microsoft frontpage 4.0"> <meta name="progid" content="frontpage.editor.document"> <title>new page 2</title> <base target="_self"
Read more