spark streaming and static DB connection -


i have spark streaming application uses db library. db library part of job runs on executors. on executor, db library creates static (singleton class/instance) connection th backend db , uses across different jobs running on executor @ different times.

i want know how long lived static db connection is? when other applications jobs run on executor, static db connection of earlier application/job deleted/removed executor?

what understand when db library gets unloaded data structures created library deleted/removed. in spark if 1 applications job using (loading) db library (that creates static connection variable) on executor, db library never unloaded after job used/loaded gets on , other applications job later runs on executor?


Comments

Popular posts from this blog

aws api gateway - SerializationException in posting new Records via Dynamodb Proxy Service in API -

asp.net - Problems sending emails from forum -