spark streaming and static DB connection -
i have spark streaming application uses db library. db library part of job runs on executors. on executor, db library creates static (singleton class/instance) connection th backend db , uses across different jobs running on executor @ different times.
i want know how long lived static db connection is? when other applications jobs run on executor, static db connection of earlier application/job deleted/removed executor?
what understand when db library gets unloaded data structures created library deleted/removed. in spark if 1 applications job using (loading) db library (that creates static connection variable) on executor, db library never unloaded after job used/loaded gets on , other applications job later runs on executor?
Comments
Post a Comment