Updated knative backend

Developer's Certificate of Origin 1.1
   By making a contribution to this project, I certify that:

   (a) The contribution was created in whole or in part by me and I
       have the right to submit it under the Apache License 2.0; or

   (b) The contribution is based upon previous work that, to the best
       of my knowledge, is covered under an appropriate open source
       license and I have the right under that license to submit that
       work with modifications, whether created in whole or in part
       by me, under the same open source license (unless I am
       permitted to submit under a different license), as indicated
       in the file; or

   (c) The contribution was provided directly to me by some other
       person who certified (a), (b) or (c) and I have not modified
       it.

   (d) I understand and agree that this project and the contribution
       are public and that a record of the contribution (including all
       personal information I submit with it, including my sign-off) is
       maintained indefinitely and may be redistributed consistent with
       this project or the open source license(s) involved.

@JosepSampe tested include-modules and found that something wrong in cloudpickle module:
2019-09-25 14:02:13,884 [DEBUG] pywren_ibm_cloud.config: Loading configuration
2019-09-25 14:02:13,884 [DEBUG] pywren_ibm_cloud.config: Loading Compute backend module: ibm_cf
2019-09-25 14:02:13,889 [DEBUG] pywren_ibm_cloud.config: Loading Storage backend module: ibm_cos
2019-09-25 14:02:13,892 [DEBUG] pywren_ibm_cloud.executor: FunctionExecutor created with ID: 12d0-4ad0
2019-09-25 14:02:13,892 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: Creating IBM COS client
2019-09-25 14:02:13,892 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: Set IBM COS Endpoint to https://s3-api.us-geo.objectstorage.softlayer.net
2019-09-25 14:02:13,892 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: Using IBM COS API Key - Reusing Token from local cache
2019-09-25 14:02:13,962 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: IBM COS client created successfully
2019-09-25 14:02:13,962 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Creating IBM Cloud Functions client
2019-09-25 14:02:13,962 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Set IBM CF Namespace to pywren_dev_us_east
2019-09-25 14:02:13,962 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Set IBM CF Endpoint to https://us-east.functions.cloud.ibm.com
2019-09-25 14:02:13,963 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: IBM CF client created successfully
2019-09-25 14:02:13,963 [INFO] pywren_ibm_cloud.runtime.runtime: ExecutorID 12d0-4ad0 | JobID M000 - Selected Runtime: omerb01/pywren-omer-runtime:3.6.10 - 2048MB
2019-09-25 14:02:13,963 [DEBUG] pywren_ibm_cloud.storage.storage: Runtime metadata not found in local cache. Retrieving it from storage
2019-09-25 14:02:14,893 [DEBUG] pywren_ibm_cloud.runtime.runtime: ExecutorID 12d0-4ad0 | JobID M000 - Runtime omerb01/pywren-omer-runtime:3.6.10 with 2048MB is not yet installed
2019-09-25 14:02:14,893 [DEBUG] pywren_ibm_cloud.runtime.runtime: Creating runtime: omerb01/pywren-omer-runtime:3.6.10, memory: 2048
2019-09-25 14:02:14,893 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: I am about to create the package pywren_v1.0.21-SNAPSHOT
2019-09-25 14:02:15,757 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: Package pywren_v1.0.21-SNAPSHOT: resource already exists
2019-09-25 14:02:15,758 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: I am about to create a new cloud function action: omerb01_pywren-omer-runtime_3.6.10_130MB
2019-09-25 14:02:15,954 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: OK --> Created action omerb01_pywren-omer-runtime_3.6.10_130MB
2019-09-25 14:02:15,954 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Extracting Python modules list from: omerb01/pywren-omer-runtime:3.6.10
2019-09-25 14:02:18,551 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: Delete cloud function action: omerb01_pywren-omer-runtime_3.6.10_130MB
2019-09-25 14:02:19,060 [INFO] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Creating new PyWren runtime based on Docker image omerb01/pywren-omer-runtime:3.6.10
2019-09-25 14:02:19,060 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: I am about to create the package pywren_v1.0.21-SNAPSHOT
2019-09-25 14:02:19,561 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: Package pywren_v1.0.21-SNAPSHOT: resource already exists
2019-09-25 14:02:19,562 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Creating function handler zip in /Users/omerbelh/IdeaProjects/WORK/pywren-annotation-pipeline/pywren_ibmcf.zip
2019-09-25 14:02:19,591 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: I am about to create a new cloud function action: omerb01_pywren-omer-runtime_3.6.10_2048MB
2019-09-25 14:02:22,552 [DEBUG] pywren_ibm_cloud.libs.ibm_cloudfunctions.client: OK --> Created action omerb01_pywren-omer-runtime_3.6.10_2048MB
2019-09-25 14:02:22,553 [DEBUG] pywren_ibm_cloud.storage.storage: Uploading Runtime metadata to: /omergar/runtimes/1.0.21-SNAPSHOT/ibm_cf/us_east/pywren_dev_us_east/omerb01_pywren-omer-runtime_3.6.10_2048MB.meta.json
2019-09-25 14:02:23,449 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object runtimes/1.0.21-SNAPSHOT/ibm_cf/us_east/pywren_dev_us_east/omerb01_pywren-omer-runtime_3.6.10_2048MB.meta.json - Size: 7.2KiB - OK
2019-09-25 14:02:23,449 [DEBUG] pywren_ibm_cloud.storage.storage: Saving runtime metadata into local cache: /Users/omerbelh/.pywren/cache/runtimes/1.0.21-SNAPSHOT/ibm_cf/us_east/pywren_dev_us_east/omerb01_pywren-omer-runtime_3.6.10_2048MB.meta.json
2019-09-25 14:02:23,452 [DEBUG] pywren_ibm_cloud.job.job: ExecutorID 12d0-4ad0 | JobID M000 - Serializing function and data
unknown encoding for '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test/bad_coding.py': uft-8
encoding problem for '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test/bad_coding2.py': utf-8
invalid or missing encoding declaration for '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test/badsyntax_pep3120.py'
2019-09-25 14:02:35,458 [DEBUG] pywren_ibm_cloud.job.serialize: Modules to transmit: {'/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/decorator.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbconvert', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/defusedxml', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd_concurrency_analyser', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbformat', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pexpect', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd_plugins', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/Tkinter', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pandocfilters.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/entrypoints.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/bleach', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydev_console', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_core', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/testpath', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevconsole.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/colorama', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ptyprocess', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/retrying.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/plotly', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/metaspace', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prometheus_client', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jedi', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydev_ipython', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/SocketServer.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/IPython', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_client', '/Users/omerbelh/IdeaProjects/WORK/pywren-annotation-pipeline/annotation_pipeline', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pygments', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/chart_studio', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/webencodings', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/_pydev_comm', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyrsistent', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyparsing.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/elasticsearch_dsl', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipython_genutils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/notebook', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cycler.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/appnope', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/_plotly_future_', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jsonschema', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/send2trash', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prompt_toolkit', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/third_party/thriftpy/_shaded_ply', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/traitlets', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/backcall', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/s3transfer', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydev_pysrc.py', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/third_party/thriftpy/_shaded_thriftpy', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/boto3', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/seaborn', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/wcwidth', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd_file_utils.py', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/_pydev_bundle', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pickleshare.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cloudpickle', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipykernel', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pylab.py', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/terminado', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/mistune.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/_plotly_utils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipywidgets', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/parso', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/_pydev_imps', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/Queue.py'}
2019-09-25 14:02:35,459 [INFO] pywren_ibm_cloud.job.job: ExecutorID 12d0-4ad0 | JobID M000 - Uploading function and data
2019-09-25 14:02:36,251 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/12d0-4ad0/M000/aggdata.pickle - Size: 2.4KiB - OK
2019-09-25 14:05:41,799 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/12d0-4ad0/M000/func.pickle - Size: 84.3MiB - OK
2019-09-25 14:05:41,820 [INFO] pywren_ibm_cloud.invoker: ExecutorID 12d0-4ad0 | JobID M000 - Starting function invocation: generate_formulas()  - Total: 84 activations
2019-09-25 14:05:42,533 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00007 invocation done! (0.702s) - Activation ID: e3ac2d0ee3f64506ac2d0ee3f6150688
2019-09-25 14:05:42,533 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00000 invocation done! (0.712s) - Activation ID: dcc23e7c9f9c439d823e7c9f9c239d3e
2019-09-25 14:05:42,537 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00001 invocation done! (0.714s) - Activation ID: cfebf25effbf4efbabf25effbfbefba3
2019-09-25 14:05:42,539 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00004 invocation done! (0.713s) - Activation ID: f609cdca4a7140d789cdca4a71b0d75c
2019-09-25 14:05:42,539 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00002 invocation done! (0.715s) - Activation ID: b6c6017e924049e786017e924099e7ca
2019-09-25 14:05:42,539 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00012 invocation done! (0.703s) - Activation ID: 0fbf0f9a65ea4b04bf0f9a65ea8b048c
2019-09-25 14:05:42,540 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00005 invocation done! (0.713s) - Activation ID: a9083e6dc0594ca4883e6dc059fca4c7
2019-09-25 14:05:42,541 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00003 invocation done! (0.715s) - Activation ID: 0d1677a4c66e42039677a4c66e620306
2019-09-25 14:05:42,541 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00015 invocation done! (0.700s) - Activation ID: cb199b78ff2c405d999b78ff2cc05ddb
2019-09-25 14:05:42,543 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00011 invocation done! (0.707s) - Activation ID: 2653ce550a1f4b4b93ce550a1f0b4bbd
2019-09-25 14:05:42,544 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00006 invocation done! (0.715s) - Activation ID: 2b0ffa1c5cc04da68ffa1c5cc05da641
2019-09-25 14:05:42,550 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00022 invocation done! (0.701s) - Activation ID: f954add162eb43a394add162eb43a30f
2019-09-25 14:05:42,551 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00013 invocation done! (0.713s) - Activation ID: 9c2e49fdceba4bb5ae49fdcebaebb584
2019-09-25 14:05:42,552 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00024 invocation done! (0.700s) - Activation ID: 2582029cc906406582029cc9067065c8
2019-09-25 14:05:42,560 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00016 invocation done! (0.718s) - Activation ID: 2f2c11f6dd874ac2ac11f6dd87fac2e0
2019-09-25 14:05:42,561 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00027 invocation done! (0.707s) - Activation ID: bae08aba5fcf46c6a08aba5fcf16c6ad
2019-09-25 14:05:42,561 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00010 invocation done! (0.727s) - Activation ID: 7f9368b9ace94f019368b9ace96f01bf
2019-09-25 14:05:42,564 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00021 invocation done! (0.716s) - Activation ID: e2d7e1dab0b64bce97e1dab0b60bce56
2019-09-25 14:05:42,564 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00023 invocation done! (0.714s) - Activation ID: 3c15b3d31a8445de95b3d31a8445de2f
2019-09-25 14:05:42,572 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00019 invocation done! (0.726s) - Activation ID: 55e87c2e91cb441ba87c2e91cb241bc0
2019-09-25 14:05:42,583 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00009 invocation done! (0.751s) - Activation ID: 91d9f6ec1f094cf899f6ec1f095cf899
2019-09-25 14:05:42,584 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00014 invocation done! (0.745s) - Activation ID: cd358782294c4b87b58782294cdb877d
2019-09-25 14:05:42,595 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00017 invocation done! (0.752s) - Activation ID: 600b9cb2f53247078b9cb2f53227076e
2019-09-25 14:05:42,595 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00028 invocation done! (0.740s) - Activation ID: 0b0c05ad53c84b5e8c05ad53c88b5ecf
2019-09-25 14:05:42,599 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00018 invocation done! (0.755s) - Activation ID: 0fc211501b1b41858211501b1bc18525
2019-09-25 14:05:42,605 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00025 invocation done! (0.752s) - Activation ID: a2cbe9585d7844ba8be9585d78e4ba82
2019-09-25 14:05:42,611 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00026 invocation done! (0.757s) - Activation ID: 82684da31f6a4baaa84da31f6a0baa77
2019-09-25 14:05:42,617 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00029 invocation done! (0.760s) - Activation ID: 04adbc479bd24c93adbc479bd20c935f
2019-09-25 14:05:42,617 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00020 invocation done! (0.771s) - Activation ID: a7960abcf8fe4853960abcf8fe5853e3
2019-09-25 14:05:42,625 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00041 invocation done! (0.756s) - Activation ID: a357a915a269442597a915a269542560
2019-09-25 14:05:42,627 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00008 invocation done! (0.795s) - Activation ID: c4b2e6f22bb94dd5b2e6f22bb92dd5a2
2019-09-25 14:05:42,631 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00047 invocation done! (0.755s) - Activation ID: 263d0b8d21ff48b9bd0b8d21ff78b944
2019-09-25 14:05:42,634 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00038 invocation done! (0.768s) - Activation ID: b9ea756b9daf4bf8aa756b9daffbf82f
2019-09-25 14:05:42,645 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00044 invocation done! (0.773s) - Activation ID: e7a74cdd885d4439a74cdd885dc439dc
2019-09-25 14:05:42,646 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00031 invocation done! (0.787s) - Activation ID: fab578678f5d4cd6b578678f5d0cd66f
2019-09-25 14:05:42,646 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00042 invocation done! (0.776s) - Activation ID: b29b592d8c534ec59b592d8c533ec528
2019-09-25 14:05:42,654 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00040 invocation done! (0.786s) - Activation ID: 3f59be2a62fd4ec899be2a62fd7ec867
2019-09-25 14:05:42,661 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00030 invocation done! (0.804s) - Activation ID: d2a70690f525417da70690f525b17d3f
2019-09-25 14:05:42,667 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00054 invocation done! (0.784s) - Activation ID: f651e689084b4dac91e689084badac77
2019-09-25 14:05:42,676 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00046 invocation done! (0.802s) - Activation ID: 691809c9203c43f79809c9203cf3f746
2019-09-25 14:05:42,702 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00049 invocation done! (0.824s) - Activation ID: c577c259657743aab7c259657773aa80
2019-09-25 14:05:42,703 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00068 invocation done! (0.805s) - Activation ID: a3048a5f14574484848a5f14574484e8
2019-09-25 14:05:42,708 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00056 invocation done! (0.823s) - Activation ID: 01abac743ff74d14abac743ff7cd148b
2019-09-25 14:05:42,714 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00073 invocation done! (0.809s) - Activation ID: 388656c04c3d4e0f8656c04c3d4e0f82
2019-09-25 14:05:42,717 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00066 invocation done! (0.821s) - Activation ID: 706bca0a8e7e4447abca0a8e7ee4472a
2019-09-25 14:05:42,717 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00059 invocation done! (0.829s) - Activation ID: 64af0048fdec475caf0048fdece75c02
2019-09-25 14:05:42,721 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00074 invocation done! (0.814s) - Activation ID: 73108e2932a04714908e2932a0e71447
2019-09-25 14:05:42,727 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00048 invocation done! (0.850s) - Activation ID: 79b36e36c34c43f9b36e36c34c13f9b8
2019-09-25 14:05:42,731 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00045 invocation done! (0.858s) - Activation ID: c4b17cdffd2e4c57b17cdffd2ecc5766
2019-09-25 14:05:42,732 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00077 invocation done! (0.822s) - Activation ID: 1020c275072f4f04a0c275072faf04e9
2019-09-25 14:05:42,735 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00081 invocation done! (0.820s) - Activation ID: bcae1cefe0e9447aae1cefe0e9447adf
2019-09-25 14:05:42,742 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00055 invocation done! (0.858s) - Activation ID: 03c27309730b4859827309730b585966
2019-09-25 14:05:42,743 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00067 invocation done! (0.846s) - Activation ID: c94bb523089742ca8bb523089742cacc
2019-09-25 14:05:42,754 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00033 invocation done! (0.893s) - Activation ID: ed99ff90a4384af599ff90a4388af5d5
2019-09-25 14:05:42,755 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00034 invocation done! (0.893s) - Activation ID: 532f361d39e44fb1af361d39e45fb1a5
2019-09-25 14:05:42,760 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00039 invocation done! (0.893s) - Activation ID: 37595aa5bf54433b995aa5bf54733b11
2019-09-25 14:05:42,773 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00036 invocation done! (0.909s) - Activation ID: 5d3454c11a154edfb454c11a150edf30
2019-09-25 14:05:42,791 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00060 invocation done! (0.902s) - Activation ID: eb434c6aded1447d834c6aded1247db5
2019-09-25 14:05:42,792 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00058 invocation done! (0.905s) - Activation ID: c984f70738e04bf384f70738e07bf377
2019-09-25 14:05:42,793 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00069 invocation done! (0.893s) - Activation ID: b34be71bd25c4a258be71bd25cba2587
2019-09-25 14:05:42,798 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00062 invocation done! (0.906s) - Activation ID: 8c742e68067c4962b42e68067cf96220
2019-09-25 14:05:42,811 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00065 invocation done! (0.916s) - Activation ID: 1965a87ae0c34b25a5a87ae0c30b25e9
2019-09-25 14:05:42,851 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00032 invocation done! (0.991s) - Activation ID: cda73f2b57594d03a73f2b57592d0304
2019-09-25 14:05:42,858 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00052 invocation done! (0.977s) - Activation ID: 9b1f70ab7d1049db9f70ab7d1079dbb4
2019-09-25 14:05:42,861 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00037 invocation done! (0.996s) - Activation ID: f0ce4878840a410a8e4878840a010ae5
2019-09-25 14:05:42,867 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00035 invocation done! (1.005s) - Activation ID: ef1ec9c145c8461a9ec9c145c8061ad6
2019-09-25 14:05:42,868 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00064 invocation done! (0.974s) - Activation ID: eb4cf5edacc146d98cf5edacc1c6d9f9
2019-09-25 14:05:42,878 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00063 invocation done! (0.985s) - Activation ID:<PHONE_NUMBER>864492a360780886b492e1
2019-09-25 14:05:42,880 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00053 invocation done! (0.998s) - Activation ID: 0e487811579f4ce2887811579fcce2bf
2019-09-25 14:05:42,882 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00043 invocation done! (1.011s) - Activation ID: b5e3f62d96d04b3ea3f62d96d02b3e54
2019-09-25 14:05:42,896 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00050 invocation done! (1.017s) - Activation ID: 7399f106a772486899f106a772086863
2019-09-25 14:05:42,908 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00072 invocation done! (1.005s) - Activation ID: 39416d94f7354278816d94f7356278af
2019-09-25 14:05:42,916 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00051 invocation done! (1.036s) - Activation ID: 562ef1a66f4e4243aef1a66f4ef24347
2019-09-25 14:05:42,921 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00082 invocation done! (1.004s) - Activation ID: d90e942fac4843cb8e942fac48b3cbd7
2019-09-25 14:05:42,921 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00071 invocation done! (1.020s) - Activation ID: b1d79229740148c79792297401f8c76b
2019-09-25 14:05:42,949 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00083 invocation done! (1.031s) - Activation ID: b122c2accdaa473fa2c2accdaa773f33
2019-09-25 14:05:42,966 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00057 invocation done! (1.080s) - Activation ID: f8d360abd1014fa49360abd101afa407
2019-09-25 14:05:42,996 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00075 invocation done! (1.088s) - Activation ID: 1eb37d0611714260b37d061171226075
2019-09-25 14:05:43,005 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00070 invocation done! (1.105s) - Activation ID: 4cbe599ad37b4c6abe599ad37b3c6a0b
2019-09-25 14:05:43,008 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00076 invocation done! (1.099s) - Activation ID: cbc53520836547428535208365d7427b
2019-09-25 14:05:43,017 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00078 invocation done! (1.106s) - Activation ID: 42cf7700ed2946e38f7700ed2986e343
2019-09-25 14:05:43,026 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00080 invocation done! (1.113s) - Activation ID: d9944ae8b42b4a12944ae8b42bca121f
2019-09-25 14:05:43,028 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00079 invocation done! (1.115s) - Activation ID: a3a3e532d2c442b9a3e532d2c4d2b9c4
2019-09-25 14:05:43,029 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID 12d0-4ad0 | JobID M000 - Function 00061 invocation done! (1.138s) - Activation ID: bc51a0b770bb44a891a0b770bb04a86c
2019-09-25 14:05:43,031 [INFO] pywren_ibm_cloud.executor: ExecutorID 12d0-4ad0 - Getting results...
2019-09-25 14:05:50,872 [INFO] pywren_ibm_cloud.executor: ExecutorID 12d0-4ad0 | JobID M000 - There was an exception - Activation ID: cfebf25effbf4efbabf25effbfbefba3

Traceback (most recent call last):
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 236, in run
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 134, in _unpickle_function
  File "/action/pywren_ibm_cloud/libs/cloudpickle/cloudpickle.py", line 1147, in subimport
ModuleNotFoundError: No module named '_pydevd_bundle'
2019-09-25 14:05:50,872 [INFO] pywren_ibm_cloud.executor: ExecutorID 12d0-4ad0 - Cleaning temporary data

its code is a bit complicated, tell me if you need anything.
good to mention that the current implementation serialises 20mb more (84mb in total)

@JosepSampe Moreover, found that if I use include_modules=['annotation_pipeline'] I get any related modules in addition to the package itself - in this case, I would like to serialise only annotation pipeline package instead of all modules together which actually are not in any use (in my case it is 67 redundant mb in estimate)

@omerb01 From where are you running it? console? notebook? eclipse?

@JosepSampe console

@omerb01 Is intellij console adding more packages?

@JosepSampe @omerb01 resolved? Can i merge it? @omerb01 can you run your tests from CLI and see if they pass without issues?

@gilv It passes all tests. However, I'm working to fix this last issue. I will send you an email once I have it ready

@JosepSampe still experience an exception:
if I don't use include_modules param:
2019-09-27 09:46:49,747 [DEBUG] pywren_ibm_cloud.job.job: ExecutorID a232-4526 | JobID M000 - Serializing function and data
unknown encoding for '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test/bad_coding.py': uft-8
encoding problem for '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test/bad_coding2.py': utf-8
invalid or missing encoding declaration for '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test/badsyntax_pep3120.py'
2019-09-27 09:47:05,612 [DEBUG] pywren_ibm_cloud.job.serialize: Modules to transmit: {'/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/third_party/thriftpy/_shaded_ply', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyrsistent', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydev_pysrc.py', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevconsole.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyparsing.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/traitlets', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/_pydev_bundle', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pandocfilters.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jedi', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/metaspace', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/SocketServer.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipython_genutils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbformat', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/send2trash', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prompt_toolkit', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/Queue.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pylab.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/boto3', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/test', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/plotly', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipykernel', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/appnope', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/Tkinter', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/terminado', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydev_console', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd_concurrency_analyser', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/mistune.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/colorama', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cloudpickle', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/_plotly_utils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prometheus_client', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/decorator.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/seaborn', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pickleshare.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/entrypoints.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/wcwidth', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipywidgets', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pexpect', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/_pydev_comm', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_core', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd_plugins', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ptyprocess', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/testpath', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_client', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/backcall', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jsonschema', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/s3transfer', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pygments', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/parso', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/webencodings', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/_pydev_imps', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/notebook', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/defusedxml', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydevd_file_utils.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/bleach', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/third_party/thriftpy/_shaded_thriftpy', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbconvert', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/IPython', '/Users/omerbelh/IdeaProjects/WORK/pywren-annotation-pipeline/annotation_pipeline', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/_plotly_future_', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/retrying.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/chart_studio', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/elasticsearch_dsl', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cycler.py', '/Users/omerbelh/Library/Application Support/IdeaIC2019.1/python-ce/helpers/pydev/pydev_ipython'}
2019-09-27 09:47:05,612 [INFO] pywren_ibm_cloud.job.job: ExecutorID a232-4526 | JobID M000 - Uploading function and data
2019-09-27 09:47:06,476 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/a232-4526/M000/aggdata.pickle - Size: 2.4KiB - OK
2019-09-27 09:49:30,764 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/a232-4526/M000/func.pickle - Size: 84.3MiB - OK

and get:
Traceback (most recent call last):
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 236, in run
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 134, in _unpickle_function
  File "/action/pywren_ibm_cloud/libs/cloudpickle/cloudpickle.py", line 1147, in subimport
ModuleNotFoundError: No module named '_pydevd_bundle'

if I use include_modules=['annotation_pipeline']:
2019-09-27 09:52:59,737 [DEBUG] pywren_ibm_cloud.job.job: ExecutorID 3d28-4d6b | JobID M000 - Serializing function and data
2019-09-27 09:53:07,655 [DEBUG] pywren_ibm_cloud.job.serialize: Modules to transmit: {'/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/webencodings', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/plotly', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cycler.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipykernel', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pickleshare.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/traitlets', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pexpect', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pylab.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_core', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/SocketServer.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pandocfilters.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/_plotly_future_', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/appnope', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/parso', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/entrypoints.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prometheus_client', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipywidgets', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jsonschema', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/retrying.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prompt_toolkit', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cloudpickle', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/decorator.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/s3transfer', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/send2trash', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/testpath', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/defusedxml', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/bleach', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/_plotly_utils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pygments', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/colorama', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/wcwidth', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/IPython', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ptyprocess', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/mistune.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jedi', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/elasticsearch_dsl', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/metaspace', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/seaborn', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/backcall', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyrsistent', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/chart_studio', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyparsing.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipython_genutils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/terminado', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/boto3', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbconvert', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_client', '/Users/omerbelh/IdeaProjects/WORK/pywren-annotation-pipeline/annotation_pipeline', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/notebook', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbformat'}
2019-09-27 09:53:07,655 [INFO] pywren_ibm_cloud.job.job: ExecutorID 3d28-4d6b | JobID M000 - Uploading function and data
2019-09-27 09:53:08,810 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/3d28-4d6b/M000/aggdata.pickle - Size: 2.4KiB - OK
2019-09-27 09:56:48,514 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/3d28-4d6b/M000/func.pickle - Size: 67.3MiB - OK

and get:
Traceback (most recent call last):
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 236, in run
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 134, in _unpickle_function
  File "/action/pywren_ibm_cloud/libs/cloudpickle/cloudpickle.py", line 1147, in subimport
ModuleNotFoundError: No module named '_pydevd_bundle'

@JosepSampe back to your question about INTELIJ, different modules are serialised as you suspected, but still get an exception with or without include_modules:
2019-09-27 10:04:50,996 [DEBUG] pywren_ibm_cloud.config: Loading configuration
2019-09-27 10:04:50,997 [DEBUG] pywren_ibm_cloud.config: Loading Compute backend module: ibm_cf
2019-09-27 10:04:50,999 [DEBUG] pywren_ibm_cloud.config: Loading Storage backend module: ibm_cos
2019-09-27 10:04:51,000 [DEBUG] pywren_ibm_cloud.executor: FunctionExecutor created with ID: e968-4987
2019-09-27 10:04:51,000 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: Creating IBM COS client
2019-09-27 10:04:51,000 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: Set IBM COS Endpoint to https://s3-api.us-geo.objectstorage.softlayer.net
2019-09-27 10:04:51,000 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: Using IBM COS API Key - Reusing Token from local cache
2019-09-27 10:04:51,024 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: IBM COS client created successfully
2019-09-27 10:04:51,024 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Creating IBM Cloud Functions client
2019-09-27 10:04:51,024 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Set IBM CF Namespace to pywren_dev_us_east
2019-09-27 10:04:51,024 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: Set IBM CF Endpoint to https://us-east.functions.cloud.ibm.com
2019-09-27 10:04:51,024 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: IBM CF client created successfully
2019-09-27 10:04:51,024 [INFO] pywren_ibm_cloud.runtime.runtime: ExecutorID e968-4987 | JobID M000 - Selected Runtime: omerb01/pywren-omer-runtime:3.6.10 - 2048MB
2019-09-27 10:04:51,024 [DEBUG] pywren_ibm_cloud.storage.storage: Runtime metadata found in local cache
2019-09-27 10:04:51,025 [DEBUG] pywren_ibm_cloud.job.job: ExecutorID e968-4987 | JobID M000 - Serializing function and data
2019-09-27 10:04:53,629 [DEBUG] pywren_ibm_cloud.job.serialize: Modules to transmit: {'/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/entrypoints.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pexpect', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_core', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbconvert', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/webencodings', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/wcwidth', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pandocfilters.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/SocketServer.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyrsistent', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pyparsing.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/backcall', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/bleach', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/terminado', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pygments', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/nbformat', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ptyprocess', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jupyter_client', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipykernel', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/traitlets', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/appnope', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/decorator.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/pickleshare.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/testpath', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/mistune.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prompt_toolkit', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/notebook', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/colorama', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/send2trash', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/parso', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cycler.py', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/defusedxml', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jsonschema', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/IPython', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/ipython_genutils', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/prometheus_client', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/cloudpickle', '/Users/omerbelh/.pyenv/versions/3.6.0/lib/python3.6/site-packages/jedi'}
2019-09-27 10:04:53,629 [INFO] pywren_ibm_cloud.job.job: ExecutorID e968-4987 | JobID M000 - Uploading function and data
2019-09-27 10:04:54,742 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/e968-4987/M000/aggdata.pickle - Size: 2.4KiB - OK
2019-09-27 10:05:28,423 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/e968-4987/M000/func.pickle - Size: 14.8MiB - OK
2019-09-27 10:05:28,428 [INFO] pywren_ibm_cloud.invoker: ExecutorID e968-4987 | JobID M000 - Starting function invocation: generate_formulas()  - Total: 84 activations
2019-09-27 10:05:29,162 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00000 invocation done! (0.734s) - Activation ID: db67b5a060ff44f8a7b5a060ffb4f87f
2019-09-27 10:05:29,184 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00038 invocation done! (0.739s) - Activation ID: 6c354b3ba9464bbeb54b3ba9468bbe89
2019-09-27 10:05:29,195 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00012 invocation done! (0.760s) - Activation ID: 9630dcee9aed4545b0dcee9aed55453e
2019-09-27 10:05:29,196 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00013 invocation done! (0.761s) - Activation ID: e57e0c5add0944b3be0c5add0944b31e
2019-09-27 10:05:29,199 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00004 invocation done! (0.768s) - Activation ID: aad06a5770d943af906a5770d9d3af68
2019-09-27 10:05:29,199 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00021 invocation done! (0.761s) - Activation ID: 25b63029075240cab63029075220ca93
2019-09-27 10:05:29,200 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00029 invocation done! (0.758s) - Activation ID: 817d93acc02d4217bd93acc02d52175e
2019-09-27 10:05:29,202 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00010 invocation done! (0.768s) - Activation ID: f587dcf62af045ec87dcf62af0c5ec0e
2019-09-27 10:05:29,204 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00011 invocation done! (0.769s) - Activation ID: a9d2b5bc403d4d4792b5bc403d6d474c
2019-09-27 10:05:29,204 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00025 invocation done! (0.764s) - Activation ID: 4c75b418a6d0401db5b418a6d0901ddc
2019-09-27 10:05:29,206 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00015 invocation done! (0.769s) - Activation ID: ed67d994a39f4b78a7d994a39f2b785e
2019-09-27 10:05:29,206 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00006 invocation done! (0.774s) - Activation ID: c6ded1ae32e04c8d9ed1ae32e0fc8d5a
2019-09-27 10:05:29,210 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00028 invocation done! (0.768s) - Activation ID: 297fa940fa6e4aa8bfa940fa6efaa80a
2019-09-27 10:05:29,210 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00036 invocation done! (0.765s) - Activation ID: 2875fea3c4eb47b9b5fea3c4ebe7b90d
2019-09-27 10:05:29,218 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00065 invocation done! (0.761s) - Activation ID: 576f9395ed62441caf9395ed62e41ca7
2019-09-27 10:05:29,225 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00019 invocation done! (0.787s) - Activation ID: 1486fbdb55354a3e86fbdb5535da3e8a
2019-09-27 10:05:29,228 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00040 invocation done! (0.781s) - Activation ID: 9783bbd6ef7a46fe83bbd6ef7a26fe88
2019-09-27 10:05:29,228 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00044 invocation done! (0.780s) - Activation ID: c9157396faec4fe9957396faec5fe99a
2019-09-27 10:05:29,233 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00017 invocation done! (0.796s) - Activation ID: 15a2663679e14d5ba2663679e17d5bff
2019-09-27 10:05:29,234 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00002 invocation done! (0.805s) - Activation ID: 5e2a84a65c424d17aa84a65c42ed17e6
2019-09-27 10:05:29,235 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00042 invocation done! (0.788s) - Activation ID: 139b2a7fdb8c448c9b2a7fdb8c348cf1
2019-09-27 10:05:29,240 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00022 invocation done! (0.800s) - Activation ID: 315b64e7077d4c539b64e7077d0c53cb
2019-09-27 10:05:29,241 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00023 invocation done! (0.801s) - Activation ID: bb013d768e0b4ffa813d768e0b8ffab8
2019-09-27 10:05:29,241 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00001 invocation done! (0.812s) - Activation ID: cf6fdf56bab940a3afdf56bab960a388
2019-09-27 10:05:29,244 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00007 invocation done! (0.811s) - Activation ID: 7b4abd34a66b49bc8abd34a66b49bc45
2019-09-27 10:05:29,244 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00061 invocation done! (0.789s) - Activation ID: b0c5183255a7466d85183255a7166db0
2019-09-27 10:05:29,250 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00067 invocation done! (0.793s) - Activation ID: 94256f734b064eb8a56f734b061eb8f1
2019-09-27 10:05:29,255 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00008 invocation done! (0.822s) - Activation ID: 2c71c616a5544f0cb1c616a5545f0c2e
2019-09-27 10:05:29,256 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00018 invocation done! (0.818s) - Activation ID: 19b35c772e70495fb35c772e70e95f6c
2019-09-27 10:05:29,256 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00005 invocation done! (0.824s) - Activation ID: b7a59b75a3d74924a59b75a3d7092489
2019-09-27 10:05:29,264 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00003 invocation done! (0.834s) - Activation ID: 9a7876f5babf4c15b876f5babf9c157d
2019-09-27 10:05:29,264 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00035 invocation done! (0.820s) - Activation ID: 56d6712827dc4b0a96712827dc9b0ab7
2019-09-27 10:05:29,265 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00014 invocation done! (0.829s) - Activation ID: 835f2cf3a11146bb9f2cf3a11126bbac
2019-09-27 10:05:29,265 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00030 invocation done! (0.823s) - Activation ID: f6084376c47a4432884376c47a4432bf
2019-09-27 10:05:29,267 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00033 invocation done! (0.824s) - Activation ID: 9b6b3bd3d4e74e18ab3bd3d4e75e186b
2019-09-27 10:05:29,268 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00027 invocation done! (0.826s) - Activation ID: 334ae57022b346d18ae57022b306d12c
2019-09-27 10:05:29,270 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00063 invocation done! (0.814s) - Activation ID: d3f8b6600cf540c4b8b6600cf5e0c4c5
2019-09-27 10:05:29,270 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00016 invocation done! (0.834s) - Activation ID: 9e202411bc4843e1a02411bc4803e17f
2019-09-27 10:05:29,271 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00009 invocation done! (0.837s) - Activation ID: dd2c563a083f4676ac563a083f567635
2019-09-27 10:05:29,278 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00020 invocation done! (0.840s) - Activation ID: 6bec00fe26be4782ac00fe26be778256
2019-09-27 10:05:29,289 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00083 invocation done! (0.824s) - Activation ID: f58f820f41d34d3b8f820f41d3fd3b19
2019-09-27 10:05:29,297 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00081 invocation done! (0.833s) - Activation ID: 742de2e4538b4683ade2e4538be683e7
2019-09-27 10:05:29,311 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00076 invocation done! (0.850s) - Activation ID: ff2fd32190f54f9fafd32190f56f9f3e
2019-09-27 10:05:29,327 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00074 invocation done! (0.867s) - Activation ID: 55b7f7cb5e784a43b7f7cb5e78ba4384
2019-09-27 10:05:29,332 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00053 invocation done! (0.880s) - Activation ID: 92a2d061c5bd400fa2d061c5bde00f79
2019-09-27 10:05:29,335 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00071 invocation done! (0.875s) - Activation ID: 5ae4fa3959814a5fa4fa395981ea5f63
2019-09-27 10:05:29,340 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00026 invocation done! (0.899s) - Activation ID: c9541b2bda4941ad941b2bda4921ad64
2019-09-27 10:05:29,363 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00054 invocation done! (0.910s) - Activation ID: e80fc617530a40a88fc617530ad0a82f
2019-09-27 10:05:29,409 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00045 invocation done! (0.960s) - Activation ID: df01bbb371fd47ac81bbb371fd57ace1
2019-09-27 10:05:29,415 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00075 invocation done! (0.954s) - Activation ID: 738b324861454d538b324861459d5371
2019-09-27 10:05:29,419 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00043 invocation done! (0.971s) - Activation ID: a997f8afa87242bc97f8afa87282bc21
2019-09-27 10:05:29,425 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00077 invocation done! (0.963s) - Activation ID: 0e50ab7c137f445f90ab7c137f945f90
2019-09-27 10:05:29,457 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00070 invocation done! (0.998s) - Activation ID: 4e881b7b1f6f4a3f881b7b1f6f2a3fee
2019-09-27 10:05:29,488 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00072 invocation done! (1.028s) - Activation ID: 6a1680bb9659443a9680bb9659443a69
2019-09-27 10:05:29,495 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00079 invocation done! (1.032s) - Activation ID: 9c8868cff21549418868cff215594180
2019-09-27 10:05:29,495 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00058 invocation done! (1.042s) - Activation ID: b61348785f8641e59348785f8641e574
2019-09-27 10:05:29,502 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00080 invocation done! (1.039s) - Activation ID: a8ea1cd5008b4d90aa1cd5008bdd9027
2019-09-27 10:05:29,508 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00059 invocation done! (1.054s) - Activation ID: 28a892dd13954b99a892dd13953b998b
2019-09-27 10:05:29,511 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00064 invocation done! (1.055s) - Activation ID: d7d15b3b70d945f2915b3b70d975f20a
2019-09-27 10:05:29,512 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00060 invocation done! (1.058s) - Activation ID: ad9610175dbf43fa9610175dbf33fa9b
2019-09-27 10:05:29,515 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00050 invocation done! (1.064s) - Activation ID: 833e9cf90aa54788be9cf90aa54788f0
2019-09-27 10:05:29,520 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00057 invocation done! (1.067s) - Activation ID: 08e14b7f553b4531a14b7f553bf53125
2019-09-27 10:05:29,526 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00024 invocation done! (1.086s) - Activation ID: 5809a1b46be7417f89a1b46be7d17fd2
2019-09-27 10:05:29,526 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00052 invocation done! (1.075s) - Activation ID: d0b8575e0b124467b8575e0b12d46796
2019-09-27 10:05:29,527 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00048 invocation done! (1.077s) - Activation ID: b493b55fe7de47a593b55fe7dec7a59c
2019-09-27 10:05:29,528 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00039 invocation done! (1.082s) - Activation ID: bff61328958a4c70b61328958a8c700b
2019-09-27 10:05:29,532 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00051 invocation done! (1.081s) - Activation ID: e25dc12a821b46ba9dc12a821bb6bae6
2019-09-27 10:05:29,533 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00034 invocation done! (1.089s) - Activation ID: bfef0398232542a7af0398232592a7de
2019-09-27 10:05:29,534 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00047 invocation done! (1.085s) - Activation ID: 6f9205eb831445d09205eb831475d0e2
2019-09-27 10:05:29,534 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00049 invocation done! (1.084s) - Activation ID: fc21dbf99b134bafa1dbf99b132bafe3
2019-09-27 10:05:29,535 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00032 invocation done! (1.091s) - Activation ID: 67700f04d384423cb00f04d384c23c3c
2019-09-27 10:05:29,536 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00082 invocation done! (1.072s) - Activation ID: e207483e45cc43af87483e45ccb3af21
2019-09-27 10:05:29,538 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00041 invocation done! (1.091s) - Activation ID: ebe9f0c0ace94a6aa9f0c0ace97a6af9
2019-09-27 10:05:29,540 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00069 invocation done! (1.082s) - Activation ID: dd7044a10cd6439cb044a10cd6e39c4a
2019-09-27 10:05:29,541 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00068 invocation done! (1.083s) - Activation ID: 57f66399cec7431bb66399cec7831b15
2019-09-27 10:05:29,543 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00078 invocation done! (1.081s) - Activation ID: 0bffabbb770844dbbfabbb7708a4dbbf
2019-09-27 10:05:29,551 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00055 invocation done! (1.099s) - Activation ID: 359eb8cd5dcf4ec19eb8cd5dcf9ec170
2019-09-27 10:05:29,556 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00037 invocation done! (1.111s) - Activation ID: d0e795fd5fc24caaa795fd5fc21caa3b
2019-09-27 10:05:29,557 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00046 invocation done! (1.108s) - Activation ID: fdcad53ff1544d4b8ad53ff1545d4b5c
2019-09-27 10:05:29,557 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00031 invocation done! (1.115s) - Activation ID: c75661fc496a4d9c9661fc496afd9c9b
2019-09-27 10:05:29,559 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00056 invocation done! (1.106s) - Activation ID: 0f08431d6359462288431d635936227e
2019-09-27 10:05:29,567 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00073 invocation done! (1.107s) - Activation ID: c56c8c002b094e9fac8c002b091e9f2a
2019-09-27 10:05:29,581 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00062 invocation done! (1.126s) - Activation ID: 689b454a8cb648c99b454a8cb6b8c998
2019-09-27 10:05:29,710 [DEBUG] pywren_ibm_cloud.compute.backends.ibm_cf.ibm_cf: ExecutorID e968-4987 | JobID M000 - Function 00066 invocation done! (1.253s) - Activation ID: dc952e91d9174196952e91d917a19649
2019-09-27 10:05:29,711 [INFO] pywren_ibm_cloud.executor: ExecutorID e968-4987 - Getting results...
2019-09-27 10:05:31,512 [INFO] pywren_ibm_cloud.executor: ExecutorID e968-4987 | JobID M000 - There was an exception - Activation ID: 9a7876f5babf4c15b876f5babf9c157d

Traceback (most recent call last):
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 236, in run
  File "/action/pywren_ibm_cloud/runtime/function_handler/jobrunner.py", line 134, in _unpickle_function
ModuleNotFoundError: No module named 'annotation_pipeline'
2019-09-27 10:05:31,513 [INFO] pywren_ibm_cloud.executor: ExecutorID e968-4987 - Cleaning temporary data

@omerb01 Ensure you updated to new code because I added some new debug lines in serializer that doesn't appear in your logs ;)

@omerb01 For example, you should see:
2019-09-26 15:54:04,883 [DEBUG] pywren_ibm_cloud.job.job: ExecutorID 0518-4099 | JobID M000 - Serializing function and data
2019-09-26 15:54:07,136 [DEBUG] pywren_ibm_cloud.job.serialize: Referenced modules: {'/usr/lib/python3.6/concurrent/futures/__init__.py', '/home/josep/data/eclipse-workspace/pywren-ibm-cloud/pywren_ibm_cloud/utils.py', '/usr/lib/python3.6/concurrent/__init__.py', '/usr/local/lib/python3.6/dist-packages/colorama/ansi.py', '/home/josep/data/eclipse-workspace/pywren-annotation-pipeline/annotation_pipeline/fdr.py'}
2019-09-26 15:54:07,136 [DEBUG] pywren_ibm_cloud.job.serialize: Tentative modules to transmit: {'/usr/local/lib/python3.6/dist-packages/colorama', '/usr/local/lib/python3.6/dist-packages/pyrsistent', '/usr/local/lib/python3.6/dist-packages/prompt_toolkit', '/usr/local/lib/python3.6/dist-packages/pyparsing-2.3.1-py3.6.egg/pyparsing.py', '/usr/local/lib/python3.6/dist-packages/uritemplate', '/usr/local/lib/python3.6/dist-packages/defusedxml', '/usr/local/lib/python3.6/dist-packages/IPython', '/usr/local/lib/python3.6/dist-packages/cloudpickle', '/usr/lib/python3/dist-packages/pexpect', '/usr/local/lib/python3.6/dist-packages/bleach', '/usr/local/lib/python3.6/dist-packages/testpath', '/usr/local/lib/python3.6/dist-packages/webencodings', '/usr/local/lib/python3.6/dist-packages/jupyter_client', '/usr/local/lib/python3.6/dist-packages/decorator.py', '/usr/local/lib/python3.6/dist-packages/nbformat', '/usr/local/lib/python3.6/dist-packages/send2trash', '/usr/local/lib/python3.6/dist-packages/jedi', '/usr/local/lib/python3.6/dist-packages/ipykernel', '/usr/local/lib/python3.6/dist-packages/jupyter_core', '/usr/local/lib/python3.6/dist-packages/pickleshare.py', '/usr/local/lib/python3.6/dist-packages/matplotlib-3.0.3-py3.6-linux-x86_64.egg/mpl_toolkits', '/usr/local/lib/python3.6/dist-packages/nbconvert', '/usr/local/lib/python3.6/dist-packages/jsonschema', '/usr/local/lib/python3.6/dist-packages/prometheus_client', '/usr/local/lib/python3.6/dist-packages/mistune.py', '/usr/local/lib/python3.6/dist-packages/wcwidth', '/usr/local/lib/python3.6/dist-packages/pygments', '/usr/local/lib/python3.6/dist-packages/traitlets', '/usr/local/lib/python3.6/dist-packages/entrypoints.py', '/usr/local/lib/python3.6/dist-packages/ptyprocess', '/usr/local/lib/python3.6/dist-packages/notebook', '/usr/local/lib/python3.6/dist-packages/pandocfilters.py', '/home/josep/data/eclipse-workspace/pywren-annotation-pipeline/annotation_pipeline', '/usr/local/lib/python3.6/dist-packages/ipython_genutils', '/usr/local/lib/python3.6/dist-packages/cycler-0.10.0-py3.6.egg/cycler.py', '/usr/local/lib/python3.6/dist-packages/parso', '/usr/local/lib/python3.6/dist-packages/backcall', '/usr/local/lib/python3.6/dist-packages/terminado'}
2019-09-26 15:54:07,136 [DEBUG] pywren_ibm_cloud.job.serialize: Filtering modules: ['annotation_pipeline', 'colorama']
2019-09-26 15:54:07,136 [DEBUG] pywren_ibm_cloud.job.serialize: Modules to transmit: {'/usr/local/lib/python3.6/dist-packages/colorama', '/home/josep/data/eclipse-workspace/pywren-annotation-pipeline/annotation_pipeline'}
2019-09-26 15:54:07,136 [INFO] pywren_ibm_cloud.job.job: ExecutorID 0518-4099 | JobID M000 - Uploading function and data
2019-09-26 15:54:07,837 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/0518-4099/M000/aggdata.pickle - Size: 21.0B - OK
2019-09-26 15:54:08,605 [DEBUG] pywren_ibm_cloud.storage.backends.ibm_cos.ibm_cos: PUT Object pywren.jobs/0518-4099/M000/func.pickle - Size: 113.9KiB - OK

@JosepSampe Great :) tested it a bit and it works well, thanks.


feat: Crud folder structure

CRUD related code now lives in SpCrud component. This in turn uses four new components:
SpCrudCreate, SpCrudRead, SpCrudUpdate, SpCrudDelete.

Everything is setup for blog posts (not dynamic). I don't think we should go for review/merge...


Unable to create engine from onnx model

I've prepared the baseline onnx model, however, whenever I try and run depth-anything-tensorrt.exe, it outputs:
Loading model from models/depth_anything_vitb14.onnx...

and then, the program exits without any errors at all.
This is the command I'm using:
build/Release/depth-anything-tensorrt.exe models/depth_anything_vitb14.onnx video/davis_dolphins.mp4

I'm assuming that I am exporting the onnx model properly, however, just in case, I'll upload a log. Here's the command I used
python export.py --encoder vitb --load_from depth_anything_vitb14.pth --image_shape 3 518 518

onnxmodelexportlog.txt
Anyone have any idea why this isn't working for me?
Thanks.
CUDA: 11.6
TensortRT: <IP_ADDRESS>
Windows: 11

Did you put opencv_worldxxx.dll file in build/Release folder?

Also add video io dll files

Let me know if it works.

I've already starred the project, however, even with the DLL files, the same issue is still present. I'm still not getting any errors and no engine file is being built.

Let me know if it works.

I've also been trying to build the engine file with trtexec with an older version of this repo, however, I'm still running into issues.
I'm following this guide, however, I keep running into a "network creation failed" error in trtexec.
My issue is outlined here with all the relevant files

Let me know if it works. Please give a star if you like the project and my help.

thank you for taking the time to read my issue, your work looks amazing, however, I hope you're still able to help me with this :D

did you modify CMakeLists.txt to set your opencv and tensorrt paths?

Please just use most recent version and let's try to fix  your issue.

I checked your onnxmodelexportlog.txt file. It seems your engine is correctly built.

did you modify CMakeLists.txt to set your opencv and tensorrt paths?

I have modified that file to the correct paths:

That is very strange. It should show an error if there is a bug or problem in the code. If it doesn't show it may be system error

Or premission. you tensorrt and opencv are in c folder will you try it as admin?

I'm sorry I can't provide any further information, but yeah, it still doesn't work.

What is your gpu?

I have a mobile NVIDIA GTX 1060 3gb vram

I used your onnx model you put here and created the engine successfully. I think there is a cuda version problem in your system. maybe your cuda 11.6 version is not suitable for your GPU. I will look it up for you.

I have been able to successfully run the onnx model with cuda acceleration from this repo.
I don't think that compatibility with the cuda version is the issue. It could be possible that my gpu just does not support tensorrt

I found out that Compute capability (version) for your GPU (nvidia gtx 1060) is  6.1

Also, I checked that compute capability 6.1 pascal arch is compitable with CUDA 8.0

Please install cuda 8.0. Also don't forget to install cudnn version for cuda8.0

nvidia-smi states that my current cuda version is 12.4 which should allow me to use cuda version 11.6.
I have been able to use version 11.6 with this repo too.
Let me try it out though.

Then check your onnx cuda version what version it is installed with?

could you explain what you mean by onnx cuda version? I was able to use version 11.6 with this repo.

Mine says I am using cuda12.0 but in fact I installed 11.8. It doesn't show cuda toolkit version

yes, but it should indicate that my current driver is using cuda version 12.4. I have installed the latest Nvidia driver for my gpu.

You used pip install onnxruntime-gpu command to install onnx gpu right? use conda list to check onnxruntime-gpu version. Then you can check here which onnxruntime version is installed with which cuda version. https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html  it automatically install cuda toolkit

I should have version 11.6 installed properly, I will check with onnxruntime-gpu in a second

for my case it automatically install onnxruntime version that suitable for my gpu which is suitable for cuda 11.8

onnxruntime is different it will use anaconda environment to install cuda. I suggest you to install cuda 8.0 and do the steps again.

I will try that, but again, I have been able to use my version of the onnxruntime with my current version of cuda with cuda acceleration just fine in the past with the exact same model through this repo.

Hmm sorry that is what I can suggest from my observation. I can't guess without looking at it

I am looking at the onnx website you sent me and it seems to be suggesting that only cuda versions 10 and up are supported.

I'm kind of confused because I've been able to use the onnx runtime with cuda enabled before

Hmm sorry that is what I can suggest from my observation. I can't guess without looking at it

I've completely redownloaded my cuda and tensorrt. Now I'm getting an error stating:
onnx2trt_utils.cpp:374: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
onnx2trt_utils.cpp:400: One or more weights outside the range of INT32 was clamped
4: [network.cpp::nvinfer1::Network::validate::3163] Error Code 4: Internal Error (Network has dynamic or shape inputs, but no optimization profile has been defined.)```

I've figured it out. It was either my cuda cudnn or tensorrt installation that was the problem. I reinstalled everything and it works now.
Thanks for all your help!

It works on 11.6 cuda version with nvidia gtx 1060 ?


DubboProtocol.getInvoker

DubboProtocal.getInvoker
What is the purpose of the change
fix #12798
Brief changelog
update DubboProtocal.getInvoker
Verifying this change

Checklist

[x] Make sure there is a GitHub_issue field for the change (usually before you start working on it). Trivial changes like typos do not require a GitHub issue. Your pull request should address just this issue, without pulling in other changes - one PR resolves one issue.
[ ] Each commit in the pull request should have a meaningful subject line and body.
[ ] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[ ] Check if is necessary to patch to Dubbo 3 if you are work on Dubbo 2.7
[ ] Write necessary unit-test to verify your logic correction, more mock a little better when cross module dependency exist. If the new feature or significant change is committed, please remember to add sample in dubbo samples project.
[ ] Add some description to dubbo-website project if you are requesting to add a feature.
[ ] GitHub Actions works fine on your own branch.
[ ] If this contribution is large, please follow the Software Donation Guide.

Please check on 3.2.x. 2.6.x is no longer maintained.


Added README file to repo

this branch is for the static-index file, not the README. Add it under a different branch first :)


”Sângeorz-Băi” is listed in the drop-down menu

Description:
"Sângeorz-Băi" is listed in the drop-down menu alongside its corresponding county and commune, according to the law
Precondition:
The website is up an running.

Step 1
Type "Sângeorz-Băi" in the search bar.

Expected results
The location is listed in the drop-down menu as "Sângeorz-Băi, Bistrița-Năsăud (Sângeorz-Băi)".


Merge master branch to prTesting1_201910091252 branch

Docs Build status updates of commit 9aef6e9:
:clock10: Pending: waiting for processors (10 builds ahead of you)
:warning: Docs Build is busy, currently there are 10 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit 9aef6e9:
:warning: Validation status: warnings

File
Status
Preview URL
Details

split/updateTestRef1.md
:warning:Warning

Details

split/updateTestRef1.md

[Warning] Missing attribute: author. Add the current author's GitHub ID.
[Warning] Missing attribute: title. Add a title string to show in search engine results.

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Normalize header files

Some headers include other files unnecessarily. Some of them are:
scheme/bgvrns/bgvrns-scheme.h
key/allkey.h
Some headers include too many header files. Example:
scheme/allscheme.h

Work done for this ticket:

Created forward declarations files for different classes ("<original_header_name>-fwd.h"). They can be included instead of complete class definitions.
Removed unnecessary header files' includes.
The PlaintextEncodings enumerations were moved from plaintext.h to constants.h. Their names were capitalized and slightly changed for better readability.
Made enum PtxtPolyType a part of PlaintextImpl as this enum is not used anywhere else
Moved code/function implementations from header to source files to avoid additional includes.
Moved the MetadataTest class to pke/unittests/utils as it is meant for unit testing only
Created a separate file for the EncryptResult/DecryptResult structs
Created a new function CryptoContextFactory::GetFullContextByDeserializedContext() to avoid including cryptocontext.h
Completely removed the following files: bfvrns-advancedshe.cpp, bfvrns-pre.cpp, bfvrns-fhe.cpp, keyswitch-rns.cpp, bgvrns-pre.cpp, bgvrns-advancedshe.cpp, bgvrns-fhe.cpp
, plaintextfactory.cpp, ckksrns-pke.cpp, ckksrns-pre.cpp, rlwe-cryptoparameters.cpp, rns-advancedshe.cpp, rns-fhe.cpp, rns-pre.cpp, rns-scheme.cpp, allscheme.h, allkey.h, allbfvrns.h, allbase.h, allrns.h


Feature/SamvritSrinath/Landing-Page

Tracking Info
Resolves #
Make sure your branch name conforms to: <feature|staging|bugfix|...>/<username>/<3-4 word description separated by dashes>. Otherwise, please rename your branch and create a new PR.
Changes
We created the first landing static page without the NavBar and have a separate page associated with it that is rendered in App.tsx. The images present are static and don't link to anywhere as of yet: and are updated with the images presented in Figma MVP.
Testing
Compared the first site to the figma, and compared it to scale to ensure that users would be able to see all the details present within the site.
Confirmation of Change

Created Basic Landing Page for Website.


Error: node stack overflow

Hello,
After a fresh clone of the project, I have attempted to run the test case and it is still not working for me, can you please advise me as to what may be going incorrectly?
The output of
Rscript VaQuERo/scripts/VaQuERo.r --debug TRUE
follows:
Rscript VaQuERo/scripts/VaQuERo.r --debug TRUE
##------ Wed Aug  3 09:44:40 2022 ------##
[1] "Warning: command line option overwritten"
[1] "##~LOG~PARAMETERS~####################"
$dir
[1] "sandbox"
$country
[1] "Austria"
$bbsouth
[1] 46.38
$bbnorth
[1] 49.01
$bbwest
[1] 9.53
$bbeast
[1] 17.15
$metadata
[1] "VaQuERo/data/metaDataSub.tsv"
$marker
[1] "VaQuERo/resources/mutations_list_grouped_2022-05-17_Austria.csv"
$smarker
[1] "VaQuERo/resources/mutations_special_2022-05-03.csv"
$pmarker
[1] "VaQuERo/resources/mutations_problematic_vss1_v3.csv"
$data2
[1] "VaQuERo/data/mutationDataSub_sparse.tsv"
$data
[1] "VaQuERo/data/mutationDataSub.tsv.gz"
$inputformat
[1] "sparse"
$plotwidth
[1] 8
$plotheight
[1] 4.5
$ninconsens
[1] 0.4
$zero
[1] 0.02
$depth
[1] 250
$recent
[1] 9999
$plottp
[1] 3
$minuniqmark
[1] 1
$minuniqmarkfrac
[1] 0.4
$minqmark
[1] 3
$minmarkfrac
[1] 0.4
$smoothingsamples
[1] 2
$smoothingtime
[1] 2
$voi
[1] "BA.4,BA.5,BA.1,BA.2,B.1.617.2,B.1.1.7"
$highlight
[1] "BA.4,BA.5,BA.1,BA.2,B.1.617.2,B.1.1.7"
$debug
[1] TRUE
$help
[1] FALSE
[1] "##~LOG~PARAMETERS~####################"
[1] "PROGRESS: create directory "
##------ Wed Aug  3 09:44:40 2022 ------##
[1] "PROGRESS: read mutation files "
[1] "PROGRESS: read and process meta data "
[1] "LOG: last_BSF_run_id BSF_1125"
[1] "LOG: print STATUS counts: "
detected passed_qc
1        19
[1] "PROGRESS: print STATUS map"
##------ Wed Aug  3 09:44:41 2022 ------##
Saving 7 x 7 in image
Error: node stack overflow
Execution halted
free(): invalid pointer
Aborted (core dumped)
Many thanks,
Evan

Hello Evan
Unfortunately we could not reproduce your issue. Since R and its packages make use of several system libraries, which might cause different behaviors on different systems, we decided to provide a docker image to have a standardized environment to execute the analysis. I hope this helps you.
Please refer to docker/README.md for details
If you have any questions concerning usage of the container or if you run into any issue executing the tool within the container, please do not hesitate to contact me.
lg Fabian


Update eGFR calculation

New calculation for eGFR reduces racial bias. Apply logic to the apps so they calculate eGFR using this new method and discard the eGFR values received.

Check if eGFR calculations has been updated in EHR systems.


compose: Only show "New Topic" when in stream or topic narrow.

If you're in All messages, Mentions, Starred messages, or Search, New topic doesn't prefill the stream. We should only show "New Topic" if we're going to prefill the stream in the compose box. Otherwise we should show "New stream message", similar to what we show for PM narrows.
Possibly the only thing that has to change is this logic in narrow.js, as well as one more reference to update_closed_compose_buttons_for_stream in that file. (Also maybe we'll want to rename update_closed_compose_buttons_for_private to something more generic.)
    if (filter.has_operator("is") && filter.operands("is")[0] === "private"
        || filter.has_operator("pm-with") || filter.has_operator("group-pm-with")) {
        compose.update_closed_compose_buttons_for_private();
    } else {
        compose.update_closed_compose_buttons_for_stream();
    }

@zulipbot claim

compose.update_closed_compose_buttons_for_private() also changes New private message to New conversation. This change is meaningful when in PMs, but do we want the same thing in Starred/Mentions narrows?
If not, which I am guessing is the right choice here, we'll have to add a new function(s) to handle these specific cases.

btw, #12491 may also be a relevant piece of context (or not, not sure)

@zulipbot claim

@zulipbot claim --force

Reading the unfortunately super long history of this issue, I think finishing https://github.com/zulip/zulip/pull/12538 might be a better path forward than focusing on this as written.
@Signior-X do you want to try rebasing that old PR of @vinitS101's?

As commented on the PR #17363, will first make that small change so that it will be helpful. Then I will look over trying rebasing the PR of @vinitS101
It has a super long history and many conflicts, so surely it will take time to properly get hold of it.

We do not plan to move forward with this issue.


Misspelling across the repo

Signed-off-by: kanav-raina<EMAIL_ADDRESS>Issue #736
Changes
Changed Accord Protocol to Accord Project

Flags

Related Issues

Issue #
Pull Request #

Coverage remained the same at 95.535% when pulling 8cd551d14a6da9bf3a3f9dc0b205efea33101e02 on kanav-raina:patch-1 into f7a858469f8a5c77ad5714f03f7327e5227f062f on accordproject:master.


How can I make the CPU usage less than 100%?

How can I manage CPU usage?

Which version are you running? There were issues with that in the past

Right now I have the same 100% CPU issue with the latest docker version
always ghcr.io/arriven/db1000n:latest

@zdytch docker doesn't pull new versions unless --pull always is specified. The app should output its version when started, what does it show for you?

Status: Image is up to date for ghcr.io/arriven/db1000n:latest
2022/04/07 08:00:05.589425 main.go:51: DB1000n [Version: v0.8.20][PID=1]

@Arriven db1000n_0.8.19_windows_386.zip, db1000n_0.8.19_windows_amd64.zip, db1000n_0.8.16_windows_386.zip, db1000n_0.8.16_windows_amd64.zip. On VM, and on physical machines. Windows 10.

@Arriven maybe you need to run with some parameters? I just double click to launch.

we would certainly benefit from --debug argument being specified to get some more details into what's going on

guys, a bit more details from me about high CPU usage starting from this comment here https://github.com/Arriven/db1000n/issues/491#issuecomment-1091560082

Right now I have the same 100% CPU issue with the latest docker version
always ghcr.io/arriven/db1000n:latest

That is a problem of Docker Dekstop, not of any script.

https://stackoverflow.com/questions/4208/windows-equivalent-of-nice
;)


More Filter Icons

There are more icons that I think we should add that pertain to different filter operations.
Date Related Icons
this-quarter (filter showing dates for the current quarter)
next-quarter
last-quarter
this-week (filter showing dates for the current week)
next-week
last-week
year-to-date (filter showing dates from beginning of year to current date)
quarter-one (filter showing dates in Q1)
quarter-two
quarter-three
quarter-four
month (filter for a specific month, user provides the desired month)
year (filter for a specific year, user provides the desired year)
General Icons
top (filter showing the top X records, where X is a user provided number)
top-percentile (filter showing the top X% records, where X is a percent... if that makes sense)
bottom
bottom-percentile

These should go into the editor category.

@sdimchevski I wanted to confirm whether it was understood what the last-quarter and last-week icons meant.  When I requested these I meant them to really mean the previous quarter and previous week.  Not the very last quarter of the year or last week of the month.  From what I can see in the new icons it seems that we thought it meant "last" instead of "previous".
I didn't explain what I intended them to represent in the beginning so I apologize if there was any confusion.  Could we update those icons, or add new ones for previous-quarter and previous-week?

@ig-robstoffers I see. Then I'll make new ones and we'll keep the others.


TensorDict tutorial links are broken in Readme[BUG]

Describe the bug
Readme links multiple times to https://github.com/pytorch/rl/blob/main/tutorials/tensordictmodule.ipynb
which is broken.

Thanks! The tutorials were refactored recently so those links need updating. Correct link is https://pytorch.org/rl/tutorials/tensordict_module.html
I'll make sure the readme gets corrected!


Source Control - repo Incoming/Outgoing changes SLOW

Does this issue occur when all extensions are disabled?: Yes/No
YES

VS Code Version: 1.92.0
OS Version: Windows_NT x64 10.0.22631
Commit: b1c0a14de1414fcdaa400695b4db1c0799bc3124
Date: 2024-07-31T23:26:45.634Z

Steps to Reproduce:

Open VS Code, start a workspace - Clone/Open any Github repo (preferably with long list of commits)
Nav to Source Control
Observe how SLOW it is at loading all the Incoming/Outgoing commits
basically any changes you make for staging is also slow, because it is loading literally every single commit from years back, this may take a while before it updates and is usable to stage and commit.

This is because up the resent update which implements this change.
It would be nice for a way to disable or limit any/all Incoming/Outgoing to prevent this from becoming so slow it hangs up.
edit: I found it is called SCM: Show History Graph in settings.
however, sometimes this is helpful, but it would be nice if we can set a limit to prevent it loading every single one.

/duplicate
Another open issue (maybe more than one) is asking for a limit.


All facilities should be visible to the Super users

Current behavior
Currently we need to associate a facility with the user even when the user has Super or Commerce Super/administrator permission.
Expected behavior
When a user has Super or Commerce Super/administrator permission, all active facilities should be visible to the user.
Steps to reproduce the issue

Can you handle fixing this bug by yourself?

[ ] YES
[ ] NO

Environment details

Browser:
OS:
Code Version:

Additional information

Discussed and this is already fixed in coming updates.


[Rancher2] Make requirement for TLS termination on loadbalancer for Authorized Cluster Endpoint (ACE) explicit

Request Summary:
When configuring a loadbalancer with Authorized Cluster Endpoint, it is required to perform TLS termination on the loadbalancer (the user can either use a public CA signed cert, in which case they just define the FQDN in the ACE configuration, or they can also define the private CA certificate, in case of using a private CA signed certificate). This requirement to perform TLS termination is not explicit in the ACE architecture docs, leading to some confusion that Authorized Cluster Endpoint can be enabled via a Loadbalancer without TLS termination, i.e. Layer-4 loadbalancing, with TLS termination on the kube-apiserver using the cluster CA, which is not possible.

Addressed in https://github.com/catherineluse/docs/commit/1d30f699a0c29f58e5a44769b738bd4600a8e1ab


docs(aad-registered): clarify workplace joined term

Background information is on twitter

@sassdawe : Thanks for your contribution! The author(s) have been notified to review your proposed change.

@MicrosoftGuyJFlo,
Can you review the proposed changes?
IMPORTANT: When the changes are ready for publication, add a #sign-off comment to signal that the PR is ready for the review team to merge. Thanks.

#sign-off


[Azure Python SDK] Not able to consume output of virtual_machines.list_all with azure-mgmt-compute==20.0.0

I am using Azure Python SDK for resource management.
Below snippet was working with Azure -> azure-mgmt-compute==12.0.0, but after upgrading the Azure sdk to azure-mgmt-compute==20.0.0 it's not working.
creds = ServicePrincipalCredentials(client_id=client_id, secret=secret, tenant=tenant_id, **kwargs)

compute_client =  ComputeManagementClient(creds,
                                   subscription_id,
                                   base_url='https://management.azure.com')

paged_iter = compute_client.virtual_machines.list_all(raw=True)

output = []
paged_iter.get(paged_iter.next_link)
while True:
    chunk = json.loads(paged_iter.raw.response.content)
    if 'nextLink' in chunk:
        paged_iter.get(chunk['nextLink'])
    else:
        break
resp = {'value': output}
print(resp)

After upgrade getting error
AttributeError: 'ItemPaged' object has no attribute 'get'
Please help to understand how to consume output of  compute_client.virtual_machines.list_all(raw=True)

Thanks for the feedback, we’ll investigate asap.

@xiangyan99 and @msyyc - were you able to investigate this?

hi @sanvar7 The old package version like 12.0.0's 'paged_iter ' inherited from msrest.paging.Paged
https://docs.microsoft.com/en-us/python/api/msrest/msrest.paging.paged?view=azure-python
and it now inherit from azure.core.paging.ItemPaged
https://docs.microsoft.com/en-us/python/api/azure-core/azure.core.paging.itempaged?view=azure-python#by-page-continuation-token-none-

@yungezz is this something you can clearly document in the Python SDK docs?
cc @xiangyan99

@yungezz is this something you can clearly document in the Python SDK docs?
cc @xiangyan99

hi @msyyc do we have migration guide from Track1 to Track2? If yes, could you pls share it? thanks

Hi @avirishuv version < 17.0.0b1 is track1 version and version >= 17.0.0b1 is track2 version. Track1 will be deprecated soon.
(1) The difference between track1 and track2 is described in CHANGELOG.md : https://pypi.org/project/azure-mgmt-compute/22.0.0/

(2) We have guidance for migration from track1 to track2 :
https://devblogs.microsoft.com/azure-sdk/migrating-python-management-libraries/
https://github.com/Azure/azure-cli/blob/dev/doc/track_2_migration_guidance.md

hi @sanvar7 please let us know if these resources help to answer your question, or do you have any follow-up questions?

hi @sanvar7 are there any additional questions on this? If not, can we close the issue?

Closing the issue, as per above. If any additional questions, feel free to reopen.