DataLossError: file is too short to be an sstable

Hi, I am trying to build a custom object detector using Tensorflow. I tried to do it in my local computer but it took a long time as I have an Intel i3 processor and no GPU. But I was able to start the training after running the following code:
python train.py --logtostderr --train_dir=training/ --pipeline_config_path=training/ssd_inception_v2_coco.config
The training continued for few epochs for some hours along with losses like it typically does after which I decided to stop and try it using Google Colab since there is GPU support there.
But when I copy all the tensorflow directory containing all the XMLs,Images,tf-records, pretrained models and config files and run in colab, the training starts but ends with an error.
Output line of Colab:
WARNING: The TensorFlow contrib module will not be included in TensorFlow 2.0.
For more information, please see:

https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md
https://github.com/tensorflow/addons
If you depend on functionality not listed there, please file an issue.

WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/platform/app.py:125: main (from main) is deprecated and will be removed in a future version.
Instructions for updating:
Use object_detection/model_main.py.
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/legacy/trainer.py:266: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version.
Instructions for updating:
Please switch to tf.train.create_global_step
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/op_def_library.py:263: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.
Instructions for updating:
Colocations handled automatically by placer.
WARNING:tensorflow:num_readers has been reduced to 1 to match input file shards.
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/builders/dataset_builder.py:80: parallel_interleave (from tensorflow.contrib.data.python.ops.interleave_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.data.experimental.parallel_interleave(...).
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/legacy/trainer.py:65: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/core/preprocessor.py:188: sample_distorted_bounding_box (from tensorflow.python.ops.image_ops_impl) is deprecated and will be removed in a future version.
Instructions for updating:
seed2 arg is deprecated.Use sample_distorted_bounding_box_v2 instead.
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/core/preprocessor.py:1218: calling squeeze (from tensorflow.python.ops.array_ops) with squeeze_dims is deprecated and will be removed in a future version.
Instructions for updating:
Use the axis argument instead
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/core/batcher.py:96: batch (from tensorflow.python.training.input) is deprecated and will be removed in a future version.
Instructions for updating:
Queue-based input pipelines have been replaced by tf.data. Use tf.data.Dataset.batch(batch_size) (or padded_batch(...) if dynamic_pad=True).
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/training/input.py:753: QueueRunner.init (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version.
Instructions for updating:
To construct input pipelines, use the tf.data module.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow/python/training/input.py:753: add_queue_runner (from tensorflow.python.training.queue_runner_impl) is deprecated and will be removed in a future version.
Instructions for updating:
To construct input pipelines, use the tf.data module.
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
INFO:tensorflow:depth of additional conv before box predictor: 0
WARNING:tensorflow:From /content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/core/losses.py:664: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.
Instructions for updating:
Use tf.cast instead.
Traceback (most recent call last):
File "train.py", line 184, in
tf.app.run()
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/platform/app.py", line 125, in run
_sys.exit(main(argv))
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/util/deprecation.py", line 324, in new_func
return func(*args, **kwargs)
File "train.py", line 180, in main
graph_hook_fn=graph_rewriter_fn)
File "/content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/legacy/trainer.py", line 397, in train
include_global_step=False))
File "/content/drive/My Drive/New Project/TensorFlow/models/research/object_detection/utils/variables_helper.py", line 126, in get_variables_available_in_checkpoint
ckpt_reader = tf.train.NewCheckpointReader(checkpoint_path)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/pywrap_tensorflow_internal.py", line 326, in NewCheckpointReader
return CheckpointReader(compat.as_bytes(filepattern), status)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/errors_impl.py", line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.DataLossError: file is too short to be an sstable
The code i used is following:
`import os
os.chdir('/content/drive/My Drive/New Project/TensorFlow/workspace/training_demo')
os.environ['PYTHONPATH'] += ':/content/drive/My Drive/New Project/TensorFlow/models/research/:/content/drive/My Drive/New Project/TensorFlow/models/research/slim/'
!python train.py --logtostderr --train_dir=training/ --pipeline_config_path=training/ssd_inception_v2_coco.config
`
Please note that all the preprocessing related to generation of tf-records were done and the entire directory is in the Tensorflow folder.
Kindly help. Thank you.

祝君好运

It looks like you haven't used a template to create this issue. Please resubmit your issue using a template from here. We ask users to use the template because it reduces overall time to resolve a new issue by avoiding extra communication to get to the root of the issue. We will close this issue in lieu of the new one you will create from the template. Thank you for your cooperation.

Automatically closing due to lack of recent activity. Please update the issue when new information becomes available, and we will reopen the issue. Thanks!

Hi, i am also getting the same error as above. I am using Google Colab to train an object detector using Tensorflow. All my data is on google drive and i successfully done all the pre-processing including generating tf.record files for both training and test data. My training command is as follows:
os.environ['PYTHONPATH'] += '/content/gdrivre/My Drive/DeepLearning/models/research/:/content/gdrive/My Drive/DeepLearning/models/research/slim' !python train.py --logtostderr --train_dir=training/ --pipeline_config_path=ssd_mobilenet_v1_coco.config
I am already inside models/research/object_detection folder and running the command from there.
Also pre-trained ssd_mobilenet model is downloaded from official tensorflow repository.

if you're getting this from a tf.data dataloader, then try deleting the cache file. This worked for me


Potential issue in c/enc/compress_fragment.c: Arithmetic Overflow in Expression

 What is a Arithmetic Overflow?  When a narrow type integral value was shifted left, multiplied, added, or subtracted and the result of that arithmetic operation was cast to a wider type value. If the operation overflowed the narrow type value, then data is lost. You can prevent this loss by converting the value to a wider type before the arithmetic operation.
3 instances of this defect were found in the following locations:

Instance 1
File : c/enc/compress_fragment.c
Enclosing Function : EmitInsertLen
https://github.com/sagarpant1/brotli/blob/0c5603e07bed1d5fbb45e38f9bdf0e4560fde3f0/c/enc/compress_fragment.c#L193
Issue in: prefix, nbits
Code extract:
    const size_t prefix = tail >> nbits;
    const size_t inscode = (nbits << 1) + prefix + 42;
    BrotliWriteBits(depth[inscode], bits[inscode], storage_ix, storage);
    BrotliWriteBits(nbits, tail - (prefix << nbits), storage_ix, storage); <------ HERE
    ++histo[inscode];
  } else if (insertlen < 2114) {

How can I fix it?
Correct reference usage found in c/enc/brotli_bit_stream.c at line 131.
https://github.com/sagarpant1/brotli/blob/0c5603e07bed1d5fbb45e38f9bdf0e4560fde3f0/c/enc/brotli_bit_stream.c#L131
Code extract:
    size_t nbits = Log2FloorNonZero(n);
    BrotliWriteBits(1, 1, storage_ix, storage);
    BrotliWriteBits(3, nbits, storage_ix, storage);
    BrotliWriteBits(nbits, n - ((size_t)1 << nbits), storage_ix, storage); <------ HERE
  }
}

Instance 2
File : c/enc/compress_fragment.c
Enclosing Function : EmitCopyLen
https://github.com/sagarpant1/brotli/blob/0c5603e07bed1d5fbb45e38f9bdf0e4560fde3f0/c/enc/compress_fragment.c#L242
Issue in: prefix, nbits
Code extract:
    const size_t prefix = tail >> nbits;
    const size_t code = (nbits << 1) + prefix + 20;
    BrotliWriteBits(depth[code], bits[code], storage_ix, storage);
    BrotliWriteBits(nbits, tail - (prefix << nbits), storage_ix, storage); <------ HERE
    ++histo[code];
  } else if (copylen < 2118) {

How can I fix it?
Correct reference usage found in c/enc/brotli_bit_stream.c at line 131.
https://github.com/sagarpant1/brotli/blob/0c5603e07bed1d5fbb45e38f9bdf0e4560fde3f0/c/enc/brotli_bit_stream.c#L131
Code extract:
    size_t nbits = Log2FloorNonZero(n);
    BrotliWriteBits(1, 1, storage_ix, storage);
    BrotliWriteBits(3, nbits, storage_ix, storage);
    BrotliWriteBits(nbits, n - ((size_t)1 << nbits), storage_ix, storage); <------ HERE
  }
}

Instance 3
File : c/enc/compress_fragment.c
Enclosing Function : EmitCopyLenLastDistance
https://github.com/sagarpant1/brotli/blob/0c5603e07bed1d5fbb45e38f9bdf0e4560fde3f0/c/enc/compress_fragment.c#L273
Issue in: prefix, nbits
Code extract:
    const size_t prefix = tail >> nbits;
    const size_t code = (nbits << 1) + prefix + 4;
    BrotliWriteBits(depth[code], bits[code], storage_ix, storage);
    BrotliWriteBits(nbits, tail - (prefix << nbits), storage_ix, storage); <------ HERE
    ++histo[code];
  } else if (copylen < 136) {

How can I fix it?
Correct reference usage found in c/enc/brotli_bit_stream.c at line 131.
https://github.com/sagarpant1/brotli/blob/0c5603e07bed1d5fbb45e38f9bdf0e4560fde3f0/c/enc/brotli_bit_stream.c#L131
Code extract:
    size_t nbits = Log2FloorNonZero(n);
    BrotliWriteBits(1, 1, storage_ix, storage);
    BrotliWriteBits(3, nbits, storage_ix, storage);
    BrotliWriteBits(nbits, n - ((size_t)1 << nbits), storage_ix, storage); <------ HERE
  }
}

pred label 0


Spring Cloud Eureka Client does not set asgName, causes incorrect behavior in Eureka Server by Netflix

See this issue in Spinnaker - https://github.com/spinnaker/clouddriver/pull/1520#issuecomment-289588048
Discovery records from spring cloud eureka client are not setting asgName field correctly.
Without asgName, this code:
https://github.com/Netflix/eureka/blob/4f24d9dcf90713b421f6c092fa63e707cbf74df3/eureka-core/src/main/java/com/netflix/eureka/registry/AwsInstanceRegistry.java#L62
will not correctly evaluate AsgEnabledRule, causing it to fall back to LeaseExists rule.
The observed difference is that with the Netflix provided eureka client, setting the overridenstatus to OUT_OF_SERVICE in the discovery record and then deleting this override causes the record to reset its status to that of the cloud provider ( UP, DOWN, STARTING ).
In your implementation, since the AsgEnabledRule is never evaluated correctly due to the lack of asgName, the discovery status never resets and remains OUT_OF_SERVICE.

( qiangdavidliu is current maintainer of Eureka - he was the one who pointed out this discrepancy )

@tomaslin nothing is keeping you from setting eureka.instance.aSGName. We don't set a default because I'm not sure there is a good default.

@tomaslin: I am having the same issue. I set the "eureka.asgName=xxx", causing it to show up under instance info:

But still, cloudriver always use the value OUT_OF_SERVICE when re-enabling instances.
DELETE .../status?value=OUT_OF_SERVICE. Did you get it working?


Optional / null arguments with tdjson

I am using tdjson, but I have noticed there are several types that have optional arguments, but this is not available for parsers in the TL file, but it does seem to be present in the comment ABOVE the type in the TL file. For example:
(these are taken from the tdlib TL file: https://github.com/tdlib/td/blob/master/td/generate/scheme/td_api.tl )
User.profile_photo may be null:
//@description Represents a user @id User identifier @first_name First name of the user @last_name Last name of the user @username Username of the user
//@phone_number Phone number of the user @status Current online status of the user @profile_photo Profile photo of the user; may be null
//@outgoing_link Relationship from the current user to the other user @incoming_link Relationship from the other user to the current user
//@is_verified True, if the user is verified @is_support True, if the user is Telegram support account
//@restriction_reason If non-empty, it contains the reason why access to this user must be restricted. The format of the string is "{type}: {description}".
//-{type} contains the type of the restriction and at least one of the suffixes "-all", "-ios", "-android", or "-wp", which describe the platforms on which access should be restricted. (For example, "terms-ios-android". {description} contains a human-readable description of the restriction, which can be shown to the user)
//@is_scam True, if many users reported this user as a scam
//@have_access If false, the user is inaccessible, and the only information known about the user is inside this class. It can't be passed to any method except GetUser @type Type of the user @language_code IETF language tag of the user's language; only available to bots
user id:int32 first_name:string last_name:string username:string phone_number:string status:UserStatus profile_photo:profilePhoto outgoing_link:LinkState incoming_link:LinkState is_verified:Bool is_support:Bool restriction_reason:string is_scam:Bool have_access:Bool type:UserType language_code:string = User;

updateSelectedBackground.background may also be null:
//@description The selected background has changed @for_dark_theme True, if background for dark theme has changed @background The new selected background; may be null
updateSelectedBackground for_dark_theme:Bool background:background = Update;

This presents a problem with my code, as unless I specify otherwise, I expect all fields of the type to be present in the JSON, even if the value is null. Is the tdjson library removing these if they are null? or are they actual optional arguments that can somehow be exposed in the TL file?

tdjson removes all objects that are null when storing TDLib API objects to JSON. So a field is missing, only if it is null.
In incoming requests to TDLib any field can be omitted with the default value null for objects. This may form a correct or an incorrect request, depending on other parameters.

I figured out a solution, which involved basically what you said, if the value is not present i just set it to None in my code that parses the JSON received from td_json_client_receive into my model classes
Ideally i feel this should maybe be an option with tdjson, as some serialization frameworks would probably not be as flexible if there is missing fields

@mgrandi Every deserialization framework should be able to check field existence, so I don't expect a problem there. Moreover, I expect that most frameworks are able to silently return None/null for nonexistent fields. For example, the parameter default=None can be safely added when parsing all object fields in your code to completely resolve the problem.

I concede that point, i'll close this to mark it as solved


git-bob try to draw an svg file showing a forest full of christmas trees (very detailed christmas trees) and a snowman.

git-bob try again and draw at least 10 trees in the forest

I see only one tree. git-bob try again please. Make sure there are 10 trees in the svg file.


Resolve reflection for static methods

Hi,
I need to do some reflection with static methods of a class but i'm running into this error : "an indexer property is missing in statics of MyClass "
How can i solve this ?
Here is the flowTry

Noticing a similar error when calling a variable named method on a class instance : "an indexer property is missing in MyClass"
Here is the (slightly altered) flowTry

I am facing the same issue. Is there any temporary workaround this?

Me too... At first, I thought this is amazing, flow even checks and recognize the property of object declared in other files. But how can I resolve this error?
I'm trying to loop an array of classes to call a static function of each class with the same name, only if the class has that static function.

This is intentionally unsupported


Add subject key ID calculation from public key

This will be used by Fulcio to correctly calculate the
subject key ID (SKID), which is currently hardcoded.
Signed-off-by: Hayden Blauzvern<EMAIL_ADDRESS>
Summary

Ticket Link

Fixes
Release Note

* Added method to calculate subject key ID from public key

@bobcallaway


Add libs property to Spack package

Needed for self.spec["dla-future-fortran"].libs to work correctly (used by ELSI).
Added pyproject.toml to configure black as in Spack.

ELSI has a few custom variables that needs to be populated for proper linking. Since the name of the library doesn't match the name of the package, the libs property is needed for self.spec["dla-future-fortran"].libs to work correctly.


[Feature Request]: Conversational Memory in Llamaindex

Feature Description
I am generating a chatbot using llama-hub for the company knowledge-base. It is working perfectly fine, but not maintaining any context or reference for previous answer. e.g. What is reminder rule will be answer perfectly, but then how to set it will not be answer as it is not having reference of previous answer.
Reason
LlamaIndex is generating an Index and there is no way to pass that ConversationalRetrievalChain or ConversationalEntityMemory.
Value of Feature
It will be very easy for anyone to build chatbot that exactly work like chatbot, but on customized knowledgebase.

Hey, did you take a look at chat engine in llamaindex
https://docs.llamaindex.ai/en/stable/module_guides/deploying/chat_engines/root.html

Let me know if this helped you @ankitajdesai
So that I can close this issue 🙂

Hey @ankitajdesai ,
I'm closing this issue, if you still have any doubt you can re open this issue anytime or raise a new one 🙂

Hello,
Sorry for the delayed response, but yeah that has solved my requirement.
On Fri, Dec 15, 2023 at 3:51 PM Anoop Sharma @.***>
wrote:

Let me know if this helped you @ankitajdesai
https://github.com/ankitajdesai
So that I can close this issue 🙂
—
Reply to this email directly, view it on GitHub
https://github.com/run-llama/llama-hub/issues/763#issuecomment-1857624174,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF4J3HSDS7C34DHNKAEFVU3YJQQDLAVCNFSM6AAAAABAQCF55GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJXGYZDIMJXGQ
.
You are receiving this because you were mentioned.Message ID:
@.***>


check_contains_regex: escape placeholders in template

Before, the pkg_version and pkg_name was used directly, which meant
that characters such as "." would retain their special meaning in the
resulting regex. This in turn meant that searching for
^Version {version}

would also match a line like
Version 1.203

when the version number of the current package is 1.2.3, since the "."
in the version number accidentally matches the "0".
Since we will now see more backslashes in the output, we no longer use
Rust escaping when printing the regular expressions to the user.

Codecov Report

Merging #51 into master will decrease coverage by 0.2%.
The diff coverage is 87.5%.

@@            Coverage Diff             @@
##           master      #51      +/-   ##
==========================================
- Coverage   94.17%   93.97%   -0.21%
==========================================
  Files           2        2
  Lines         378      382       +4
==========================================
+ Hits          356      359       +3
- Misses         22       23       +1

Impacted Files
Coverage Δ

src/lib.rs
93.88% <87.5%> (-0.21%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update a254c84...6f7bbda. Read the comment docs.


the result of your code

thanks for the code！how about the result of your code？Is that the same as the author’s?
waiting for your reply~ thanks

Hi, the result of the code is not the same as the authors as I do not have the same computation resource mentioned in the paper. I could only achieve 28% PQ.


Adding ability to listen to multiple kafka10 topics via comma separated list

Useful for cases like span info from different environments coming from different topics, etc.

seems handy, but would need a test and updates on the config docs. Also, we should make sure that this is something others agree with as I don't know the support implications of always using ConsumerRebalanceListener.
Sorry we don't have a kafka mailer at the moment. pinging @dgrabows as he touched this recently

This change make sense to me.
I don't think the ConsumerRebalanceListener is a concern. That was already there and not introduced with this change. It gets used for the worker to maintain a list of currently assigned partitions. That list is only used in the tests for multiple consumer threads, where the test needs to wait until each consumer has some assignment before proceeding.
The listener will be invoked each time partitions are reassigned in the consumer group, which will only happen once per restart if running a single instance of the collector. If running multiple collectors, invocations will occur whenever a collector is started, stopped, or looses connectivity to the kafka brokers. Those should be relatively infrequent events.

ok great. @danielkwinsor mind adding a test? (can be as simple as checking that split worked)
lemme know if you need help with this

I was figuring a request for tests would come :)  I definitely will do it when I can fit it between my heavy work queue.  My only concern is that area didn't look easy to mock, so I don't know when I'll be able to get to it.
Manual testing did show this worked out with single or multiple topics, but I didn't test things like whitespace, etc.

looks like you might be able to write a simple test that uses package access to check kafkaConsumer.subscription()
basically read-back that to show a simple split works. wanna try?

k very least this needs an update to the docs KafkaCollector.Builder and in zipkin-server/README like..
    * `KAFKA_TOPIC`: Topic zipkin spans will be consumed from. Defaults to "zipkin"
      * When Kafka 0.10 is in use, multiple topics may be specified if comma delimited

All good or did I scare you off? :)

All good... in the process of adding docs and tests, but rebased from
upstream and it wiped out my commit, then auto closed.  Expect by EoD.
On Jun 28, 2017 11:15, "Adrian Cole"<EMAIL_ADDRESS>wrote:

All good or did I scare you off? :)
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/openzipkin/zipkin/pull/1622#issuecomment-311743424,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACsTUM4tjnDnj6bkqY538y__XJPAoc0Eks5sIphUgaJpZM4N-oBx
.

I spent too long on the unit test and gave up.  It's much too hard to mock something coming from a constructor without powermockito.  Here's the code plus docs.

Thanks very much @danielkwinsor! (and thanks for the timeboxed attempt on tests.. I'll copy you on a test commit)


Support for OpenAI Assistants API

🚀 The feature
https://platform.openai.com/docs/assistants/overview
Motivation, pitch
Allow users to experiment with different assistant
Alternatives
No response
Additional context
No response

Are there plans to add support for the Assistant API? I am interested..


Time.parse can't handle microseconds

We have %L for specifying milliseconds, but we can't handle microseconds. %L should support more digits and truncate the result for now, since we only have microsecond precision.
Seen here

@asterite wow, i was just reading the issue and you already closed, so fast 😄


flow: file writer is sending packets from worker thread

src/modules/flow/file/file.c uses a thread to write files and the error check is sending packets from the thread -- this is wrong as the flow is not supposed to be triggered from thread context.
change to use sol_worker_thread_feedback() and consuming the errors from the main thread callback.

I will take a look.

Please take a look at #910

LGTM

Merged.


chore: move up the examples folder's .gitignore and .gitattributes files to the root directory

Per @malandis's feedback on this pr, so that the project can pick up these files.

Also moved dependabot.

sorry one more thing!  There is a ci job in the examples repo that build/runs the examples when pull requests are filed.  we need that, so that when dependabot files PRs, they will be tested.

LGTM except the build is failing.  I think the build is failing because we are missing the gradle jar file in the examples/gradle/wrapper dir.

Yeah, I was able to build it locally and when I googled the error I got the same answer as your suggestion!
I'll add gradle-wrapper.jar to examples/gradle/wrapper


feat(router): support stream for builder

Attn: @arschles
While adding support for the builder, I stumbled across the edge case of missing annotations.  In the case of builder, I can roll with defaults.  Awareness of this edge case and my technique for handling it did lead to a more general refactor of how this chunk of code builds the model, that and a liberal sprinkling of new comments to explain what the hell I'm doing.  Please forgive that slight scope creep.
If you want to use this with builder (as installed by helm), there's only one thing you actually need to do-- you need to move the builder's service into the "deis" namespace.  Moving all the deis components into the "deis" namespace has been a previous topic of discussion and has been something we'll "get around to at some point."  I guess it's time?  (It sort of matters to the router, because the router goes looking for deis-builder and it really does need to know what namespace to look in.)  We could discuss this at greater length tomorrow.  cc: @technosophos @mboersma This was addressed by https://github.com/deis/charts/pull/12
Apart from that, the remainder of the configuration is optional.  You can, but don't have to, do the following in the manifest for the deis-builder:
apiVersion: v1
kind: Service
metadata:
  annotations:
    routerConfig: '{"connectTimeout":10000,"tcpTimeout":1200000}'
...

The values shown are the defaults you get if you don't add a routerConfig annotation.

See https://github.com/deis/charts/pull/12

is this ready for testing in a cluster?

It's not feature complete.  It will, however, do everything it needs to with respect to the builder.

ok. I'll be happy to test it in the near future


Can not address the Array in the configuration

Hi there,
Using archaius-core version 0.7.3, I created a YAMLConfigurationSource myself to load the configuration from YAML file. In YAML, the List is support like this:
    required:
    - appId
    - serviceName
    - version
    - status

It is OK to load these values into an List and get them in the fist time. However, I got error after a while:
[2017-03-28 15:11:22,691/GMT+08:00][pollingConfigurationSource][ERROR]Error occured applying properties com.netflix.config.AbstractPollingScheduler$1.run(AbstractPollingScheduler.java:174)
java.lang.ClassCastException: java.util.ArrayList cannot be cast to java.lang.String
    at com.netflix.config.DynamicPropertyUpdater.addOrChangeProperty(DynamicPropertyUpdater.java:134)
    at com.netflix.config.AbstractPollingScheduler.populateProperties(AbstractPollingScheduler.java:111)
    at com.netflix.config.AbstractPollingScheduler$1.run(AbstractPollingScheduler.java:172)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

The reason is in the "DynamicPropertyUpdater.java", it is assumed the List is described in a String and trying to assemble the List by split that String:
                    if(e instanceof CopyOnWriteArrayList && AbstractConfiguration.getDefaultListDelimiter() != 0) {
                        newValueArray = new CopyOnWriteArrayList();
                        Iterable stringiterator = Splitter.on(AbstractConfiguration.getDefaultListDelimiter()).omitEmptyStrings().trimResults().split((String)newValue);
                        Iterator i$ = stringiterator.iterator();

So basically, the real List is not considered currently. Any idea how to make it supported?

I think it is always assumes a simple delimited string. There is some related discussion in #266 and #360.


mat-chip with with anchor link in parent causes page reload

What is the expected behavior?
The page should be navigated to without causing a reload
What is the current behavior?
The entire page is reloaded.
What are the steps to reproduce?
Providing a StackBlitz reproduction is the best way to share your issue.
https://stackblitz.com/edit/angular-material2-issue-dvn5ws?file=app%2Ftest.component.html
Clicking the first chip causes the page to reload (but you still end up on the correct page)
Clicking the second chip works as it should
Which versions of Angular, Material, OS, TypeScript, browsers are affected?
7.2.11
Is there anything else we should know?
Looks like there was a related issue in the past: #9032

according to this pr I understand that this is the intended behaviour.  To prevent refresh we should disable the chip. This cause the opacity change. At this point nothing one can do but reset css opacity.
<a routerLink="other">
  <mat-chip-list>
    <mat-chip style="opacity:1"  disabled>chip with link in parent</mat-chip>
  </mat-chip-list>
</a>

At least for now I use this method.
What do you think?

Closing as this is actually unrelated to the mat-chip, but rather that a click is occuring inside of an <a> tag.
I created a fork of your reproduction showing that this occurs even with a native <button> element inside of an <a> tag.


Clean up plugin rules

Place the "Plugins" section rules in the related color mapping groups so the plugins section can be removed and all rules are organized by semantics.
From https://github.com/trevordmiller/nova-vim/pull/31

I will be happy to work on this, please let me know what do you mean by

related color mapping groups

@kumarmj Sounds great, thank you for your interest! The "Plugins" section is out of place since all other rules are organized by purpose. So, the only change that needs to be made is to rename the "PLUGINS" header comment to be "VERSION CONTROL"; after you change the text in that comment, you can just run npm run push -- patch and submit a pull request and you're good to go!

@kumarmj This will help the color mappings (meaning the mappings from each highlight group to the related color variable) to match the nova-colors groups: https://github.com/trevordmiller/nova-colors/blob/master/src/index.js


search: Only move cursor to end of selection if cursor is there already.

Fixes bug reported here:
https://chat.zulip.org/#narrow/channel/9-issues/topic/Broken.20links.20to.20previous.20messages.3F/near/196462

Looks good, marked to merge, thanks @evykassirer!


Query after upsert-file

Hello,
I was able to call upsert-file with a pdf document and it returned successfully an id for the document. However, when I try to query I am getting a 500 Internal Server Error.
In the console running the plugin, I can see the following error:
Error: None is not a valid Source
In my query request I only provided the document_id in the filter section as the upsert-file operation does not allow to provide any other metadata.
Could you please advise how to query when the documents are added using  upsert-file.
Thanks,
Marcelo

I'm getting the same with the Weaviate provider

Hello,
I was able to call upsert-file with a pdf document and it returned successfully an id for the document. However, when I try to query I am getting a 500 Internal Server Error.
In the console running the plugin, I can see the following error: Error: None is not a valid Source
In my query request I only provided the document_id in the filter section as the upsert-file operation does not allow to provide any other metadata.
Could you please advise how to query when the documents are added using upsert-file.
Thanks, Marcelo

For the time being, when you query use the filter, source = "file" to query correctly until this is resolved.
{
  "queries": [
    {
      "query": "string",
      "filter": {
        "source": "file"
      },
      "top_k": 5
    }
  ]
}

Thank you all!
Resolved here: https://github.com/openai/chatgpt-retrieval-plugin/commit/e07ffedb3f0365c3839b3681cc3781174634f471

Hello,
I was able to call upsert-file with a pdf document and it returned successfully an id for the document. However, when I try to query I am getting a 500 Internal Server Error.
In the console running the plugin, I can see the following error: Error: None is not a valid Source
In my query request I only provided the document_id in the filter section as the upsert-file operation does not allow to provide any other metadata.
Could you please advise how to query when the documents are added using upsert-file.
Thanks, Marcelo

Hi Marcelo,
I'm currently trying to upsert a pdf file but I'm stuck. Always getting "Internal Server Error".
I can't seem to find proper documentation how to do it right. It would be really kind if you could show me a little code example how you uperserted a file properly.
Thank, Olaf


Landing Page first section

We only want top section for now (not including event info)

[ ] Initial version with background design, tagline, and dates
[ ] Responsive for large screens
[ ] Responsive for mobile

I'm gonna start working on this so we can chunk out something. Also gonna install node-sass :)


Requirement Functions

Sometimes you just don't want to type |5 PLD Levels:7| or |5 WAR Levels:7| or |5 DRK Levels:7| or |5 GNB Levels:7| or |5 WHM Levels:7| or |5 SCH Levels:7| or |5 AST Levels:7| or |5 SGE Levels:7| or |5 MNK Levels:7| or |5 DRG Levels:7| or |5 NIN Levels:7| or |5 SAM Levels:7| or |5 RPR Levels:7| or |5 BRD Levels:7| or |5 MCH Levels:7| or |5 DNC Levels:7| or |5 BLM Levels:7| or |5 SMN Levels:7| or |5 RDM Levels:7| or |5 BLU Levels:7| hundreds of times.
Also fixes a bug Rooby found when items.json has counts as strings.

Making a note that we talked before about this looking more like a function; e.g., hasJobLevels(7). Suggested that we might use a different boundary than ||, which usually just does names/categories/similar, and maybe something like {}, but open to anything that makes sense here. Having a separate delimiter for hook-interpreted things is probably good.
This also avoids reusing the |item name:count| colon separator for something that isn't a count. Ideally, :<value> across Manual would always refer to counts of something. 😃


Added issue and pull request template

I have added pull request and issue template as markdowns.
Kindly let me know if any changes are required.
Thanks

Add them inside a .github folder

I have added them inside a .github folder as instructed @neokd

Thanks for your contribution mate ❤


kinds of engineered plasmid [sf#157]

Reported by eilbeck on 2009-09-01 22:39 UTC
Request from ZFIN for engineered plasmid terms. After email discussion, this is what crystalized out:
plasmid
---[i] natural plasmid ---> related to mobile element
---[i] engineered_plasmid ---> related to reagent
---------[i] gene trap construct
---------[i] promoter trap construct
---------[i] enhancer trap construct
gene trap construct is a type of engineered plasmid which is designed to integrate into a genome and produce a fusion transcript between exons of the gene into which it inserts and a reporter element in the construct. Gene traps contain a splice acceptor, do not contain promoter elements for the reporter, and are mutagenic. Gene traps may be bicistronic with the second cassette containing a promoter driving an a selectable marker.
promoter trap construct is a type of engineered plasmid which is designed to integrate into a genome and express a reporter when inserted in close proximity to a promoter element. Promoter traps typically do not contain promoter elements and are mutagenic.
enhancer trap construct is a type of engineered plasmid which is designed to integrate into a genome and express a reporter when the expression from a basic minimal promoter is enhanced by genomic enhancer elements. Enhancer traps contain promoter elements and are not usually mutagenic.

Updated by eilbeck on 2009-09-01 22:39 UTC

status: open --> closed-accepted


adding a new book

adding the "Modern PHP New features and good practices" book

Thanks! I've been meaning to add this for a while now.


Worng text

Challenge http://freecodecamp.com/challenges/waypoint-iterate-with-javascript-while-loops has an issue. Please describe how to reproduce it, and include links to screenshots if possible.
"Let's try getting a for loop to work by pushing values to an array."
In this text the 'for' should be replaced by 'while'.

duplicate of #1802 which has been fixed


archive: Use lz4 compression

https://github.com/open-contracting/kingfisher-archive/pull/17

 Move Archive to S3 and decommission server


VSCode prompting for git  Credentials (macOS)

This just started happening yesterday. - Somewhere between GitHub and VSCode, VSCode has decided to request login credentials repeatedly. (VERY ANNOYING).
This is happening on multiple systems and for multiple accounts. I'm not the only one on my team experiencing this issue.
I don't know what you changed in GitHub or VSCode, but please change it back

VSCode Version: 1.36.1
OS Version: 10.14.6

Steps to Reproduce:

Clone repo
Make changes and commit / push in VSCode

Does this issue occur when all extensions are disabled?: Yes/No
YES

Does it happen when you perform actions with Git (pull/push) or just appear "randomly"?
Do you have "git.autofetch": true in your Workspace (especially if you have shared .vscode folder for project) or User settings?

Can you show me a screenshot of the prompt?

It's corrected itself again (I haven't had to re-enter a login since posting this)


Huez resets color to the default color everytime I try to change it

Huez worked the first time I set up a colorscheme with it but since then whenever I try to change a colorscheme with it it will resort to using the same color that ive first set up immediately after trying to change that color.
Steps to reproduce: this is my current config

return {
  event = 'BufWinEnter',
  'vague2k/huez.nvim',
  dependencies = {
    -- You probably already have this installed, highly reccomended you do.
    'nvim-telescope/telescope.nvim',
    -- If using vim.ui, this plugin will give you a better experience
    'stevearc/dressing.nvim',
  },
  config = function()
    require('huez').setup()
    local colorscheme = require('huez.api').get_colorscheme()
    vim.cmd('colorscheme ' .. colorscheme)
    vim.keymap.set('n', '<leader>co', '<cmd>Huez<CR>', {})
  end,
}

What version of neovim are you on? Have you checked that you're on the latest version? I'd start there.
I copy pasted your config and it stills works as intended for me


Python path broken under Linux

This line fails on Linux due to the path:
https://github.com/nimadez/mental-diffusion/blob/56c388515ec5a08857bc5cfaebda370a193e2ede/src/extension.js#L51
My ComfyUI install doesn't have a python_embeded folder. Ideally it should be using the venv's python. If this could be specified by setting variable, it'd work for both Linux and Windows.

MD updated to support user-defined Python path, please update, thank you.

There appears to be an error on the update.
https://github.com/nimadez/mental-diffusion/blob/7ae90be35954fbdcb23c70458cfa4e3ea9b0313c/src/extension.js#L55
It has an additional ComfyUI in the path, causing it to execute instead: . . ./ComfyUI/ComfyUI/main.py
Note the double ComfyUI

MD updated, user must specify ComfyUI source-code directory instead of root directory, please let me know if the problem is solved.

There must be a race condition or something. When I run ComfyUI standalone, Checkpoint and VAE combo boxes are populated correctly, when I allow the extension to start ComfyUI (it starts correctly), it doesn't populate them, no matter what I do.
ComfyUI folder: /media/Makai/home/Projects/AI/ComfyUI
With Python path: source /media/Makai/home/Projects/AI/ComfyUI/venv/bin/activate && python
Models won't load:

With Python path: /bin/false and pre-starting ComfyUI
Models load:

The issue has been fixed, but a different one arose.

Checkpoints are received from the ComfyUI server, this problem has nothing to do with paths. It is probably related to your ComfyUI installation method. I am looking for the cause of the problem to find a solution.

Checkpoints are received from the ComfyUI server, this problem has nothing to do with paths. I am looking for the cause of the problem to find a solution, but unfortunately I have not yet been able to reproduce the new issue.

Yeah, seems strange to me, the start commands look the same, ComfyUI starts correctly, binds to the port just fine, but it won't populate the combo boxes. Pressing Generate will send the command to ComfyUI but it'll complain that there is no model in the inputs while the MD UI waits forever. I'll be pre-starting ComfyUI in the meantime.


Can not get any examples to work

I'm very interested in this project but I cannot seem to even get out of the gate with it.
I grabbed the latest version and installed it. Added duke-core/, duke-lucene/,etc to CLASSPATH and I could run the executable
I then tried the LinkingCountries example. I got the raw CSV files, raw TXT file and raw XML file. When running I got an error which is fine I suppose....but someone should likely have an actual correct CSV file. I am not sure which file its having a problem with
Exception in thread "main" no.priv.garshol.duke.DukeException: Unbalanced quote in CSV file
at no.priv.garshol.duke.utils.CSVReader.next(CSVReader.java:110)
at no.priv.garshol.duke.datasources.CSVDataSource$CSVRecordIterator.findNextRecord(CSVDataSource.java:204)
at no.priv.garshol.duke.datasources.CSVDataSource$CSVRecordIterator.next(CSVDataSource.java:232)
at no.priv.garshol.duke.datasources.CSVDataSource$CSVRecordIterator.next(CSVDataSource.java:137)
at no.priv.garshol.duke.Processor$BasicIterator.next(Processor.java:677)
at no.priv.garshol.duke.Processor$BatchIterator.next(Processor.java:650)
at no.priv.garshol.duke.Processor$BatchIterator.next(Processor.java:633)
at no.priv.garshol.duke.Processor.link(Processor.java:331)
at no.priv.garshol.duke.Duke.main_(Duke.java:175)
at no.priv.garshol.duke.Duke.main(Duke.java:35)
I then tried the SemanticDogfood example. When running this I get errors about Lucene. I saw there was discussion about what version of Lucene to use so I tried 3.6.0, 4.0.0, and 4.8.0. For all of them I got the source and compiled with ant as per the Apache instructions, then put the lucene-core-4.8-SNAPSHOT.jar in the CLASSPATH also as Apache suggested and still all errors are either StandardAnalyzer or KeywordAnalyzer
Is there another resource to learn to set everything up? I am very interested in using this and pitching in if I can but I cannot get even the examples to work. Any help hugely appreciated.

Whoops sorry realized the trace of the Lucene errors was not included
java no.priv.garshol.duke.Duke --testfile=dogfood-test.txt --testdebug --showmatches dogfood.xml
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/lucene/analysis/standard/StandardAnalyzer
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:195)
at no.priv.garshol.duke.ConfigLoader.instantiate(ConfigLoader.java:291)
at no.priv.garshol.duke.ConfigLoader.access$100(ConfigLoader.java:31)
at no.priv.garshol.duke.ConfigLoader$ConfigHandler.startElement(ConfigLoader.java:199)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.startElement(AbstractSAXParser.java:509)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.scanStartElement(XMLNSDocumentScannerImpl.java:379)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2786)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:117)
at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1140)
at no.priv.garshol.duke.ConfigLoader.load(ConfigLoader.java:49)
at no.priv.garshol.duke.Duke.main_(Duke.java:64)
at no.priv.garshol.duke.Duke.main(Duke.java:35)
Caused by: java.lang.ClassNotFoundException: org.apache.lucene.analysis.standard.StandardAnalyzer
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 18 more

Similar Problem
I couldn't get the Genetic Algorithm example to work (see GeneticAlgorithm wiki). It looks like the csv files are corrupted in various ways.  I was able to start fixing the dbpedia csv file but I still haven't resolved issues with the monopedia file.
Does someone have csv files for the Genetic Algorithm example that are working?
The script I used to fix countries-dbpedia.csv is here. If there's no resolution, I can work on getting monopedia working next week.

I am not sure which file its having a problem with

Good point. I fixed it now so that it reports which file it is.

It turns out that there was a bug in the code that detects unbalanced quotes, and the bug wasn't detected by the test suite. I've fixed the bug now and added a test case for it so that it doesn't come back. Sorry about this.
Please check again, but the problems should be solved now. If they persist, please reopen the bug.


Build errors with boost::optional and other issues after fixing customFactor.h

Dear authors,
Thank you for providing this repository and the implementation of the algorithm. I have been working on integrating it with our real-world robots. After following the installation and build steps as outlined in the documentation, I faced the following error:

~/mr.cap/include/mrcap/customFactor.h:40:115: error: ‘boost::optional’ has not been declared.

I was able to resolve this by adding the following to customFactor.h:
using namespace boost;
#include <boost/optional.hpp>
#include <boost/make_shared.hpp>

However, even after this fix, I am still encountering several other errors, which I have not been able to resolve. I'm guessing that this could be related to version issues?
~/mr.cap/include/mrcap/FactorGraph.h:52:83:   required from here
/usr/include/boost/smart_ptr/make_shared_object.hpp:256:5: error: invalid new-expression of abstract class type ‘UnaryFactorObstacleAvoidance’
  256 |     ::new( pv ) T( boost::detail::sp_forward<Args>( args )... );
      |     ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /mr.cap/include/mrcap/Optimizer.h:28,
                 from ~/mr.cap/include/mrcap/MainWindow.h:20,
                 from ~/mr.cap/src/main.cpp:3:
~/mr.cap/include/mrcap/customFactor.h:64:7: note:   because the following virtual functions are pure within ‘UnaryFactorObstacleAvoidance’:
   64 | class UnaryFactorObstacleAvoidance : public gtsam::NoiseModelFactor1<gtsam::Pose2> {
      |       ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /usr/local/include/gtsam/nonlinear/NonlinearFactorGraph.h:25,
                 from ~/mr.cap/include/mrcap/Metrics.h:12,
                 from ~/mr.cap/include/mrcap/MainWindow.h:19,
                 from ~/mr.cap/src/main.cpp:3:
/usr/local/include/gtsam/nonlinear/NonlinearFactor.h:639:18: note:     ‘gtsam::Vector gtsam::NoiseModelFactorN<ValueTypes>::evaluateError(const ValueTypes& ..., gtsam::NoiseModelFactorN<ValueTypes>::OptionalMatrixTypeT<ValueTypes>...) const [with ValueTypes = {gtsam::Pose2}; gtsam::Vector = Eigen::Matrix<double, -1, 1>]’
  639 |   virtual Vector evaluateError(const ValueTypes&... x,
      |                  ^~~~~~~~~~~~~
In file included from /usr/local/include/gtsam/nonlinear/NonlinearFactorGraph.h:27,
                 from ~/mr.cap/include/mrcap/Metrics.h:12,
                 from ~mr.cap/include/mrcap/MainWindow.h:19,
                 from ~/mr.cap/src/main.cpp:3:
/usr/local/include/gtsam/inference/FactorGraph.h: In instantiation of ‘void gtsam::FactorGraph<FACTOR>::add(const FACTOR_OR_CONTAINER&) [with FACTOR_OR_CONTAINER = boost::shared_ptr<UnaryFactorObstacleAvoidance>; FACTOR = gtsam::NonlinearFactor]’:
~/mr.cap/include/mrcap/FactorGraph.h:52:34:   required from here
/usr/local/include/gtsam/inference/FactorGraph.h:242:14: error: no matching function for call to ‘gtsam::FactorGraph<gtsam::NonlinearFactor>::push_back(const boost::shared_ptr<UnaryFactorObstacleAvoidance>&)’
  242 |     push_back(factorOrContainer);
      |     ~~~~~~~~~^~~~~~~~~~~~~~~~~~~
/usr/local/include/gtsam/inference/FactorGraph.h:147:28: note: candidate: ‘template<class DERIVEDFACTOR> gtsam::FactorGraph<FACTOR>::IsDerived<DERIVEDFACTOR> gtsam::FactorGraph<FACTOR>::push_back(std::shared_ptr<_Yp>) [with DERIVEDFACTOR = DERIVEDFACTOR; FACTOR = gtsam::NonlinearFactor]’

Hello,
Glad you are giving my work a try.
Try checking out the following commit: GTSAM: 618ac28f2cc407e27e9eaf4e36ece64bc236b8e7 This is not ideal, but it may work. Theres some dependency conflicts in newer GTSAM versions.

@h2jaafar thank you, switching to this version resolved all the issues. I encountered a type error with sdf_s.obstacles, which I fixed by changing x, y, and z to type float.

Great to hear. Can you make a pull request and I can review it


Custom Dataset

Hi @Riboha
Thank you for uploading this great work. I have a couple of questions:

How can I test the code with my own dataset?
Is it necessary to have the trajectory.txt file if we don't care about the evaluation results? Can we use the pipeline with just pairs of RGB and depth frames?

BR

Hello,

It is not included in this repo. Adding GS-ICP SLAM capabilities to work with user's own datasets is on my plan, but I'm uncertain when this update will be released. I'm very sorry about this.
The ground truth trajectory.txt is only used for evaluating results. Therefore, if evaluation is not required, the ground truth trajectory is unnecessary.

Hello,

It is not included in this repo. Adding GS-ICP SLAM capabilities to work with user's own datasets is on my plan, but I'm uncertain when this update will be released. I'm very sorry about this.
The ground truth trajectory.txt is only used for evaluating results. Therefore, if evaluation is not required, the ground truth trajectory is unnecessary.
Thank you for your quick response. Just to clarify, will it not work if I provide the data in this format:

- scene
    - images (contain rgb images)
        - frame000000.jpg
        ...
    - depth_images (contain depth images)
        - depth000000.jpg

Amazing work ! I also would be interested in a bit more info to use with my own dataset


debug 17:46:15.388: VSCodeNotebookController::handleExecution, Class name = x (started execution)
debug 17:46:15.390: Execute Cell 0 c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb
debug 17:46:15.391: start the kernel, options.disableUI=false for c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb
debug 17:46:15.394: Start Jupyter Session in kernel.ts with disableUI = false
info 17:46:15.395: Starting Jupyter Session startUsingPythonInterpreter, .jvsc74a57bd04bac1da4ac38e89ef23c085a510331fc4a055c90eba44137a6551846acb4ac6f.c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe.c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe.-m#ipykernel_launcher (Python Path: c:\git\repository-cti\analytics\code\modules.venv, EnvType: Venv, EnvName: '.venv', Version: 3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]) for 'c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb' (disableUI=false)
debug 17:46:15.396: Creating raw notebook for resource 'c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb'
info 17:46:15.396: Computing working directory for resource 'c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb'
debug 17:46:15.398: Kernel Launcher. launch, Class name = r (started execution), Arg 1: {"id":".jvsc74a57bd04bac1da4ac38e89ef23c085a510331fc4a055c90eba44137a6551846acb4ac6f.c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe.c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe.-m#ipykernel_launcher","kernelSpec":{"interpreterPath":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe","isRegisteredByVSC":"registeredByNewVersionOfExt","name":"pythonjvsc74a57bd04bac1da4ac38e89ef23c085a510331fc4a055c90eba44137a6551846acb4ac6f","argv":["python","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","executable":"python","display_name":".venv","metadata":{"interpreter":{"path":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe"}},"env":{}},"interpreter":{"id":"C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES\.VENV\SCRIPTS\PYTHON.EXE","sysPrefix":"c:\git\repository-cti\analytics\code\modules\.venv","envPath":"c:\git\repository-cti\analytics\code\modules\.venv","displayPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"envName":".venv","displayName":".venv","envType":"Venv","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"},"path":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe"},"kind":"startUsingPythonInterpreter"}, Arg 2: 60000, Arg 3: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 4: "c:\git\repository-cti\analytics\code\modules", Arg 5: {"a":false,"b":null}
debug 17:46:15.398: Create activated Env, Class name = w (started execution), Arg 1: {"interpreter":{"id":"C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES\.VENV\SCRIPTS\PYTHON.EXE","sysPrefix":"c:\git\repository-cti\analytics\code\modules\.venv","envPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"displayPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"envName":".venv","uri":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","path":"/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","scheme":"file"},"displayName":".venv","envType":"Venv","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}},"resource":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","path":"/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","scheme":"file"}}
debug 17:46:15.398: Getting activated env variables, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe, Arg 3: undefined
debug 17:46:15.398: Getting activated env variables impl, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.398: Getting activated env variables ourselves, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.398: Got activation Env Vars from cached promise with key \C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES_C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES.VENV\SCRIPTS\PYTHON.EXE
debug 17:46:15.398: Getting activated env variables from Python, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.398: Get Custom Env Variables, Class name = S (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.401: Getting activated env variables ourselves, Class name = K, completed in 3ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.401: Got env vars ourselves c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe in 3ms with 64 variables
debug 17:46:15.401: Get Custom Env Variables, Class name = S, completed in 3ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.402: Getting activated env variables impl, Class name = K, completed in 4ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.402: Getting activated env variables, Class name = K, completed in 4ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe, Arg 3: undefined
debug 17:46:15.402: Create activated Env, Class name = w, completed in 4ms, has a truthy return value, Arg 1: {"interpreter":{"id":"C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES\.VENV\SCRIPTS\PYTHON.EXE","sysPrefix":"c:\git\repository-cti\analytics\code\modules\.venv","envPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"displayPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"envName":".venv","uri":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","path":"/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","scheme":"file"},"displayName":".venv","envType":"Venv","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}},"resource":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","path":"/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","scheme":"file"}}
info 17:46:15.437: Process Execution: > c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe -c "import ipykernel; print(ipykernel.version); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.file)"
c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe -c "import ipykernel; print(ipykernel.version); print("5dc3a68c-e34e-4080-9c3e-2a532b2ccb4d"); print(ipykernel.file)"
debug 17:46:15.496: Launching kernel in kernelProcess.ts, Class name = x (started execution), Arg 1: "c:\git\repository-cti\analytics\code\modules", Arg 2: ""
debug 17:46:15.497: Create activated Env, Class name = w (started execution), Arg 1: {"resource":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","path":"/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","scheme":"file"},"interpreter":{"id":"C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES\.VENV\SCRIPTS\PYTHON.EXE","sysPrefix":"c:\git\repository-cti\analytics\code\modules\.venv","envPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"displayPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"envName":".venv","uri":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","path":"/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","scheme":"file"},"displayName":".venv","envType":"Venv","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}}}
debug 17:46:15.497: Getting activated env variables, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe, Arg 3: undefined
debug 17:46:15.497: Getting activated env variables impl, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.497: Getting activated env variables ourselves, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.497: Got activation Env Vars from cached promise with key \C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES_C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES.VENV\SCRIPTS\PYTHON.EXE
debug 17:46:15.497: Getting activated env variables from Python, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.497: Get Custom Env Variables, Class name = S (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.498: Getting activated env variables, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe, Arg 3: false
debug 17:46:15.498: Getting activated env variables impl, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.498: Getting activated env variables ourselves, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.498: Got activation Env Vars from cached promise with key \C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES_C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES.VENV\SCRIPTS\PYTHON.EXE
debug 17:46:15.498: Getting activated env variables from Python, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.498: Get Custom Env Variables, Class name = S (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.500: Getting activated env variables ourselves, Class name = K, completed in 3ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.500: Getting activated env variables ourselves, Class name = K, completed in 2ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.501: Got env vars ourselves c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe in 4ms with 64 variables
debug 17:46:15.501: Get Custom Env Variables, Class name = S, completed in 4ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.501: Got env vars ourselves c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe in 3ms with 64 variables
debug 17:46:15.501: Get Custom Env Variables, Class name = S, completed in 3ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.501: Getting activated env variables impl, Class name = K, completed in 4ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.501: Getting activated env variables impl, Class name = K, completed in 3ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:15.501: Getting activated env variables, Class name = K, completed in 4ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe, Arg 3: undefined
debug 17:46:15.501: Getting activated env variables, Class name = K, completed in 3ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe, Arg 3: false
debug 17:46:15.501: Create activated Env, Class name = w, completed in 4ms, has a truthy return value, Arg 1: {"resource":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","path":"/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","scheme":"file"},"interpreter":{"id":"C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES\.VENV\SCRIPTS\PYTHON.EXE","sysPrefix":"c:\git\repository-cti\analytics\code\modules\.venv","envPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"displayPath":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv","_sep":1,"path":"/c:/git/repository-cti/analytics/code/modules/.venv","scheme":"file"},"envName":".venv","uri":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\.venv\Scripts\python.exe","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","path":"/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe","scheme":"file"},"displayName":".venv","envType":"Venv","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}}}
debug 17:46:15.511: Create activated Env, Class name = w (started execution), Arg 1: {"interpreter":{"id":"C:\DEV\PYTHON-3.10\PYTHON.EXE","sysPrefix":"C:\dev\python-3.10","displayPath":{"$mid":1,"path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"envName":"","uri":{"$mid":1,"fsPath":"c:\dev\python-3.10\python.exe","_sep":1,"external":"file:///c%3A/dev/python-3.10/python.exe","path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"displayName":"","envType":"Unknown","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}},"resource":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb","_sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","path":"/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","scheme":"file"}}
debug 17:46:15.511: Getting activated env variables, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe, Arg 3: undefined
debug 17:46:15.511: Getting activated env variables impl, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:15.511: Getting activated env variables ourselves, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:15.511: Get Interpreter details, Class name = x (started execution), Arg 1: "/C:/dev/python-3.10/python.exe"
debug 17:46:15.511: Got activation Env Vars without any caching. Key is \C:\GIT\REPOSITORY-CTI\ANALYTICS\CODE\MODULES_C:\DEV\PYTHON-3.10\PYTHON.EXE
debug 17:46:15.511: Getting activated env variables from Python, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:15.511: Get Custom Env Variables, Class name = S (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.513: Get Custom Env Variables, Class name = S, completed in 2ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.514: Interpreter details for c:\dev\python-3.10\python.exe from Python is {"internal":{"path":"C:\dev\python-3.10\python.exe","id":"C:\DEV\PYTHON-3.10\PYTHON.EXE","executable":{"uri":{"$mid":1,"fsPath":"c:\dev\python-3.10\python.exe","_sep":1,"path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"bitness":"64-bit","sysPrefix":"C:\dev\python-3.10"},"version":{"major":3,"minor":10,"micro":9,"release":{"level":"final","serial":0},"sysVersion":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"},"tools":[]},"id":"C:\DEV\PYTHON-3.10\PYTHON.EXE"} and our mapping is {"id":"C:\DEV\PYTHON-3.10\PYTHON.EXE","sysPrefix":"C:\dev\python-3.10","displayPath":{"$mid":1,"path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"envName":"","uri":{"$mid":1,"fsPath":"c:\dev\python-3.10\python.exe","_sep":1,"path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"displayName":"","envType":"Unknown","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}}
debug 17:46:15.514: Get Interpreter details, Class name = x, completed in 3ms, has a truthy return value, Arg 1: "/C:/dev/python-3.10/python.exe"
debug 17:46:15.514: Create ProcessService, Class name = h (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb"
debug 17:46:15.514: Get Custom Env Variables, Class name = S (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunNonPythonCode"
debug 17:46:15.514: Cached data exists getEnvironmentVariables, c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb
debug 17:46:15.514: Getting env activation commands, Class name = K (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:15.514: Getting activation commands for file:///c%3A/dev/python-3.10/python.exe
debug 17:46:15.514: Getting activation commands for file:///c%3A/dev/python-3.10/python.exe are not cached. May take a while.
debug 17:46:15.514: Get Custom Env Variables, Class name = S (started execution), Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
debug 17:46:15.514: Get Custom Env Variables, Class name = S, completed in 0ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunNonPythonCode"
debug 17:46:15.515: Create ProcessService, Class name = h, completed in 1ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb"
debug 17:46:15.516: Get Custom Env Variables, Class name = S, completed in 2ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: "RunPythonCode"
info 17:46:16.078: Got empty env vars with python c:\dev\python-3.10\python.exe in 567ms
debug 17:46:16.078: Getting activated env variables from Python, Class name = K, completed in 567ms, has a falsy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:16.078: Got env vars with python c:\dev\python-3.10\python.exe in 567ms with 0 variables
debug 17:46:16.079: Got env vars from Python faster, but empty c:\dev\python-3.10\python.exe
debug 17:46:16.080: Getting env activation commands, Class name = K, completed in 566ms, has a falsy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:16.081: Getting activated env variables ourselves, Class name = K, completed in 570ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:16.082: Got env vars ourselves c:\dev\python-3.10\python.exe in 571ms with 57 variables
debug 17:46:16.082: Getting activated env variables impl, Class name = K, completed in 571ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe
debug 17:46:16.082: Getting activated env variables, Class name = K, completed in 571ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/C:/dev/python-3.10/python.exe, Arg 3: undefined
debug 17:46:16.082: Create activated Env, Class name = w, completed in 571ms, has a truthy return value, Arg 1: {"interpreter":{"id":"C:\DEV\PYTHON-3.10\PYTHON.EXE","sysPrefix":"C:\dev\python-3.10","displayPath":{"$mid":1,"path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"envName":"","uri":{"$mid":1,"fsPath":"c:\dev\python-3.10\python.exe","_sep":1,"external":"file:///c%3A/dev/python-3.10/python.exe","path":"/C:/dev/python-3.10/python.exe","scheme":"file"},"displayName":"","envType":"Unknown","version":{"major":3,"minor":10,"patch":9,"raw":"3.10.9 (tags/v3.10.9:1dd9be6, Dec  6 2022, 20:01:21) [MSC v.1934 64 bit (AMD64)]"}},"resource":{"$mid":1,"fsPath":"c:\git\repository-cti\analytics\code\modules\Untitled-1.ipynb","sep":1,"external":"file:///c%3A/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","path":"/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb","scheme":"file"}}
info 17:46:16.195: Process Execution: > c:\dev\python-3.10\python.exe ~.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers\kernel_interrupt_daemon.py --ppid 11924
c:\dev\python-3.10\python.exe ~.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers\kernel_interrupt_daemon.py --ppid 11924
info 17:46:16.195: Process Execution: cwd: ~.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers
cwd: ~.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers
warn 17:46:17.033: Error output in interrupt daemon response 2023-01-04 17:46:17,031 UTC - ERROR - ERROR: handling command :INITIALIZE_INTERRUPT:0
Traceback (most recent call last):
File "c:\Users\flsantos.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers\kernel_interrupt_daemon.py", line 336, in handle_command
handle = interrupter.initialize_interrupt()
File "c:\Users\flsantos.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers\kernel_interrupt_daemon.py", line 298, in initialize_interrupt
child_proc_handle = OpenProcess(PROCESS_ALL_ACCESS, False, os.getpid())
File "c:\Users\flsantos.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers\kernel_interrupt_daemon.py", line 164, in OpenProcess
CheckError(hp, "failed to open process")
File "c:\Users\flsantos.vscode\extensions\ms-toolsai.jupyter-2022.11.1003412109\pythonFiles\vscode_datascience_helpers\kernel_interrupt_daemon.py", line 132, in CheckError
raise ctypes.WinError(ctypes.get_last_error(), msg)
PermissionError: [WinError 5] failed to open process
('END')
info 17:46:18.398: Got env vars with python c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe, with env var count 64 and custom env var count 57 in 2901ms
debug 17:46:18.399: Getting activated env variables from Python, Class name = K, completed in 2902ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:18.399: Got env vars with python c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe in 2902ms with 81 variables
info 17:46:18.465: Got env vars with python c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe, with env var count 64 and custom env var count 57 in 3067ms
debug 17:46:18.465: Getting activated env variables from Python, Class name = K, completed in 3067ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:18.465: Got env vars with python c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe in 3067ms with 81 variables
info 17:46:18.489: Got env vars with python c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe, with env var count 64 and custom env var count 57 in 2991ms
debug 17:46:18.491: Getting activated env variables from Python, Class name = K, completed in 2993ms, has a truthy return value, Arg 1: "/c:/git/repository-cti/analytics/code/modules/Untitled-1.ipynb", Arg 2: Uri:/c:/git/repository-cti/analytics/code/modules/.venv/Scripts/python.exe
debug 17:46:18.492: Got env vars with python c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe in 2994ms with 81 variables
info 17:46:19.002: ipykernel version & path 6.19.4, c:\git\repository-cti\analytics\code\modules.venv\lib\site-packages\ipykernel_init.py for c:\git\repository-cti\analytics\code\modules.venv\Scripts\python.exe

@flavaflav
I'm confused with your comment, when you say you are running into the same issue, do you mean you too cannot run cells, or it takes a long time or you get a prompt to select an interpreter?
Based on the logs, the elapased time is under 30s,
The extension starts at info 17:45:52.877 & the last log entry is info 17:46:19.002,
Or its possible you have not provided all of the logs

Hi, I tryed insider and it fail earlier because It can't pickup a python interpreter.

That looks like an error in the Python extension, if that does not work please file an issue on the Python extension repo as that would cause a lot of things to fail in the Jupyter extension as well.

@flavaflav I'm confused with your comment, when you say you are running into the same issue, do you mean you too cannot run cells, or it takes a long time or you get a prompt to select an interpreter?
Based on the logs, the elapased time is under 30s, The extension starts at info 17:45:52.877 & the last log entry is info 17:46:19.002, Or its possible you have not provided all of the logs

Hi, I tryed insider and it fail earlier because It can't pickup a python interpreter.

That looks like an error in the Python extension, if that does not work please file an issue on the Python extension repo as that would cause a lot of things to fail in the Jupyter extension as well.

Sorry. WillI  try again.
My problem is that I can´t have the jupyter notebook working within visual studio code. It gets Connecting to kernel forever.
The user interface was presenting a dialog telling it was trying to connect to a jupyter server endlessly.
Searching online I found this topic and your comments. You have pointed out a possible solution of  running the insider version. And this option is not useful right now right now because there are other issues on other plugins.
The time elapsed on the logs is under 30s just because it was the amount of time I spent to generate and collect the logs. For example: I'm trying running a simple "print(1)" inside a jupyter cell and it wasn't able to run for the last hour.
I also spotted an error message on the logs: "PermissionError: [WinError 5] failed to open process".
Any help would be appreciated.
Im running on Win10, corporate environment, lots of security policies aplied on my environment.

he logs: "PermissionError: [WinError 5] failed to open process".

That looks like an environment issue and not an issue with the extension. you might want to check with someone else who is aware of the security lock downs to understand what processes are blocked and how they can be unblocked.

This error is associated with this particular file: kernel_interrupt_daemon.py, line 132 (in v2022.11.1003412109).
There's any suggestion on what process this may be hitting some permission issue?

@hiramshirata Please could you provide the logs, without that I have no idea what error message you are running into.

Guess in my case has something to do with administrator privilegies, since a root user can use vscode jupyter with no problems.

@hiramshirata you are running into a different permission issue, thats' not realted to kernel taking a long time to connect.
Since this issue has been opened for a while and the original request for the information hasn't been provided for a while and there are no new issues and no new information related to this, i'm closing this.

hello! sorry for this late reply. I figured out the issue. There's a corporate firewall software that was blocking VSCode process and causing this issue, in my case a manual disable of this software did the trick. The software in question is the Avecto (beyond trust).
Long term solution, though, is due to VSCode not being yet certified, which will take place soon.
Thanks for your attention!

@kyanovsky I believe this has now been fixed in the latest pre-release version of the Jupyter extension. Please could you:

Install vscode insiders
Then install the latest pre-release version of the jupyter extension

The kernel should now work for you. Please let me know how this goes. I'm going to close this issue as this has been resolved. If not please feel free to re-open this issue, or create a new issue or ping me here.

I am using the latest version, and still suffers from the same problem:
Version: 1.77.3 (user setup)
Commit: 704ed70d4fd1c6bd6342c436f1ede30d1cff4710
Date: 2023-04-12T09:16:02.548Z
Electron: 19.1.11
Chromium: 102.0.5005.196
Node.js: 16.14.2
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.22621
Sandboxed: No
jupyter version: v2023.3.1201040234
ps: my vscode server is setup under very restricted internet access.
but i still wish my jupyter starts up instantly.

I just upgraded to latest VSCode and Jupyter extension and it's working for me. Thanks @DonJayamanne
Version: 1.77.3 (system setup)
Commit: 704ed70d4fd1c6bd6342c436f1ede30d1cff4710
Date: 2023-04-12T09:16:02.548Z
Electron: 19.1.11
Chromium: 102.0.5005.196
Node.js: 16.14.2
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.19045
Sandboxed: No
Jupyter v2023.3.1201040234

Hi, all
So sorry, I am not very familiar with Python. How can I do this in R. I am going to use this model to reduce the dimension of food items and handle the multilinearity. Much appreciate it if anyone can help me.


Probably a bug

It seems to me there is a bug in the base64 decode.
How could (enc3 == 64) on line 88, since you removed all paddings on line 59?
enc3 can never be 64 so that check seems unnecessary.
Similarly, the line
enc4 = this._keyStr.indexOf(input.charAt(j++));
seems wrong. If j>input.length, then input.charAt() = "" and indexOf("") =0, which is wrong since indexOf("A") = 0 as well. But your code works because in this case, i is already equal to bytes, so writing to uarray[i+1] writes outside of the actual array so it adds no new characters there.
https://github.com/danguer/blog-examples/blob/7614928e5f0968e078db2b0f2ac3624c96f9c7d5/js/base64-binary.js#L88

it actually is a bug.
padding = characters must not be stripped away before processing; otherwise the resulting output may have unwanted zero bytes at the end of the array (as much as the = stripped away)


feat(views): create global challenge-description component

Pre-Submission Checklist

[x] Your pull request targets the staging branch of freeCodeCamp.
[x] Branch starts with either fix/, feature/, or translate/ (e.g. fix/signin-issue)
[x] You have only one commit (if not, squash them into one commit).
[ ] All new and existing tests pass the command npm test. Use git commit --amend to amend any fixes.

Type of Change

[ ] Small bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds new functionality)
[ ] Breaking change (fix or feature that would change existing functionality)
[ ] Add new translation (feature adding new translations)

Checklist:

[x] Tested changes locally.
[ ] Closes currently open issue (replace XXXX with an issue no): Closes #XXXX

Description

@BerkeleyTrue As discussed, this PR addresses the issue originally addressed in #14986 but couples the challenges less closely with the stylesheets by implementing a global ChallengeInstructions component so that both the classic and backend challenge descriptions receive the same styles. Moved the less rules over to challenges.less, changing the namespacing of the instructions class names to challenges rather than classic.
A couple of notes:

could not get npm test to pass because of the propTypes objects in Back-End.jsx - it looks like since the redux form prop types are spread out into propTypes, the final result is not alphabetical. I didn't make any changes here, so I'm guessing the test was only triggered because I edited the file and that this is an issue that was encountered in the past?
I was getting some weird behavior with the challenges-instructions styles. Everything seems to work correctly (verified in main.css that all the rules look correct), but when making and saving changes in JS files, occasionally it would seem as if the styles weren't applied, then I'd make another change and they'd be back. So not sure what's up with that, but I believe the rules are correct.

Let me know if you think everything looks good.
This PR also makes a slight change to the backend challenges component to improve responsiveness at smaller screen resolutions. Previously, w/ xs={ 12 }, the result was too wide and content gets cutoff unless you scroll:

So just changed it all too xs={ 6 }, && xsOffset={ 3 }:

@no-stack-dub-sack Looks like there is some lint issue with the prop types in back-end.jsx proptypes.

@BerkeleyTrue Yeah, the warning is that prop types have to be alphabetical, but oddly, I didn't change the prop types at all as you can see from the diff.  It looks like since the redux form prop types are spread out into propTypes, the final result is not alphabetical - my guess anyway.
Could it be that this problem existed previously and the tests are only catching them because I edited the file?

@BerkeleyTrue Ok, all set.

@BerkeleyTrue Just checking in on this one

@BerkeleyTrue Thanks!
@raisedadead feel like giving a second review and/or merge?

Sure thing @no-stack-dub-sack

@raisedadead thanks man

Hi @no-stack-dub-sack
Is this expected?

Device: 13" MacBook, Chrome 58.0.3029.110
I'll get back with more details.

@raisedadead Sorry for the late reply - just getting back from a vacation out of the country. Hmm... I did not experience this, the navbar sizing is what you're talking about?
When I first started working on this the responsiveness was not working right as you can see from the original screenshots, but I didn't get this behavior when testing out my minor changes.

@raisedadead whoops - I see what I did. Thanks for catching this. I must have changed something at the last second after I took those screenshots. About to fix it and push up the changes.

Testing wise works just as expected. @BerkeleyTrue please merge if you think no more changes are to be done.

@raisedadead @BerkeleyTrue Thanks for the reviews guys! Looking forward to seeing this in there.

@BerkeleyTrue @raisedadead just noticed this was still open - can we merge?

@no-stack-dub-sack Thanks!
Happy Coding!


[WIP] publish meshcop service when thread is disabled [Run CI only]

Closing this PR because the CI doesn't run.


Verification of the use-cases corresponding to MDB_REVERSEKEY and MDB_REVERSEDUP DB flags enabled

LMDB flags MDB_REVERSEKEY and MDB_REVERSEDUP specify that keys and values are compared (not sorted) in reverse order (from last byte to to the first). Property reversed_flag can be specified to be std::true_type in key or value trait to propagate corresponding flags into lmdb database settings (functionality is already implemented);
It is required to verify the behaviour by integration tests:

implement traits for std::string with the reversed_flag;
check that the sorting respects reversed key comparison order.

Should be done after #5


[TextField] Uncontrolled Input components do not fully reset when inside a <form> with a reset button

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Steps to reproduce 🕹
Link to live example without using state: https://codesandbox.io/s/admiring-ishizaka-yjy2wk?file=/Demo.tsx
Link to live example using state: https://codesandbox.io/s/charming-grothendieck-r9zw8y?file=/Demo.tsx
Current behavior 😯
When I use certain components like radio buttons, checkbox, switch, textfiled, select, and autocomplete, I can't clear the value by pressing the reset button. When I click the reset button, the text inside the textfield gets cleared, but it will not shrink off the label.
If I use the above components with states then it will work properly (refer second codesandbox example above).
Expected behavior 🤔
Changes in the value of the above components will get reset while clicking on the reset button when we are not using the state (for the first codesandbox).
Context 🔦
No response
Your environment 🌎

npx @mui/envinfo
  System:
    OS: macOS 13.2.1
  Binaries:
    Node: 18.17.1 - ~/.nvm/versions/node/v18.17.1/bin/node
    Yarn: 1.22.19 - ~/.nvm/versions/node/v18.17.1/bin/yarn
    npm: 9.6.7 - ~/.nvm/versions/node/v18.17.1/bin/npm
  Browsers:
    Chrome: 116.0.5845.187
    Edge: Not Found
    Safari: 16.3
  npmPackages:
    @emotion/react: ^11.10.8 => 11.10.8
    @emotion/styled: ^11.10.8 => 11.10.8
    @mui/base:  5.0.0-alpha.127
    @mui/core-downloads-tracker:  5.12.2
    @mui/lab: ^5.0.0-alpha.128 => 5.0.0-alpha.128
    @mui/material: ^5.12.2 => 5.12.2
    @mui/private-theming:  5.12.0
    @mui/styled-engine:  5.12.0
    @mui/system: ^5.12.1 => 5.12.1
    @mui/types:  7.2.4
    @mui/utils:  5.12.0
    @mui/x-data-grid: 6.0.3 => 6.0.3
    @types/react: ^18.2.0 => 18.2.0
    react: ^18.2.0 => 18.2.0
    react-dom: ^18.2.0 => 18.2.0
    typescript: ^5.0.4 => 5.0.4

Hello @mj12albert,
I am having the same issue. Any update regarding this issue?

Please open separate issues for each component 🙏

Hi @mj12albert,
You have already mention this issue in #38374 for the TextField then also I have to create separate issue for all other components?


CMSIS-NN: conv unit test cases fail for non-unity dilation cases

@tensorflow/micro
System information

Host OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 16.04
TensorFlow installed from (source or binary): Source
Tensorflow version (commit SHA if source): 712fd5cfe4a5de420a4226c874664423eba4cb1a
Target platform (e.g. Arm Mbed OS, Arduino Nano 33 etc.): stm32f4

Describe the problem
The unit test cases which have dilation parameters not equal to 1 fail for cmsis-nn.
Please provide the exact sequence of commands/steps when you ran into the problem

Remove conv_test in exclusion filter list in target Makefile for stm32f4.

make -f tensorflow/lite/micro/tools/make/Makefile TAGS=cmsis-nn TARGET=stm32f4 test_kernel_fully_connected_test

I'll provide the fix for this.