docs2db.py hangs at max_seq_length 512

Hi @junruxiong thanks for the project, I am having some trouble generating the embeddings, some guidance would be appreciated 🙏
Describe the bug
docs2db.py hangs at max_seq_length 512
Using the default data given with EMBEDDING_NAME = hkunlpInstructorLarge
python docs2db.py

The file processing hangs at:
[nltk_data]   Package wordnet is already up-to-date!
[nltk_data]   Package wordnet is already up-to-date!
[nltk_data]   Package wordnet is already up-to-date!
Processing files: 100%|███████████████████████████| 1/1 [00:07<00:00,  7.91s/it]
load INSTRUCTOR_Transformer
max_seq_length  512

To Reproduce
Steps to reproduce the behavior:

Run python docs2db.py

Expected behavior
Embeddings to be created, however currently no embeddings are created in database_store folder.

Thanks for your help @junruxiong!
When docs2db.py is run, only the .sqlite3 file and the file_names.pkl is created:

Could it be something with my config? I made the following changes:

TOGETHER_API
MODEL_NAME = Together|togethercomputer/llama-2-70b-chat|None
EMBEDDING_NAME = hkunlpInstructorLarge

Config file used:
[tokens]
; Enter one/all of your API key here.
; E.g., OPENAI_API_KEY = sk-xxxxxxx
OPENAI_API_KEY = xxxxx
ANTHROPIC_API_KEY = xxxxx
TOGETHER_API_KEY = <redacted>
; if you use Meta-Llama models, you may need Huggingface token to access.
HUGGINGFACE_TOKEN = xxxxx
VERSION = 1.0.1

[directory]
; Directory for source files.
DOCS_DIR = ./data
; Directory to store embeddings and Langchain documents.
DB_DIR = ./database_store
LOCAL_MODEL_DIR = ./models

; The below parameters are optional to modify:
; --------------------------------------------
[parameters]
; Model name schema: Model Provider|Model Name|Model File. Model File is only valid for GGUF format, set None for other format.

; For example:
; OpenAI|gpt-3.5-turbo|None
; OpenAI|gpt-4|None
; Anthropic|claude-2.0|None
; Together|togethercomputer/llama-2-70b-chat|None
; HuggingFace|TheBloke/Llama-2-70B-chat-GGUF|llama-2-70b-chat.q4_K_M.gguf
; HuggingFace|meta-llama/Llama-2-70b-chat-hf|None

; The full Together.AI model list can be found in the end of this file; We currently only support quantized gguf and the full huggingface local LLMs.
MODEL_NAME = Together|togethercomputer/llama-2-70b-chat|None
; LLM temperature
TEMPURATURE = 0
; Maximum tokens for storing chat history.
MAX_CHAT_HISTORY = 800
; Maximum tokens for LLM context for retrieved information.
MAX_LLM_CONTEXT = 1200
; Maximum tokens for LLM generation.
MAX_LLM_GENERATION = 1000
; Supported embeddings: openAIEmbeddings and hkunlpInstructorLarge.
EMBEDDING_NAME = hkunlpInstructorLarge

; This is dependent on your GPU type.
N_GPU_LAYERS = 100
; this is depend on your GPU and CPU ram when using open source LLMs.
N_BATCH = 512

; The base (small) chunk size for first stage document retrieval.
BASE_CHUNK_SIZE = 100
; Set to 0 for no overlap.
CHUNK_OVERLAP = 0
; The final retrieval (medium) chunk size will be BASE_CHUNK_SIZE * CHUNK_SCALE.
CHUNK_SCALE = 3
WINDOW_STEPS = 3
; The # tokens of window chunk will be BASE_CHUNK_SIZE * WINDOW_SCALE.
WINDOW_SCALE = 18

; Ratio of BM25 retriever to Chroma Vectorstore retriever.
RETRIEVER_WEIGHTS = 0.5, 0.5
; Number of retrieved chunks will range from FIRST_RETRIEVAL_K to 2*FIRST_RETRIEVAL_K due to the ensemble retriever.
FIRST_RETRIEVAL_K = 3
; Number of retrieved chunks will range from SECOND_RETRIEVAL_K to 2*SECOND_RETRIEVAL_K due to the ensemble retriever.
SECOND_RETRIEVAL_K = 3
; Number of windows (large chunks) for the third retriever.
NUM_WINDOWS = 2
; (The third retrieval gets the final chunks passed to the LLM QA chain. The 'k' value is dynamic (based on MAX_LLM_CONTEXT), depending on the number of rephrased questions and retrieved documents.)

[logging]
; If you do not want to enable logging, set enabled to False.
enabled = True
level = INFO
filename = IncarnaMind.log
format = %(asctime)s [%(levelname)s] %(name)s: %(message)s

Hi, I reproduced your code according to your description. After running for about 30 seconds, my database_store generated the exact same file as yours, but after a few minutes, all the embedding files were generated.

May I ask if you still only have the chunks_small folder and file_names.pkl file after running the python docs2db.py command completely?

hi @junruxiong thanks for your help to replicate, might just be insufficient memory on my side 🤔
I'll just close this issue for now 🙏.


When adding a second contract in graph init, the location is the subgraph directory rather than the directory where the init command was made

This is confusing, e.g. when adding a local ABI

Thank you for flagging - I was running into the same issue and this helped


Cleanup Legal Text

Remove the legal text from our private files

Can one of the admins verify this patch?

If you really want to remove it, you can change to a minified version like https://github.com/uber/ios-snapshot-test-case/blob/master/FBSnapshotTestCase/FBSnapshotTestCase.h
But I highly recommend not removing the license from the files. We put it in for a reason.


Modify EnsureCert to support certs with IPs and usages

Add support for usages and ip address SANs in the cert requests

I think that's a great idea.  I'll do it in this PR.


CMake build issues on Linux.

Hello everyone, I was trying to build IREE by CMake on Linux and here some minor issues:

The SRCS path to file_io and file_mapping libs
https://github.com/google/iree/blob/master/iree/base/CMakeLists.txt#L64
Should the path be "internal/file_io_posix.cc" instead "file_io_posix.cc" and so on?
executable_cache needs iree::base::wait_handle which is commented out in https://github.com/google/iree/blob/master/iree/base/CMakeLists.txt#L349
Tensorflow path, should it be changed from
build_tools/third_party/tensorflow
to
third_party/tensorlow ?

By the way, as far as I understood you have own internal build system, do you have any plans to support stable build under Linux?
Thanks.

Hi! Good catches! We are still working to get the public build working (mostly stalled on figuring out a good way to build Tensorflow via cmake, as it currently only has bazel files), and once we have it working we'll be setting up a CI to ensure it remains buildable on Windows, Linux, and MacOS.
We use bazel internally and will be adding the build files to the public repo, but wanted to force ourselves to get cmake working first so that it's easier to consume the project (at least the runtime parts) from a non-bazel world. Worst case if we can't get Tensorflow building from cmake we'll have the compiler build with bazel but the runtime parts linked into applications will not need bazel at all.
We hope to have the compiler figured out in the next week or so (unless you or someone who has done things like this knows of any solutions!), and we'll update this issue as we make progress.

@benvanik thanks for the quick reply! This is good to know!

Update: much closer to building now - the iree-translate binary should build (at least on Windows) but there are still a few missing pieces:

[ ] SPIR-V translation (needs glslang CMake build/rules for handwritten kernels)
[ ] Flatbuffer writing/embedding rules to run the samples (invoke iree-translate and then embed the resulting binary in a header)
[ ] Non-TODO'ed ALWAYSLINK to prevent the need to pass all libs everywhere (for static registration)
[ ] lit test wrapper that makes proper ctests for CMake testing

I'll try to get these in this weekend at which point we should have the full end-to-end going. @ScottTodd is working on getting Swiftshader setup so that we can have the full Vulkan + SPIR-V path tested on CI's without GPUs, at which point we'll setup github actions (probably) for all platforms that perform the builds and run all tests.

@benvanik can you please clarify on "handwritten" kernels, sorry if it's a not right thread.
As far as I understood, plese fix me if I'm wrong, in general, loweing pipeline is:
TF Dialect (legalize, full convertion) -> XLA Dialect (legalize, partial convertion) -> IREE High level (legalize, full) -> IREE Low level.
I've skipped some passes which are described here  https://github.com/google/iree/blob/master/iree/compiler/Translation/Sequencer/SequencerModuleTranslation.cpp#L217
The result module is splitted on regions and for example some region could have math operation like "dot"
 %0 = iree.load_input(%arg0 : memref<1x128xf32>) : tensor<1x128xf32>
 %1 = iree.load_input(%arg1 : memref<128x10xf32>) : tensor<128x10xf32>
 %2 = "xla_hlo.dot"(%0, %1) {name = "dot.13", precision_config = ["DEFAULT", "DEFAULT"]} : (tensor<1x128xf32>, tensor<128x10xf32>) -> tensor<1x10xf32>
 iree.store_output(%2 : tensor<1x10xf32>, %arg2 : memref<1x10xf32>)
 iree.return

So, on the next stage of lowering it could be possible to lower "dot" into MLIR SPIR-V or instead specify to use "handwritter" kernel?
Thanks.

You're correct about the flow - we lower through XLA HLO and then allow the backends to do what they want with that. So for the dot in your example above we lower that to an interpreter matmul_f op when we are running on the CPU (which then uses Ruy to perform the GEMM) but in SPIR-V land we (today) lower it to a handwritten kernel (https://github.com/google/iree/blob/master/iree/compiler/Translation/SPIRV/Kernels/matmul.comp). xla_hlo.dot is special, though, and currently the only op we have a handwritten kernel for. All other ops are automatically generated into SPIR-V.
This is because GEMMs are the most performance heavy op we have and it's not clear that the automatic lowering will be able to achieve matching performance for awhile (if ever). There's also a lot of vendor-specific magic that we want to take advantage of such as Nvidia's cooperative matrix extension (which would be even more difficult to generate code for).
So the idea is that we can optionally have handwritten implementations but default to generating automatically. An improvement that will be added soon is fusing into the handwritten kernels so that we can merge generated and handwritten IR. Over time we could hopefully remove all handwritten kernels (which, again today is just xla_hlo.dot).

@benvanik thanks for detailed explanation!

@benvanik I'm not sure is ok to report some build issue or not, since it still under development, please let me know if it's not needed.

It seems like those flags  https://github.com/google/iree/blob/master/build_tools/cmake/iree_copts.cmake#L31 are "unrecognized" at least by gcc,

cc1plus: warning: command line option ‘-Wno-strict-prototypes’ is valid for C/ObjC but not for C++
cc1plus: warning: unrecognized command line option ‘-Wno-documentation-unknown-command’
cc1plus: warning: unrecognized command line option ‘-Wno-documentation’
cc1plus: warning: unrecognized command line option ‘-Wno-gnu-label-as-value’
cc1plus: warning: unrecognized command line option ‘-Wno-missing-variable-declarations’
cc1plus: warning: unrecognized command line option ‘-Wno-unused-private-field’
cc1plus: warning: unrecognized command line option ‘-Wno-unreachable-code-return’
cc1plus: warning: unrecognized command line option ‘-Wno-shadow-field-in-constructor’
cc1plus: warning: unrecognized command line option ‘-Wno-gnu-zero-variadic-macro-arguments’
cc1plus: warning: unrecognized command line option ‘-Wno-shadow-uncaptured-local’
cc1plus: warning: unrecognized command line option ‘-Wno-unused-local-typedef’

the problem accurs when some third party package has "Werror" flag, in this case the build fails.
My workaround was to add "-Wno-error" to the end of the CMAKE_CXX_FLAGS.

Build issues are still useful to track, thanks for trying what exists so far!
Yes, the flags aren't compatible with gcc. We've primarily been using clang.

@ScottTodd got it, thanks!

@benvanik The iree-translate binary also builds under Linux (using clang). Anyway, the CMakeLists.txt files need some tweaking to get the build running. If there is interested, I can submit PRs within the next week for the patches I have written so far.

If you've got tweaks to the cmake configs to make things build with clang, we'd happily accept PRs. I'm working on getting us some proper CI on the OSS side so that we can stay on top of these.

FYI we now have a cmake CI, although it excludes the compiler portion of IREE (and therefore the MLIR dependencies). When we do get them working, I can change the option to add these to the CI.

Let's close this issue, as most of the problems in the initial report have been resolved.


Feature Request: Integration with Apollo Router

Discussed in https://github.com/kamilkisiela/graphql-hive/discussions/159

Originally posted by oo00spy00oo June 23, 2022
The next version of Apollo Gateway is Apollo Router with description here: https://www.apollographql.com/docs/router
Need a plugin for integrate between Hive and Apollo Router.
Regards.

#158


Changing idol images

Allow the user to be able to change the image of an idol when its informations are displayed.

Thank you very much for your contribution! That's a great improvement.


Phantom border on second monitor

OS:
Running the latest build downloaded yesterday on Win7 x64, Dark Theme
Issue Descriptions:
When the player is maximized under multiple monitors a phantom border appears on the monitor to the left. In this case, two 1080p monitors in left/right respectively. When the application is maximized on the right hand monitor, the right edge of the left monitor displays a phantom border.
Note that the border in question is roughly the same height of the application when windowed. Vertically resizing in windowed mode then maximizing presents you with a phantom border of roughly the same height before maximizing.
Steps to Reproduce:

Open the player and make sure it's windowed and not maximized in the right hand monitor.
Take note of the height of the player window.
Maximize the window.
Observe a new phantom border along the right hand edge of your neighboring monitor to the left.
Resize the window and repeat as necessary.

I see what is probably the same thing on Windows 10, Dark Theme

Just to confirm, this also happens under the light theme as well as with any other custom theme options.

Posting this screenshot here too, since it is relevant to this thread as well.
You can see the 8px ghost border on the left hand side in the screenshot taken while maximized on my rightmost 1920×1080 monitor. Note that the screenshot dimensions are are 1928×1090 – apparently there are black borders above and below as well.

Raised upstream https://github.com/electron/electron/issues/5267

Enabling the option to use the system windows border makes this go away, it's a little less pretty but no phantom border appears when this option is on and the window is maximized.

Closing as upstream (that's how we roll)


How do I embed this into my site?

I couldn't find anything in the docs about how to embed this onto my own site or if it's even possible. StackEdit looks great, hope I can use it!

+1

benweet commented on Oct 24, 2013
Sorry, StackEdit is not embeddable. However you can embed Pagedown. In StackEdit, I use a fork of Pagedown to work with ACE editor.


Curiosities - Could SEN50 be made to return temp/humidity in all methods that return them?

Hey, I've got all three models, and using the measureValues as floats works nicely for the 55+54, but the 50 returns failed temp+humidity values (NAN) and valid particle counts (and expected NANs for nox/voc).
I do know that there's a separate method for the sen50, but could the other method be made to not fail, as that would make most peoples lives easier. Don't drop the method for the 50, but make the other methods work as far as possible for the 50.
Thanks ❤
Also on the curiosities front, I just got 3 new (one of each) sensors, and previously just had a single SEN55 from the same supplier. I've found the new lot to be vibrating more than expected (fan vibrations). Particularly when held by both sides between thumb and forefinger, from next to cable to edge of QRcode. Is this expected to be quite a lot, and how would one even measure such a thing?
Is there a batch number or anything in the QRcode that tells me which fan I've got if you've used more than one?

I'm a muppet, it turns out I think (not mentioned on product page) that there is no temp/humidity on the SEN50. Woopsie.
Still curious about the vibration question 🤷

Hi,
The vibration could be caused by the fan auto cleaning where the fan runs on the highest speed. The difference between the SEN50 and SEN55 is only the sensors available in the module.
Both use the same particulate matter sensor. Of course it is possible that the fan vibration is not exactly the same for each module. As far as I am aware of, the same fan should be used in all modules. Since we don't produce them on our own there might be some variation between batches within the specs.

Thanks that's confirmed my own thoughts. I assume they don't do a clean on first measure though (thought it was a day or 7 away unless changed).


PERF: Make ingestion for neo4j use CSV imports

Currently importing is a bit slower than expected with direct queries. According to neo4j docs, CSV importing seems to provide better performance for ingesting our data. This issue is around taking a look, evaluating and implementing which technique should be used for GUAC.
https://neo4j.com/developer/guide-import-csv/
https://neo4j.com/blog/bulk-data-import-neo4j-3-0/

FYI: @mihaimaruseac


Ask clarifying question to understand context skill.

Re-adding Ask clarifying question to understand context skill PR #294

@instructlab-bot precheck

@instructlab-bot generate

It seems that the teacher model does not currently have the capability to generate quality synthetic data for this skill. This will be closed for now. If we make changes to the teacher model please feel free to resubmit for testing again!

It seems that the teacher model does not currently have the capability to generate quality synthetic data for this skill. This will be closed for now. If we make changes to the teacher model please feel free to resubmit for testing again!

Is that based on the qarating values here?

No so much the qa ratings but the "inputs" field. This is the field that contains the generated questions from the synthetic data generator. As you can see, it seems fairly confused and generates the clarifying question as the questions.

Ok so based on the icl_q and icl_a we try to generate inputs (questions) and targets (answers) that are similar to what I've submitted?
I'm curious what a successful "inputs" value would be for something like this?


The Repercussions of a Yes vote victory in the 1995 Quebec independence referendum

Having done some research it appears that the effects of a yes victory in the 1995 Quebec independence referendum were more significant in determining the territorial stability of Canada than I had ever imagined. Both sides of the referendum didn't have any sort of plan to deal with a yes vote victory, since the Canadian government at that time assumed that the no vote would almost certainly win. However the results were far closer than they had anticipated therefore the Canadian government could be woefully unprepared for a yes victory in that referendum. In 2014 Roy Romanow the former Premier(Governor) of Saskatchewan revealed than in 1995 he had set up a secret committee to develop contingency plans in the event of a Yes vote in the 1995 Quebec referendum even though he was pretty much in favour of a united Canada.
Those contingency plans were

Saskatchewan seceding from Canada
Creating a Western union of Saskatchewan, Alberta and British Columbia independent of Canada.
Abandoning the Canadian dollar to use the U.S. greenback
The annexation of Saskatchewan to the United States.

While all of these contingency were unlikely to occur in the event of a yes victory in the referendum, it just goes to show how chaotic the situation could have been in Canada if the yes vote won in the referendum and Quebec seceded shortly afterwards.
Sources
http://www.macleans.ca/politics/ottawa/what-would-have-come-after-a-yes/
http://www.cbc.ca/news/canada/saskatchewan/saskatchewan-considered-separation-roy-romanow-reveals-1.2744298
http://www.nationalnewswatch.com/2014/08/22/saskatchewan-considered-separation-roy-romanow-reveals/#.WKnqP2_yjIU

Post this in the NWO thread and see if any Canadian player has input.
btw :) please link the sources in the text. It takes more time than necessary to read all to find where substance for a claim comes from. In this case the two last sources is the same article.
like:
Saskatchewan revealed than in 1995 he had set up a secret committee to

Dveduu
Canadian here. Never heard of Saskatchewan secession, and I don't think many people would take the idea seriously.
Now, Western secession has been talked about. Political alienation of the western provinces of British Columbia and Alberta has been known to happen- especially under Liberal governments whose power centers are in Ontario and Quebec. For example, Pierre Trudeau's National Energy Program still makes Albertans unhappy.
The main problem is BC and AB are two of the "have" provinces, and along with Ontario they pay a lot of money to the maritime provinces. There is more trade and travel between Washington state and BC than between BC and the maritimes. The idea of an independent country west of the cascade mountain range has been proposed https://en.wikipedia.org/wiki/Cascadia_(independence_movement)
Ultimately there isn't a particularly strong sense of national unity or identity in Canada, except in the case of Quebec. So I think it is entirely realistic to have Quebec as the only releasable nation in Canada.

I think this issue needs more feedback from Canadian player£.

Yes, absolutely, but for now I would go with the one presented by Dveduu "So I think it is entirely realistic to have Quebec as the only releasable nation in Canada.". I.e. Close this and focus on other maybe more pressing issues.

Upon thinking the on the issue more I have come up with several ideas for events and decisions that could happen in the aftermath of a yes vote victory in the Quebec independence referendum in 1995.  First of all Quebec seceding in 1995 could raise separatist sentiment in neighbouring province of Newfoundland and Labrador as it has only been part of Canada since 1949 and it appears there is some local frustration with the level of control Toronto has over Newfoundland's economy.
https://www.google.ie/amp/www.cbc.ca/amp/1.410339
http://www.thetelegram.com/news/regional/2010/7/1/senator-warns-of-newfoundland-separatism-1451626.html
Another idea I've though of is what could Quebec's relations with France could be like. I suppose it's  both countries try to create a political and economic union similar to CANZUK if Quebec becomes independent. Also I wonder if Quebec would actually try to gain St. Pierre et Miquelon and the French speaking parts of the Maritime provinces. Back to the potential economic and political union of France the reason I was suggesting it was because it appears the U.S wouldn't recognise Quebec and prevent it from joining NAFTA if the yes vote referendum possibly as part of a retaliation for the referendum destabilising Canada a major ally of the U.S.
https://www.google.ie/amp/s/sec.theglobeandmail.com/news/politics/white-house-documents-reveal-how-us-would-react-if-quebec-had-separated/article17499442/%3Fservice%3Damp


Re-add space in between multiple authors

Upstream: https://github.com/NASA-IMPACT/nasa-apt/issues/827
From https://github.com/NASA-IMPACT/nasa-apt-frontend/pull/577#issuecomment-2004907190

@bwbaker1 we re-added the space in between multiple initials. It's ready for your review on staging.


SW-1939 Remove scheduled state transition dates

In v1, the user would enter dates for things like the accession being ready to
move to a drying rack, and the system would use those dates to figure out the
correct accession state at any given time.
In v2, there are no more time-based state transitions and most of the v1
user-supplied dates are no longer shown in the UI (with the exception of the
drying end date, which now just generates a notification rather than causing a
state transition).
Remove the unused date fields from AccessionModel.

Current dependencies on/for this PR:

main

PR #741

PR #742

PR #743

PR #744   👈

This comment was auto-generated by Graphite.

Current dependencies on/for this PR:

main

PR #741

PR #742

PR #743

PR #744   👈

This comment was auto-generated by Graphite.


Update get_translated_payload method in ManagementFeature

Rationale
The function requires the bot's tree for working accordingly
Summary of changes made
It adds bot.tree as parameter for the function
Checklist

[x] This PR changes the jishaku module/cog codebase

[ ] These changes add new functionality to the module/cog
[x] These changes fix an issue or bug in the module/cog
[x] I have tested that these changes work on a production bot codebase
[x] I have tested these changes against the CI/CD test suite
[ ] I have updated the documentation to reflect these changes

[ ] This PR changes the CI/CD test suite

[ ] I have tested my suite changes are well-formed (all tests can be discovered)
[ ] These changes adjust existing test cases
[ ] These changes add new test cases

[ ] This PR changes prose (such as the documentation, README or other Markdown/RST documents)

[ ] I have proofread my changes for grammar and spelling issues
[ ] I have tested that any changes regarding Markdown/RST syntax result in a well formed document

The function signature doesn't indicate that this should be necessary. Can you explain why you thought this change was necessary (and ideally include any supporting errors or other info you can about what lead you towards this fix)?

It errors, but now that I look properly into source code, it has to do with how it works for hybrid commands.
https://github.com/Rapptz/discord.py/blob/425edd2e10b9be3d7799c0df0cd1d43a1a34654e/discord/app_commands/transformers.py#L93, as hybrid commands require the tree and the translator. (Therefore this PR breaks normal app commands, so please don't merge)

I see. Part of how this code works might need to be rewritten to make it support both cases, I haven't really used hybrid commands so I guess I've never run into this. I imagined there might be some need to refine and update the sync procedure anyway since it deviates from how the discord.py public API intends for the sake of better diagnostics, so I'll probably need to make some kind of test harness to make sure I'm not missing things when maintaining it.

https://github.com/Rapptz/discord.py/blob/425edd2e10b9be3d7799c0df0cd1d43a1a34654e/discord/ext/commands/hybrid.py#L299

https://github.com/Rapptz/discord.py/blob/425edd2e10b9be3d7799c0df0cd1d43a1a34654e/discord/app_commands/tree.py#L1060

I am looking tree.sync function, it looks same.
And I have never seen that report

@Gorialis fyi, this issue is only present in the (currently experimental) feature/user_apps branch of discord.py.
This is caused by a change in app_commands.Command.to_dict's signature, where a new tree argument was added. Permalink to the change | Link to latest feature/user_apps commit

Change has been merged in master, jishaku's sync command no longer works with Master Branch

Can confirm:
May 07 23:24:59 contabo-vps python[1054883]:     ret = await coro(*args, **kwargs)
May 07 23:24:59 contabo-vps python[1054883]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 07 23:24:59 contabo-vps python[1054883]:   File "/home/jdjg/JDBot/.venv/lib/python3.11/site-packages/jishaku/features/management.py", line 246, in jsk_sync
May 07 23:24:59 contabo-vps python[1054883]:     payload = [command.to_dict() for command in slash_commands]
May 07 23:24:59 contabo-vps python[1054883]:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 07 23:24:59 contabo-vps python[1054883]:   File "/home/jdjg/JDBot/.venv/lib/python3.11/site-packages/jishaku/features/management.py", line 246, in <listcomp>
May 07 23:24:59 contabo-vps python[1054883]:     payload = [command.to_dict() for command in slash_commands]
May 07 23:24:59 contabo-vps python[1054883]:                ^^^^^^^^^^^^^^^^^
May 07 23:24:59 contabo-vps python[1054883]: TypeError: Command.to_dict() missing 1 required positional argument: 'tree'

Because this change still hasn't hit PyPI release, this PR can't be merged until it is ensured that this change doesn't break users who aren't on master branch.

Because this change still hasn't hit PyPI release, this PR can't be merged until it is ensured that this change doesn't break users who aren't on master branch.

It could handle the error? If this gets merged, it will error for dpy <2.4 users anyways.

Superceded by #235


Clean up devices with no entities

Describe the bug
When switching meters, HA ends up with multiple devices (one for the new meter and one for the old meter). The device associated with the old device has no entities associated with them. This originates from https://github.com/BottlecapDave/HomeAssistant-OctopusEnergy/discussions/749
Reproduction steps
Switch physical meters
Expected behaviour
Any device that is no longer associated with a meter should be removed automatically.
Tariff Code
N/A
Integration Version
10.1.0
Home Assistant Version
2024.2.1
Fresh Install?
Not specified
Home Assistant Logs
N/A
Confirmation

[X] I confirm that I cannot find my solution within the documentation
[X] I confirm that I cannot find my solution within the FAQ

This was resolved in 10.1.2


Different format to old Fox cloud data?

I think I am seeing an issue with older Fox cloud data;
I was pulling data from Sept 2021 to upload to PVOutput and received an error when uploading.
It looks like PV data (generation) and Export figures are incorrect. Load (Consumption) and Import seem about right.
Using the Google colab method this is what I get for 7 Sep 2021;
20210907,567661,10900,531200,06:46,,,,,0,0,199,0,10299,,,,
Which PVOutput did not like as values in position 2 and 4 were too large.
Manipulating the Fox data report in Excel gets me these values which seem more likely;

BUT.... if I run the Google colab method on recent data (I tried 30 Aug 2023) , the values come out more or less the same as data that Foxcloud & HA are reporting (so not an issue with the code).
Something at the back of my head is remembering the format of the Fox data report changing at some point, but I can't be sure, or pin down a date!
I posted this as an issue but it is more just for info if anybody is using it on an older Fox system.
It's not impacting me as I'm getting round it by downloading Fox data reports, manipulating them in Excel and creating CSV data to upload.

BTW - looking at your data, there appears to be a spike in the PV Power 06:40. These are the max power and time from the Fox cloud:
531200,06:46
So, Fox is saying you generated 531.2 kW at 06.46 in the monning...
I suppose I could look for exterme data values like this and zero them out if they appear in the data?

I've uploaded v0.3.5 that includes a check on the max solar power generation. Do you want to check again to see if you get a sensible value now for 2012-09-07? It should generate some warnings so we can see how many bad data points there are.
To run it, go to Runtime menu in Colab and select Restart Runtime and re-run cell 1. It should sign on with v0.3.5. Then set start_date to '2021-09-07 and generate the upload and see if the pv generation data looks more sensible?
I'd be interested to see what output it produces as I don't know how many other people might get this same problem.

Hi Tony,
Thanks for this I won't be able to get on to this today but will give it a
try Sunday evening or Monday.
Cheers
On Fri, 1 Sept 2023 at 20:52, TonyM1958 @.***> wrote:

I've uploaded v0.3.5 that includes a check on the max solar power
generation. Do you want to check again to see if you get a sensible value
now for 2012-09-07? It should generate some warnings so we can see how many
bad data points there are.
To run it, go to Runtime menu in Colab and select Restart Runtime and
re-run cell 1. It should sign on with v0.3.5. Then set start_date to
'2021-09-07 and generate the upload and see if the pv generation data looks
more sensible?
I'd be interested to see what output it produces as I don't know how many
other people might get this same problem.
—
Reply to this email directly, view it on GitHub
https://github.com/TonyM1958/FoxESS-Cloud/issues/1#issuecomment-1703253243,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQQRDKMHQCXVUQK5C4RVMJLXYI4H3ANCNFSM6AAAAAA4HWKRBA
.
You are receiving this because you authored the thread.Message ID:
@.***>

Hi @TonyM1958, good news and bad news....!
I quickly ran the v0.3.5 yesterday on some of my earlier data (June 2021) and it seemed to work.
Originally (with v0.3.4) all the PV data I was missing from 16/6/21 to 07/09/21 was incorrect, as shown here;

But the first running of 0.3.5 fixed that for June 👍 , so I reran it for June-Sept and broke Google colab somehow with various errors.
Just taken another look today, now on v0.3.6 and get this error trying to get those 84 values from 16/6/21 - 7/9/21....

Code in input cell matches your example (as far as I can see), any thoughts?
But I can confirm that the first time I ran it it worked and values looked sensible. I didn't get chance to check against values I dumped from Fox data report as I ran it again and came up with the error.

OK, I'm away for a few days so can't easily update the code. The error is my fault- its complex but I temporarily zero'd out the data with values over 50000 in your data. The code then looks further minimum value and picks up zero and then after scanning the values goes back to work out the time the data was zero. But this value does not exist anywhere in the original list - hence the error zero not in list...
The bizarre thing is that means even when it's dark, your PV power was never zero over a complete 24 hour period.. so I think I really need to get a dump of the data that's causing this problem to see what is really going on and how best to handle it.
Can I get back to you on Wednesday?

Absolutely not a problem Tony.
I have now got my older data (pre my manual records/HA) in PVOutput anyway,
using the FoxCloud data reports & a bit of Excel manipulation/integration.
I was just letting you know in case anyone else runs across this problem.
Cheers
On Sun, 3 Sept 2023 at 16:41, TonyM1958 @.***> wrote:

OK, I'm away for a few days so can't easily update the code. The error is
my fault- its complex but I temporarily zero'd out the data with values
over 50000 in your data. The code then looks further minimum value and
picks up zero and then after scanning the values goes back to work out the
time the data was zero. But this value does not exist anywhere in the
original list - hence the error zero not in list...
The bizarre thing is that means even when it's dark, your PV power was
never zero over a complete 24 hour period.. so I think I really need to get
a dump of the data that's causing this problem to see what is really going
on and how best to handle it.
Can I get back to you on Wednesday?
—
Reply to this email directly, view it on GitHub
https://github.com/TonyM1958/FoxESS-Cloud/issues/1#issuecomment-1704338032,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQQRDKJYNQ2ZVD3BIC3FVG3XYSQLRANCNFSM6AAAAAA4HWKRBA
.
You are receiving this because you authored the thread.Message ID:
@.***>

I've updated and added some code to v0.3.7.
If you open your notebook in Colab after you haven't used it for a few hours, hopefully it will sign on with v0.3.7 when you run the first cell. If not, you may need to go to Runtime, Disconnect and delete. Close the notebook and then re-open it in Colab. It should load a fresh runtime and download the latest code.
Once you have this running, please can you add a line to a new, empty cell at the bottom of the notebook:
f.get_raw('day', d='2021-06-16', v='pvPower', save='pvPower')

I've made some changes, so hopefully this won't now crash getting the min or max values.
You can change the date if you wish. Each time it runs, it print some data in the output window and write a file named pvPower_raw_day_20210616.json. This contains the raw data that the Fox cloud is returning for the day. You can download this file and attach it and I can then see the 5 minute sample PV power data for that day - 288 samples per file.
It can take a few minutes before Colab rescans the folder and it appears folder view (click the folder in the LH margin to show/hide the file viewer). Feel free to have a look at the downloaded file in a text editor to check you are happy with the data and there is no personal data.
Also note, if you disconnect or leave the runtime idle for a period, it will probably delete the files if you didn't download them - but you can run the cell again to recreate the data any time.

ps - it would also help to know what you think your generation actually might have been for the day you provide data for!

Thanks @TonyM1958
Followed your instructions and it worked great.  This is for 16/06/21.
Had to rename the JSON to TXT as upload wouldn't allow it.
pvPower_raw_day_20210616.txt
This is what I think my data is for that day......
(Fox data report into Excel, then P=IV for each array and summing them to get total PV for both arrays, evaluating import or export power based on meter power, then integrating all power values based on time between readings).
Date | Sum   of TotPV | Sum   of Load kW | Sum   of Exp | Sum   of Imp
16/06/2021 | 25.7 | 13.0 | 8.3 | 0.7
Apols for the formatting, it's a paste from a Pivot Table. Let me know if you want it with more granularity as I have the raw data like this;

@TonyM1958 Thanks for looking at this, and no, it doesn't make any sense to me either !!
I haven't got data from the API before, just the Fox data download. So no PvPower in that just the array I & V data.
I am OK with the data I have, and the calculated import/export data ties in with my supplier (+/-), so the cloud data and my integration method seem ok.
Don't spend any more time on this Tony!
Appreciate all your hard work getting us access to the data.
I raised the issue just in case anyone else was seeing similar issues, and suggesting there is a way around it using the cloud data.
There is still someting nagging me about the Foxcloud data reports though !
A few months after my install I wanted to start recording data and used the Fox data reports to get this.
I vaguely remember some extra fields appearing in the CSV at some point after that & I had to change my XLS accordingly.
I then got HA working with macxq integration so ditched the XLS analysis.
So maybe Fox changed format of the data report and the API output changed too?

To me, this looks like it might be PV1 + PV2 Voltage. Its the middle of summer, so the days are quite long, I suppose. Does this make any sense to you?

Don't know if you saw this edit I made shortly after posting? Fox report this data as pvPower with a unit of kW but as the value at midnight is 6.9 and PV1 Voltage = 3.6 and PV2 Voltage = 3.3, it looks like their data is actually PV1 Voltage + PV2 Voltage. Still doesn't make sense but may point to a historic database error of some sort.
I don't think this data is fixable for you, and you are happy with what you have - but I am concerned about how many others might come across a similar problem so would like to frame this in the code so it returns good data where possible.
The code is pretty flexible... here are a couple of cells I'd like you to run if that's OK with you?
for d in f.date_list('2021-06-16', '2021-09-30'):
    result = f.get_raw('day', d, v=['pvPower'], summary=2)
    max = result[0].get('max')
    if max is not None and max > 0 and max < 100:
        print(f"{d} is valid, max pvPower = {max}kW")
        break

This looks at your pvPower data from 2021-06-16 to 2021-09-30 and checks the maximum value in the day. If it's voltage, the max will be over 100v but power generation should never be over 100kW - so it should show the first day when the power data is sensible.
for d in f.date_list('2021-06-16', '2021-09-30'):
    result = f.get_raw('day', d, v=['pv1Volt', 'pv1Current', 'pv2Volt', 'pv2Current', 'pvPower'], summary=1)
    wh = 0.0
    for i,data in enumerate(result[0]['data']):
        wh += result[0]['data'][i]['value'] * result[1]['data'][i]['value'] / 12   # pv1Volt * pv1Current / 12
        wh += result[2]['data'][i]['value'] * result[3]['data'][i]['value'] / 12   # pv2Volt * pv2Current / 12
    print(f"{d}: generation from IV = {round(wh/1000,3)}kWh, generation from pvPower = {result[4]['kwh']}kWh")

This cell replicates  what you did and downloads the PV1/PV2 Voltage and Current data and integrates this to produce the pv Power and compares this with what the Fox data says. Just want to check that this agrees with your calculated data.
You can change the dates in this cell to check your data for any date if you want.
I've added a check of max generation in the next version of the code that will highlight data that PV Output won't upload anyway.
Depending on the result of the above, I may just check the dates people put in and not generate data before a cut off date (start of 2022?) unless someone explicitly over-rides that date...
Then I think we've taken this as far as we can?

Hi @TonyM1958,
This is great!
It does look like the values are PV1+PV2 voltages as you say.
The drop 09:40-11:40 makes sense now, installers had to come back as they couldn't complete the PV setup on the first day. I'd forgotten that!
Ran the 2 cells above and it looks like data becomes normal on 8th Sept 2021;

And values tie up with my Excel integration values.

Yep I agree can't take this any further, and I have all my data pre 8th Sept 2021 so that's all good.
Thanks for all your work on this 👍

OK - I think a check if pvPower is > 100 kW should work. A bad value getting through if max total PV voltage in a day is less than 100v should be a very rare occurence (panels covered in snow?) but a max PV Power of more than 100kW in a day is clearly wrong for the size of solar arrays / inverters we are talking about.
So, the next version will flag the date as invalid if pvPower is more than 100kW.


Remove only aggregator depenedencies from the dist pom

Closes #3935

Add an explicit default <scope>compile</compile>  to the ant run execution of update_config just to make the following regex simple for both remaining instances of aggregator dependency

Generate that regex

"<dependency>\s+?<groupId>com.nvidia</groupId>\s+?<artifactId>rapids-4-spark-aggregator_\S+?</artifactId>\s+?<version>\S+?</version>\s+?<classifier>\S+?</classifier>\s+?<scope>\S+?</scope>\s+?</dependency>"

to cut aggregator out of the dependency-reduced-pom
result
diff dist/pom.xml dist/target/dependency-reduced-pom.xml
32,38c32
<         <dependency>
<             <groupId>com.nvidia</groupId>
<             <artifactId>rapids-4-spark-aggregator_${scala.binary.version}</artifactId>
<             <version>${project.version}</version>
<             <classifier>${spark.version.classifier}</classifier>
<             <scope>provided</scope>
<         </dependency>
---
>
308,314c302
<                     <dependency>
<                         <groupId>com.nvidia</groupId>
<                         <artifactId>rapids-4-spark-aggregator_${scala.binary.version}</artifactId>
<                         <version>${project.version}</version>
<                         <classifier>${spark.version.classifier}</classifier>
<                         <scope>compile</scope>
<                     </dependency>
---
>

Signed-off-by: Gera Shegalov<EMAIL_ADDRESS>

build

so is this actually the right thing to do?  I thought our old dependency reduced pom didn't have the spark dependencies as provided in it, but it would be good to double check that.   So this changes the scope to be compile?   would be nice to have more description because we aren't removing the dependency from the pom we are changing the dependency scope.

actually, I think I was wrong, must have been looking at the wrong pom, or dependency reduced from aggregator.
https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/21.08.0/rapids-4-spark_2.12-21.08.0.pom
Shows them as provided.

I don't think this is what we want.  If you look at the generated dependency-reduced-pom.xml, the dependencies are still effectively gone.  This jar clearly cannot stand on its own and needs other jars at runtime to work, and I think the dependencies in the pom should reflect that.
The dist pom is pulling in the aggregator pom with the understanding that we'll get all of the aggregator dependencies, transitively.  That's exactly what we want during the compile/build phase, but when it comes to advertising the dependencies in the deployed artifact, we need to remove the aggregator jar from the dependency tree underneath us, but also move all of the aggregator jar dependencies up to become dist jar dependencies.  The dist jar contains the aggregator jar contents but not its transitive dependencies, so the dist jar dependencies should look similar to the aggregator jar dependencies.
In the end I would expect the dependency reduced pom to list the Apache Spark jars along with the cudf jar as provided dependencies.

In the end I would expect the dependency reduced pom to list the Apache Spark jars along with the cudf jar as provided dependencies.

@jlowe please update #3935  to reflect that you mean cudf  and other aggregator's immediate child dependencies need to be promoted to the dist jar  as provided. The issue currently talks only about spark-hive and spark-sql.
Look like we want to just pick any aggregator (say the first one) and transplant its dependencies

Look like we want to just pick any aggregator (say the first one) and transplant its dependencies

Argh, I don't think we can just grab the aggregator dependencies, since some of those dependencies have been pulled into the dist jar as part of the custom shading (sql-plugin, shuffle-plugin, etc.).  We'd have to filter out the aggregator dependencies we know have been pulled in to the dist jar.
As for listing whatever Spark jars are specified by the first aggregator, is that what we want?  It would be nice to show the matrix of support -- we could put the <profile> options in there showing how the dependencies switch by profile, but not sure that really helps for dependency analysis or resolution.  Listing the oldest Spark version for the jars may be the best option if we list the Spark dependency at all.  In that case it will get "interesting" if future Spark versions change their jar composition such that we need more jars or differently named jars.  Anyone else have ideas on how to best present this?

I also thought of using profiles

I investigated the option promoteTransitiveDependencies .
The only way I was able to make it work is by switching cudf (note it is not advertised in our 21.08- poms at all) and spark to compile-scope dependencies so they don't get filtered out by the shade plugin. Then to make sure that those artifacts don't get included into the uber jar, we can add aI.rapids:* and org.apache.spark:*.  In this case dependency-reduced-pom.xml has them  in the dependency list, however with the  compile dependency scope. In summary these are too many changes for the result we can easily hardcode for the moment.
As for advertising the right version of the spark dependencies, I think we can skip adding profiles to this pom.  We publish the parent pom. -Dbuildver should work

build

I reproduced the CI failure locally:
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-install-plugin:3.0.0-M1:install-file (install-with-dependency-reduced-pom) on project rapids-4-spark_2.12: Execution install-with-dependency-reduced-pom of goal org.apache.maven.plugins:maven-install-plugin:3.0.0-M1:install-file failed: Cannot add two different pieces of metadata for: project com.nvidia:rapids-4-spark-udf_2.12 -> [Help 1]

working on the fix.

build

build


[joy-ui][Select] Increase color contrast of hovered option

Duplicates

[X] I have searched the existing issues

Latest version

[X] I have tested the latest version

Steps to reproduce 🕹
Link to live example:https://codesandbox.io/s/peaceful-hypatia-892sc6
Steps:

Hover on any option on html select component, notice the color
When hovering over any option within the 'joy' Select component, observe that the color change upon hover is hardly distinguishable from the background, making it barely noticeable.

Current behavior 😯
No response
Expected behavior 🤔
No response
Context 🔦
No response
Your environment 🌎

npx @mui/envinfo
  Don't forget to mention which browser you used.
  Output from `npx @mui/envinfo` goes here.

Can you assign this to me ?

@priyankuhazarika Feel free to take this up.

@priyankuhazarika make sure to tag @zanivan for a design review of the PR you'll be opening up! 😃

@zanivan increasing contrast of the hover color. What do you think the color would best suit ? I was thinking to apply palette neutral 100 i.e #eaeef6 (which is the same color for an already selected item) in case of light mode. Would that color work for hover ? what do you think ?

Hey @priyankuhazarika thanks for the feedback! I'm working on the #38416 that refines the default neutral color palette, and solves this and many smaller issues. I see you've been working on #38726, but I think it's best to aggregate it on the #38416, changing all the hovered states using default theme color variables.

Alright, thanks keep posted!
On Thu, 31 Aug 2023 at 4:15 PM, Victor Zanivan Monteiro <
@.***> wrote:

Hey @priyankuhazarika https://github.com/priyankuhazarika thanks for
the feedback! I'm working on the #38416
https://github.com/mui/material-ui/pull/38416 that refines the default
neutral color palette, and solves this and many smaller issues. I see
you've been working on #38726
https://github.com/mui/material-ui/pull/38726, but I think it's best to
aggregate it on the #38416 https://github.com/mui/material-ui/pull/38416,
changing all the hovered states using default theme color variables.
—
Reply to this email directly, view it on GitHub
https://github.com/mui/material-ui/issues/38705#issuecomment-1700801816,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AIPHXKTF5EHY7WQMO5NZJILXYBTL7ANCNFSM6AAAAAA4C4KZZA
.
You are receiving this because you were mentioned.Message ID:
@.***>


/api/rotation/clear_cache now takes long enough that we might want to look at changing something

Took about 50s on prod when called from the rotation script and I have seen it "gateway timeout" from Cloudflare in a browser once. We could go pure incremental in rotation_runs which brings it way but we'd have to remember to DELETE FROM rotations_runs WHERE season_id = {next_season_id} if we ever manually edit the Run_xxx.txt files.

This has now timed out for me three times. I'm not sure if it's timed out for the bot or not but it did fail to refresh to latest a few runs in a row around run 120. But that was also when github was having prod issues and modo-bugs and other things were failing too. So not sure if clear_cache has ever failed for the rotation script or only for me.

OK this definitely timed out for the bot on Run 161. So we should move it to incremental or run it async once the bot calls us or … something better than allowing a Cloudflare gateway timeout to ruin the party.

@if_not_in_rotation()
def update_cache_if_necessary() -> None:
    season_id = seasons.next_season_num()
    last_run_number = rotation.last_run_number() or 0
    sql = 'SELECT MAX(number) FROM rotation_runs WHERE season_id = %s'
    last_stored_run_number = db().value(sql, [season_id]) or 0
    if last_run_number <= last_stored_run_number:
        return
    gentle_cache_update()


Missing environment variables documentation

would be great to have a list like https://github.com/ppy/osu-elastic-indexer#environment-variables

@ThePooN self assigning you on this for now, as discussed in the meeting.


Updated servers, hardware fix, and binaries

Firstly, I would like to apologize for commandeering this page. I know this is not good practice, but seeing as though this is the officially linked github page and it hasn't been updated in about a year I figured I'd help some people browsing out. I am just a ravencoin user who wanted to use a hardware device.
I have made a fork with a fix for the following issues botched together and will be updating it for the forseeable future:

Hardware support
Automatically loading the blockchain_headers instead of having to manually copy it
Updated the active electrumx servers
Made the binary building workable

Here is the link: https://github.com/kralverde/electrum-raven
Check https://ravencoin.org/community/ for more resources
Sorry again for the poor form! This just seemed like a good place to get information out.

I tried your version, but it does not connect to the network too. After chaning the server it connected to the network, but it was still impossible to send any transaction using ledger.

I tried your version, but it does not connect to the network too. After chaning the server it connected to the network, but it was still impossible to send any transaction using ledger.

Wow that's a big problem! I can't believe I missed that. Will prioritize.

@kralverde I looked at your servers json and only rvn4lyfe.com works. Thanks for posting the server. I have not tried to send. Is that working now as well?

@sobertram if you get ravencoin from a tx with a lot of outputs (for instance mining directly to hardware) it will take a long time to sign transactions. We are getting started on a updated version of electrum in the ravencoin discord right now


[Problem]: Error when updating adatper via GitHub

Description
I tried to update one of my adapters via GitGub URL. The adapter is owned by myself and I wanted to test the next to-be released version.
The debug-log of this update has some errors in it:
39 verbose stack Error: An unknown git error occurred
39 verbose stack     at makeError (/usr/lib/node_modules/npm/node_modules/@npmcli/git/lib/make-error.js:28:13)
39 verbose stack     at /usr/lib/node_modules/npm/node_modules/@npmcli/git/lib/spawn.js:37:26
39 verbose stack     at processTicksAndRejections (node:internal/process/task_queues:96:5)
40 verbose cwd /opt/iobroker
41 verbose Linux 5.10.0-21-amd64
42 verbose node v16.19.0
43 verbose npm  v8.19.3
44 error code 128
45 error An unknown git error occurred
46 error command git --no-replace-objects ls-remote<EMAIL_ADDRESS>47 error ssh -oStrictHostKeyChecking=accept-new: 1: ssh: not found
47 error fatal: Could not read from remote repository.
47 error
47 error Please make sure you have the correct access rights
47 error and the repository exists.
48 verbose exit 128

Image version
buanet/iobroker:latest
Docker logs
not sure this helps, is this an problem with the image or with iobroker itself?

Hi @phifogg, are you sure that you use the latest image?
I use the latest image and I have this versions:
Node.js: v18.16.0
NPM: 9.5.1

Thanks... correct. It was latest when I created it 3 months ago.
Updated my image and it works now.


menu in input tag with onChange issue Menu>MenuList>li>input

floating-ui.react.umd.js:3284 Uncaught TypeError: text.toLocaleLowerCase is not a function
at floating-ui.react.umd.js:3284:154
at Array.find ()
at onKeyDown (floating-ui.react.umd.js:3284:111)
at floating-ui.react.umd.js:3587:87
at Array.forEach ()
at acc. (floating-ui.react.umd.js:3587:73)
at HTMLUnknownElement.callCallback2 (react-dom.development.js:4164:14)
at Object.invokeGuardedCallbackDev (react-dom.development.js:4213:16)
at invokeGuardedCallback (react-dom.development.js:4277:31)
at invokeGuardedCallbackAndCatchFirstError (react-dom.development.js:4291:25)
(anonymous) @ floating-ui.react.umd.js:3284
onKeyDown @ floating-ui.react.umd.js:3284
(anonymous) @ floating-ui.react.umd.js:3587
acc. @ floating-ui.react.umd.js:3587
callCallback2 @ react-dom.development.js:4164
invokeGuardedCallbackDev @ react-dom.development.js:4213
invokeGuardedCallback @ react-dom.development.js:4277
invokeGuardedCallbackAndCatchFirstError @ react-dom.development.js:4291
executeDispatch @ react-dom.development.js:9041
processDispatchQueueItemsInOrder @ react-dom.development.js:9073
processDispatchQueue @ react-dom.development.js:9086
dispatchEventsForPlugins @ react-dom.development.js:9097
(anonymous) @ react-dom.development.js:9288
batchedUpdates$1 @ react-dom.development.js:26140
batchedUpdates @ react-dom.development.js:3991
dispatchEventForPluginEventSystem @ react-dom.development.js:9287
dispatchEventWithEnableCapturePhaseSelectiveHydrationWithoutDiscreteEventReplay @ react-dom.development.js:6465
dispatchEvent @ react-dom.development.js:6457
dispatchDiscreteEvent @ react-dom.development.js:6430
react-dom.development.js:4312 Uncaught TypeError: text.toLocaleLowerCase is not a function
at floating-ui.react.umd.js:3284:154
at Array.find ()
at onKeyDown (floating-ui.react.umd.js:3284:111)
at floating-ui.react.umd.js:3587:87
at Array.forEach ()
at acc. (floating-ui.react.umd.js:3587:73)
at HTMLUnknownElement.callCallback2 (react-dom.development.js:4164:14)
at Object.invokeGuardedCallbackDev (react-dom.development.js:4213:16)
at invokeGuardedCallback (react-dom.development.js:4277:31)
at invokeGuardedCallbackAndCatchFirstError (react-dom.development.js:4291:25)
(anonymous) @ floating-ui.react.umd.js:3284
onKeyDown @ floating-ui.react.umd.js:3284
(anonymous) @ floating-ui.react.umd.js:3587
acc. @ floating-ui.react.umd.js:3587
callCallback2 @ react-dom.development.js:4164
invokeGuardedCallbackDev @ react-dom.development.js:4213
invokeGuardedCallback @ react-dom.development.js:4277
invokeGuardedCallbackAndCatchFirstError @ react-dom.development.js:4291
executeDispatch @ react-dom.development.js:9041
processDispatchQueueItemsInOrder @ react-dom.development.js:9073
processDispatchQueue @ react-dom.development.js:9086
dispatchEventsForPlugins @ react-dom.development.js:9097
(anonymous) @ react-dom.development.js:9288
batchedUpdates$1 @ react-dom.development.js:26140
batchedUpdates @ react-dom.development.js:3991
dispatchEventForPluginEventSystem @ react-dom.development.js:9287
dispatchEventWithEnableCapturePhaseSelectiveHydrationWithoutDiscreteEventReplay @ react-dom.development.js:6465
dispatchEvent @ react-dom.development.js:6457
dispatchDiscreteEvent @ react-dom.development.js:6430

@Md-Anamul-Haque
This issue has been fixed on v1.4.0 please update to the latest version.
Cheers,
Sajad


Update IP list to include RT-1.32

RT-1.32 feature/bgp/policybase/otg_tests/actions-MED_LocPref_prepend_flow-control/README.md testplan includes 2 IP prefix viz. <IP_ADDRESS>/24, <IP_ADDRESS>/24 that needs to be advertised in BGP.
Hence, updating CONTRIBUTING.md

Pull Request Functional Test Report for #2693 / 78817bd1a9b9c508fe0098fac715769e5c849933
No tests identified for validation.
Help

Pull Request Test Coverage Report for Build<PHONE_NUMBER>
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 52.21%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
1654

Relevant Lines:
3168

💛  - Coveralls


[Bug]: The args of method annotations  is inconsistent with the real args of the method

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
com.alibaba.graphar.util.FileSystem.scala
def writeDataFrame(...){}

The args of method annotations  is inconsistent with the real args of the method,in the ide will give red
Expected Behavior
args in the annotation of the method are kept consistent with the true args
Minimal Reproducible Example
/**

Write input dataframe to output path with certain file format.

@param dataframe
DataFrame to write out.
@param fileType
output file format type, the value could be csv|parquet|orc.
@param outputPrefix
output path prefix.
@param startChunkIndex
the start index of chunk.
*/
def writeDataFrame(
dataFrame: DataFrame,
fileType: String,
outputPrefix: String,
offsetStartChunkIndex: Option[Int],
aggNumListOfEdgeChunk: Option[Array[Long]]
): Unit = {...

Environment

Operating system:mac
GraphAr version:main

Link to GraphAr Logs
No response
Further Information
No response

Hi, @haohao0103 . Thank you for bringing this issue to our attention. We would greatly appreciate your assistance in resolving it.


noasync: expose run from high level to noasync

closes #665
Signed-off-by: Sudhanshu<EMAIL_ADDRESS>

thanks for pointing that out :)

Sweet! Thank you! Merged :D


cmd/server: save SSN when creating a Customer

Issue: https://github.com/moov-io/customers/issues/25

Codecov Report

Merging #27 into master will decrease coverage by 1.97%.
The diff coverage is 43.78%.

@@            Coverage Diff             @@
##           master      #27      +/-   ##
==========================================
- Coverage   59.62%   57.64%   -1.98%
==========================================
  Files          10       12       +2
  Lines        1159     1308     +149
==========================================
+ Hits          691      754      +63
- Misses        372      446      +74
- Partials       96      108      +12


Please Help

i am not able to download the files or movie. please please make this feature available i just need it.

As the title of the project states: "Stream", not Download ;)

Is there not any way to download the files


Add a blog post about plugins in conda

Description
The conda maintainers have been doing a lot of work and some PR (public relations) about our work on developing a plugins infrastructure for the conda package manager. We would like to have a blog post that describes how we decided to build a plugin mechanism and where we plan on taking this going forward.
Additionally, we would like to use this blog post to highlight @beeankha and @travishathaway's recent presentations at PyCon US and PyCon DE, respectively. The YouTube videos of these presentations should be embedded within the article.
Tasks

[ ] Create a draft of the blog post
[ ] Submit it for review
[ ] Publish it after updating based on review comments

Link to @travishathaway's presentation: https://www.youtube.com/watch?v=d40tBcqopAI

And here's a link to @beeankha's PyCon US 2023 talk: https://youtu.be/OeSv0_HesaU

It would also be great to include info about the new plugins repo where we've started to list available/usable plugins: https://github.com/conda-incubator/plugins


Tooltips

Changed tooltips and names for cut3&5

Let's move the numbers to the end for both these and 3OH and 5OH, so we won't need the underscore

Will do.
On Wed, Sep 5, 2018 at 1:03 PM cjmyers<EMAIL_ADDRESS>wrote:

Let's move the numbers to the end for both these and 3OH and 5OH, so we
won't need the underscore
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/SynBioDex/SBOLDesigner/pull/303#issuecomment-418845136,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AV89xQDOX97ljaFdn2KbgJUpR3KubtGSks5uYCATgaJpZM4WbgOm
.


How does the NotionDirectoryLoader work?

I've been trying to find details on how to use the NotionDirectoryLoader, but can't seem to figure it out. I've attached my flow i'm using so you can see what i've setup. In short, I'm using it like a Document type and passing that into a Text Splitter then into FAISS...etc.
NotionLoader.json.zip
The specific error i'm receiving is:
Error building node FAISS: The source you provided did not load correctly or was empty.This may cause an error in the vectorstore.
I tried using ChromaDB instead and it got a similar error saying that the value was blank basically.
What am I missing? How can I use this to connect to my Notion. This could be incredibly valuable integration I think.

Hey I've been doing the same thing though with Chroma and I notice a few things:

Using docker-compose I've been unsucessful. I use poetry and install langflow with poetry add langflow && poetry install && langflow
I use langflow 0.0.87 not 0.0.88. If I don't then path is missing from the UI. I did try switching dockers version to 0.0.87 but that still didn't show the path.
Sometimes the VectorStoreInfo panel shows the same message as you have above. Closing out and opening up again causes it to rethink it's life choices and starts co-operating.
If I load your one (after closing out) FAISS waits in validating in orange for about 10x longer (5 minutes?) whereas Chroma takes a little while and then goes green. This is with 0.0.87 and the path field in Notion available.
And of course you need your Notion database dump unzipped in the root folder and the directory name entered in the path field.


Improve guidance for fabric setup once git sync and workspace workflow finalized

Fabric's git integration and workspace flow is still evolving. We need to add some guideance for setup and link potential Microsoft docs to enable the user to understand the workflow using PRs and Azure Devops.

Let's make sure each example uses the same folder structure as closely aligned with the structure in fabric


Running test.py and creating test.c and test.h

Hi , I am trying to create test.c and test.h by converting test.py to test.pyx . So that i can use conversion.cpp and conversion.h in my function .
I tried in anaconda prompt to run the command  "-m test" in python shell. But i am not able to run the make file . Can you please help me/ or tell me the steps to generate test.c and test.
Thanks in advance

test.py just imports the compiled shared object file, which is generated by compiling examples.cpp. You can already use conversion.h in your C++ program as demonstrated in examples.cpp. You'll need boost-python to compile it (check the makefile to see how to compile).

Hi I am actually working with windows So none of the commands env python -m test is working . i am new to running makefiles. Can you please help me in this regards.
I tried using conversion.cpp and conversion.h in my Visual studio project and  added the necessary include files for boost/python.hpp . and the error i get is that importarray() is undefined . May be the issue is that  i am not creating the test.c and test.h from test.py .So can you please tell me how to progress.

I'm afraid I haven't tested any of this on Windows. I think Cygwin or the recent Ubuntu integration can get you far. Maybe playing with this on an Ubuntu VM is also an idea.

Ok .Thanks a lot . i will try


Convert ReceiveAsync to Receive

eliminates unnecessary delegate allocation under the covers.

Hi @Aaronontheweb, thank you for this contribution.
These are the new numbers:
Clients: 750
Before:  207450 req/s
After:   197344 req/s

Which is ~ -4.9% drop. So the throughput is slightly lower. I ran the benchmark two times with both versions and the drop was similar in both cases. There is of course the issue of reproducibility, because this runs on public cloud, so the environment is not fully controlled and isolated. So maybe that might have an effect as well.
Let me know if you want me to merge this change.


update webpack dependencies and config

We are basically already inline with the correct ways to do webpack 5. This just updates the config slightly to demonstrate setting a static path and updates the related package versions.
I also added a npm run start:built to demonstrate hosting the built version as static files using http-server
This branches off of #51
Fixes https://github.com/CesiumGS/cesium-webpack-example/issues/24
Fixes https://github.com/CesiumGS/cesium-webpack-example/issues/11
Fixes https://github.com/CesiumGS/cesium-webpack-example/issues/4

Looks good to me! Thanks @jjspace!


Feature Request: Password Reset

To make sure users don't lose their account. a password reset system should be implemented.
To reset a users password, a link will be sent to the email registered to that account and clicking on the link will allow the user to reset their password.
Please make any changes that would help accommodate this feature in the case of liveassist, and have a great day!

Closing due to inactivity


Bernie fixes

Fixes from Bernie suggestions and meetings.

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/images/cortana-manage-user-identity.png
:white_check_mark:Succeeded

docs/skills/authentication.md
:white_check_mark:Succeeded

docs/skills/mva21-setup.md
:white_check_mark:Succeeded

docs/skills/mva22-hello-world.md
:white_check_mark:Succeeded

docs/skills/mva31-understanding-conversations.md
:white_check_mark:Succeeded

docs/skills/mva32-building-conversations.md
:white_check_mark:Succeeded

docs/skills/mva41-streaming-audio.md
:white_check_mark:Succeeded

docs/skills/mva42-visual-ux.md
:white_check_mark:Succeeded

docs/skills/mva43-client-code.md
:white_check_mark:Succeeded

docs/skills/mva51-profile-data.md
:white_check_mark:Succeeded

docs/skills/mva52-using-profile-data.md
:white_check_mark:Succeeded

docs/skills/mva61-authentication.md
:white_check_mark:Succeeded

docs/skills/mva71-share-skill.md
:white_check_mark:Succeeded

docs/skills/mva72-publish-skill.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Filter optimization to avoid unnecessary predicate evaluation.

Filter optimization to avoid unnecessary predicate evaluation.
Replace AND/OR operators with EmptyFilterOperator if one child (all
children for OR) of AND Operator always evaluates to false. Doing so in
planning phase completely eliminates thread overheads during execution
phase. In an example use-case with 180 segments, where most segments are
eliminated due to time filters in query, this change provided > 25%
improvement in QPS, while improving latency by 10%.

All filter operators now implement alwaysFalse(). Leaf level filter
operators use predicate evaluator for the same. While non leaf filters
(AND/OR) decide that based on their children (one child is alwaysFalse
for AND, all children alwaysFalse for OR).

While creating FilterPlan, return an emtpy filter operator for all
AND's that have at least one child that always evaluates to false. This
helps optimize the filter tree by collapsing parts of the tree that are
alwaysFalse.

Removed set/getPredicate() from BaseFilterOperator, leaf level filter
operators take predicate in constructor now.

Added unit test to test the always false optimizations.

alwaysFalse() is renamed to isResultEmpty()


New setting to define extra navigation links

Is it a third party application feature request?
No
Describe your feature request
We'd like to show all applications and models  (SIDEBAR.show_all_applications) and define some extra navigation links before those (dashboard, show website, some external links, some custom sites etc).
If you define those links in SIDEBAR.navigation, then it shows only those links but not show_all_applications.
Therefore we suggest to add a new setting SIDEBAR.extend_navigation, to easily add new navigation links without the need to define every single app and model in the settings and just show them all.

Do you have any examples how you want to specify additional links? How you want to declare the position of these links in the whole navigation?

I'd like to define it kinda similar to SIDEBAR.navigation. It could be extra_navigation, extend_navigation or you split it like navigation_top and navigation_bottom.
The order would then be:

(optional) navigation top
regular navigation
(optional) navigation bottom

In case you don't split it, then there must be a field position.
Example:
UNFOLD = {
    "SIDEBAR": {
        "navigation_top": [
            {
                "title": _("Navigation"),
                "separator": True,
                "items": [
                    {
                        "title": _("Dashboard"),
                        "icon": "dashboard",
                        "link": reverse_lazy("admin:index"),
                        "permission": lambda request: request.user.is_superuser,
                    },
                    {
                        "title": _("Website"),
                        "icon": "home",
                        "link": reverse_lazy("index"),
                    },
                ],
            },
        ],
    },
}


IPv6 URL Mis-handling

Description
It looks like there's a bug in URL manipulation with regard to IPv6 addresses.
A snippet from /_scheduler/jobs:
    {
      "database": "_replicator",
      "id": "3e9e019d74f393c8fb8319dd43abec45+continuous",
      "pid": null,
      "source": "http://[fdaa:a:d05:a7b:12:eb5a:cc23:2]:5984/_users/",
      "target": "http://localhost:5984/_users/",
      "user": null,
      "doc_id": "pup_fdaa:a:d05:a7b:12:eb5a:cc23:2__users",
      "info": null,
      "history": [
        {
          "timestamp": "2024-09-06T03:45:14Z",
          "type": "crashed",
          "reason": "{replication_auth_error,\n    {session_request_failed,\"http://fdaa:a:d05:a7b:12:eb5a:cc23:2/_session\",\n        \"admin\",\n        {url_parsing_failed,{error,invalid_uri}}}}"
        },

Note that the _session URL does not show the requisite [] around the IP address.
Steps to Reproduce

Set up two CouchDB instances on an IPv6 network
Configure them to replicate with each other, referring to the other by IP address

Expected Behaviour
Replication happens cleanly.
Your Environment
{
  "couchdb": "Welcome",
  "version": "3.3.3",
  "git_sha": "40afbcfc7",
  "uuid": "2ec4265a1ffc0f5d75390407dd3cd392",
  "features": [
    "access-ready",
    "partitioned",
    "pluggable-storage-engines",
    "reshard",
    "scheduler"
  ],
  "vendor": {
    "name": "The Apache Software Foundation"
  }
}

Additional Context
This was exposed while working on an automagic CouchDB on fly.io project.

From the CouchDB log:
[notice] 2024-09-06T03:54:09.540505Z nonode@nohost <0.393.0> -------- couch_replicator_scheduler: Job {"3e9e019d74f393c8fb8319dd43abec45","+continuous"} s
tarted as <0.12000.0>                                                                                [error] 2024-09-06T03:54:11.461321Z nonode@nohost <0.12000.0> -------- couch_replicator_httpc: auth plugin initialization failed "http://[fdaa:a:d05:a7b:1
2:eb5a:cc23:2]:5984/_users/" {session_request_failed,"http://fdaa:a:d05:a7b:12:eb5a:cc23:2/_session","admin",{url_parsing_failed,{error,invalid_uri}}}    [error] 2024-09-06T03:54:11.461920Z nonode@nohost <0.12000.0> -------- throw:{replication_auth_error,{session_request_failed,"http://fdaa:a:d05:a7b:12:eb5
a:cc23:2/_session","admin",{url_parsing_failed,{error,invalid_uri}}}}: Replication 3e9e019d74f393c8fb8319dd43abec45+continuous failed to start "http://[fdaa:a:d05:a7b:12:eb5a:cc23:2]:5984/_users/" -> "http://localhost:5984/_users/" doc <<"shards/00000000-7fffffff/_replicator.1725575687">>:<<"pup_fdaa:a:d05:
a7b:12:eb5a:cc23:2__users">> stack:[{couch_replicator_httpc,setup,1,[{file,"src/couch_replicator_httpc.erl"},{line,62}]},{couch_replicator_api_wrap,db_open,3,[{file,"src/couch_replicator_api_wrap.erl"},{line,68}]}]

what version of erlang do you have there?

on erlang 25/26 this works;
1> ibrowse_lib:parse_url("http://[fdaa:a:d05:a7b:12:eb5a:cc23:2]:5984/_users/").
{url,"http://[fdaa:a:d05:a7b:12:eb5a:cc23:2]:5984/_users/",
     "fdaa:a:d05:a7b:12:eb5a:cc23:2",5984,undefined,undefined,
     "/_users/",http,ipv6_address}

Whatever you're packing in your Debian packages. I'm having trouble tracking that down.
I'm using a fork of the semi-official container https://github.com/teahouse-hosting/couchdb-docker/blob/trunk/3.3.3/Dockerfile that's been updated to bookworm. (submitted as https://github.com/apache/couchdb-docker/pull/259) And that uses the Apache jFrog repos.
Also, I suspect the bug isn't in parsing http://[fdaa:a:d05:a7b:12:eb5a:cc23:2]:5984/_users/, but when that's transformed into http://fdaa:a:d05:a7b:12:eb5a:cc23:2/_session as part of the replicator. (It looses both the [] and :5984.)

https://github.com/apache/couchdb/blob/c4aac977d2e6eafc34fcad72b624fc02cf07d49f/src/couch_replicator/src/couch_replicator_auth_session.erl#L267-L282
You're using string concatenation instead of URL unparsing, so when ibrowse_lib:parse_url() drops the [], it messes everything up.

nice find, we'll get it fixed.

Since I don't really know the Couch devs, I feel the need to point out that since the root of this bug is an API that's missing half its round-trip, this is probably a systemic bug in the Couch codebase--any part of the code that assembles or munges URLs is probably affected.

I'm certainly alive to the notion that couchdb has more bugs around this than the one you've highlighted. :)

extra context: the replicator application is the only thing that makes outbound http connections and has only recently needed to construct a url (to the _session endpoint to acquire a cookie) from another url supplied by the user (either the source or target). so we are looking for other occurrences but there likely aren't any.


PrettyJSON: type-level JSON prettification.

The module lets us modify JSON outputs on the fly as per use case. It
will also keep JSON normalisation principled instead of ad-hoc.

That seems cool. Will it work with custom ToJSON instances or some other trick to choose the serialized field names ?

That seems cool.
* Will it work with custom `ToJSON` instances or some other trick to choose the serialized field names ?

If I understand the question but yes, I don't see why it shouldn't work with custom ToJSON instances.
However, the best use of it would be to just use DerivingVia to avoid any boilerplate.

* Will it work when doing it the other way, i.e. when parsing JSON back to some Haskell data type ?

No, and some field modifications are non-isomorphic AFAICS. Especially array removals of null will be very tricky to deserailiase.
This was expected, but I can add it to the docs.

@noteed replies inline.

@noteed discussed changes pushed.


upload dcm file using curl -x post

hi, i want to upload a .dcm file to orthanc using curl -x post
but when i execute this command
curl -X POST http://localhost:8042/instances -data-binary test.dcm
it replies
curl: (6) Could not resolve host: test.dcm
can anyone help me with this?
any help will be greatly appreciate.

i change the test.dcm path to absolute path /home/test.dcm
and then i get
curl: (3) <url> malformed
how can i login orthanc with orthanc:orthanc in curl?
thanks a lot.

I think this would be "the hard way" to upload dicom files.  Is there any particular reason you are trying to do it this way?  If not, I'd recommend one of the following three methods:

via DICOM using something like DCMTK's storescu command
via HTTP using STOW-RS
manually using drag&drop on orthanc's upload page

I can understand if you don't want to use the manual approach, but the first two can be easily incorporated into scripts.
I will leave this issue open in case anyone else wants to look into your approach, but if you are satisfied with the other methods I proposed, then feel free to close it.

Thanks much for your help.
i have found the way.
using following command and it worked. however i don't understand why it need an "@"
curl -X POST http://localhost:8042/instances --data-binary @test.dcm
i will close this issue and thanks again.


Create GatedCheckbox Component

Details
We need a way to wrap an input as 'Gated' so if a user checks the checkbox they see the form input/area.
Includes:

checkbox
takes text for the explaination
if checked it shows the input - if not it hides it
takes the input as a prop

TODO: How does this need to play with form builder?
@jordanlesich
Example usage in the expiration date component:

Prop is perfect. That way we can define the gate as a lego.
We should test it to make sure that it works with other registered Inputs.

two questions:

gated Input should support most of the wrapped input field components (molecules) ? Or should also support atom components?
Explanation should be a markdown text?