Kafka integration as a Connector

Describe what you would like to achieve
I am curious as to the implications of sourcing the data from somewhere else. I am working on a project for collecting BGP data from certain sources and would like to integrate the alerting capabilities of this tool. Is this something that would be possible with the way this tool was built around consuming the public web sockets?
Describe why the current solution (if any) is not satisfactory
I would like to use a custom connector and source my own bgp data to monitor/generate alerts from
Provide an example
We collect BGP data through BMP collectors that push to a kafka broker. It would be interesting to be able to connect this tool to the broken and consume the topics as a Connector rather than just for pushing alerts to

Hi @kbmanseau,
It is absolutely possible (and already done by third-parties).
Here https://github.com/nttgin/BGPalerter/tree/dev/src/connectors you can find the connectors. You can create your own and extend the Connector class, which tells you what methods must be implemented. Essentially, for each message (or bulk of messages) you call this._message. The static method transform allows you to take in input whatever format and translate it to the internal JSON one.
Please, if you write a Kafka input connector, contribute back to this repo. That would be much appreciated.

I have started working on this an am hoping to perhaps pick your brain a bit. I am trying to use kafkajs to implement the consumer logic. What I have so far is to create the consumer inside the connector.connect() function and then call a new async function I created connector._kafkaConsumer() to handle the stream of incoming messages. The issue I am facing is that the kafkajs package seems to need to use an async function and when I call that from the non async function connector.connect() I am not seeing expected behavior of the app progressing to the other methods like connector.transform() I will attach a code sample:
connect = () => {
  //create kafka connection
  //send connection to new function
  this._kafkaConsumer(kafkaConnection, topic)
}
_kafkaConsumer = async (kafkaConnection, topic) => {
  try {
    await kafkaConnection.connect()
    await kafkaConnection.subscribe({ topic, fromBeginning: false })
    await kafkaConnection.run({
      eachMessage: async ({ topic, partition, message }) => {
        //minor parsing
        //call this._message
        this._message(message);
      },
    })
  } catch (error) {
    console.log(error)
    error.message;
  }
}

I think the issue is that whatever is calling connector.connect() is expecting a return for the promise but because of the async run function for eachMessage I don't think it ever returns?

I have made progress and no longer require assistance with the above question. Just updating so others don't waste time trying to assist. Will continue working to implement this

I believe I have the connector implemented but am unsure about what the best way to test it would be. I see the "-t" flag for testing reporters, is there something similar to validate the configuration of a connector?

Hi @kbmanseau,

I believe I have the connector implemented

Great news!

but am unsure about what the best way to test it would be. I see the "-t" flag for testing reporters, is there something similar to validate the configuration of a connector?
Edit: I have also seen the "npm run test" but from what I see that is to test all the forms of reporting

Since the kafka connector would be a new component, there is no test already made.
The tests are going to be part of the pull request before the merge.
I would suggest you to start by creating a pull request on the dev branch and keep working on your fork (the PR will be auto updated). So you can receive already suggestions etc.
The connector has to have a connect status, the first basic test would be to check if the uptimeApi is able to correctly identify the status of the connector. Another test would be to generate data in Kafka and see if you can see the alert generated by such data. The reportKaka module is tested in a similar way, just opposite direction: the test generates alerts and reads the same alerts on the other side of Kafka.

Hi @massimocandela
The health api was great help and I can confirm it reports well.
I have also been able to test the connector by generating false advertisements to a kafka broker with them being consumed by bgpalerter. I am going through use-case validation scenarios but after I will need to have the code reviewed internally and approved before I can push it back to the public repo (or begin the PR process). I can use this issue to provide updates on progress

As a quick update, Draft PR 603 created. This was the base code for testing minus our env specific vars. I plan to also work on making the parsing section more modular as well as some other contributions

I reviewed the PR. We can continue there. Thanks for the contribution.


Qwen 2 7B not working

This appears on a fresh installation of sglang. Currently using docker container with the following packages
sglang==0.1.17
triton==2.3.0
transformers==4.41.2
torch==2.3.0
vllm==0.4.3
vllm-flash-attn==2.5.8.post2
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Wed_Nov_22_10:17:15_PST_2023
Cuda compilation tools, release 12.3, V12.3.107
Build cuda_12.3.r12.3/compiler.33567101_0

CUDA_VISIBLE_DEVICES=2 python -m sglang.launch_server --model-path Qwen/Qwen2-7B-Instruct-GPTQ-Int8 --port 30000
/usr/local/lib/python3.10/dist-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
  warnings.warn(
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
[gpu_id=0] Set cuda device.
[gpu_id=0] Init nccl begin.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
[gpu_id=0] Load weight begin. avail mem=78.27 GB
INFO 06-10 11:32:21 gptq_marlin.py:133] The model is convertible to gptq_marlin during runtime. Using gptq_marlin kernel.
INFO 06-10 11:32:23 weight_utils.py:207] Using model weights format ['*.safetensors']
[gpu_id=0] Load weight end. type=Qwen2ForCausalLM, avail mem=69.90 GB
[gpu_id=0] Memory pool end. avail mem=6.64 GB
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
[gpu_id=0] max_total_num_tokens=1162244, max_prefill_tokens=65536, context_len=32768,
[gpu_id=0] server_args: enable_flashinfer=False, attention_reduce_in_fp32=False, disable_radix_cache=False, disable_regex_jump_forward=False, disable_disk_cache=False,
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
INFO:     Started server process [34862]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://<IP_ADDRESS>:30000 (Press CTRL+C to quit)
INFO:     <IP_ADDRESS>:33602 - "GET /get_model_info HTTP/1.1" 200 OK
[gpu_id=0] Prefil batch. #new-seq: 1, #new-token: 6, #cached-token: 0, cache hit rate: 0.00%, #running-req: 0, #queue-req: 0
Exception in ModelTpServer:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 188, in exposed_step
    self.forward_step()
  File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 218, in forward_step
    self.forward_decode_batch(self.running_batch)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 572, in forward_decode_batch
    next_token_ids, _ = batch.sample(logits)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/infer_batch.py", line 592, in sample
    sampled_index = torch.multinomial(probs_sort, num_samples=1)
RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

Exception in ControllerSingle:
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/manager_single.py", line 93, in start_controller_process
    loop.run_until_complete(controller.loop_for_forward())
  File "uvloop/loop.pyx", line 1517, in uvloop.loop.Loop.run_until_complete
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/manager_single.py", line 44, in loop_for_forward
    out_pyobjs = await self.model_client.step(next_step_input)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 753, in _func
    return f(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 188, in exposed_step
    self.forward_step()
  File "/usr/local/lib/python3.10/dist-packages/torch/utils/_contextlib.py", line 115, in decorate_context
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 218, in forward_step
    self.forward_decode_batch(self.running_batch)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/tp_worker.py", line 572, in forward_decode_batch
    next_token_ids, _ = batch.sample(logits)
  File "/usr/local/lib/python3.10/dist-packages/sglang/srt/managers/controller/infer_batch.py", line 592, in sample
    sampled_index = torch.multinomial(probs_sort, num_samples=1)
RuntimeError: probability tensor contains either `inf`, `nan` or element < 0

Killed

@sudarshan-kamath This is due to the fp16 reduction loss in the attention kernel. Try use the CLI argument --attention-reduce-in-fp32.

@hnyls2002 Thanks a lot. This works now :) I will close the issue

add this args can slove it


scama

witch data base field would hold the  signature to release the inputs to the new out puts?

Each input redeems funds that are locked in a previous output. The proof that the input is entitled to consume those funds is contained in the “input script”. This field is not stored in the database. I considered this field to be less interesting since the proof was already made and the funds were already consumed. By consumed I mean transferred to a new output where they were locked.
Each output locks a quantity of bitcoins. The output contains in its “output script” the conditions needed to release the funds later. That is what I considered to be interesting - that is what one needs to “unlock” in order to spend funds in a future transaction. This field is stored in the database in table TransactionOutput, column OutputScript.
If for whatever reason, you need the “input script”, that would be a relatively easy change to make but you’ll need to make it yourself. The BitcoinDatabaseGenerator tool relies on parser implemented in a NuGet package called BitcoinBlockchain (see https://github.com/ladimolnar/BitcoinBlockchain). The parser coded there does provide access to the “input script”. The change would be relatively simple: add a new column to table TransactionInput, then make sure that the “input script” is propagated from the dataset produced by the parser all the way to the database. If that is what you need, I could give you a few more details.


Added traditional chinese json under filename tw.json

Added traditional chinese json under filename tw.json. In addition, I changed one line
in cn.json as I think it was not correctly translated.

please feel free to discuss with me

Hi @robinlluu2002 thank you for the translations. Looks like we may have a problem with the naming of both the cn.json file and the tw.json. According to the ISO 639-1 codes Chinese should be named zh.json and I can't find a code for Traditional Chinese. According to the list tw represents Niger–Congo and cn doesn't have a value in the list (I should have checked that when the first translations was provided).
Would be great to merge these translations in but could you advise on what to name Traditional Chinese? (I can rename existing cn translation file after.) Possibly the files would become zh.json and zh-traditional.json?

Hi @anthonyjb, from my understanding.  Simplified Chinese(China) could be named zh-cn.json and traditional Chinese(Taiwan) be named zh-tw.json. This naming convention is commonly used in dealing with simplified and traditional Chinese.

That makes sense (like en-us, en-gb), I'll merge your changes in and rename the files thanks :+1:


Castxml: update

Description of changes
0
Closes https://github.com/NixOS/nixpkgs/pull/308975
Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.05 Release Notes (or backporting 23.05 and 23.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

change https://github.com/NixOS/nixpkgs/pull/311950 which  removes strictDeps


Unexpected character '�'

I get the following error in a SolidStart project (i.e. using Vite) after upgrading to<EMAIL_ADDRESS>[commonjs--resolver] Unexpected character '�' (Note that you need plugins to import files that are not JavaScript)
file: /Users/erikmuller/cn-webapp/node_modules/@node-rs/argon2/index.js:1:0
1: ����
<EMAIL_ADDRESS>   ^
2: �H__LINKEDIT�
�/Users/runner/work/node-rs/node-rs/target/aarch6...

[12:36:09 AM]  ERROR  Unexpected character '�' (Note that you need plugins to import files that are not JavaScript)

  at error (node_modules/vinxi/node_modules/vite/node_modules/rollup/dist/es/shared/node-entry.js:2287:30)
  at Module.error (node_modules/vinxi/node_modules/vite/node_modules/rollup/dist/es/shared/node-entry.js:13745:16)
  at Module.tryParse (node_modules/vinxi/node_modules/vite/node_modules/rollup/dist/es/shared/node-entry.js:14476:25)
  at Module.setSource (node_modules/vinxi/node_modules/vite/node_modules/rollup/dist/es/shared/node-entry.js:14077:39)
  at ModuleLoader.addModuleSource (node_modules/vinxi/node_modules/vite/node_modules/rollup/dist/es/shared/node-entry.js:24649:20)

The issue has also been reported for SvelteKit project here and the resolution proposed in this post doesn't work for me.

Did you install it as a dev dependency?

No, I installed<EMAIL_ADDRESS>as a regular dependency.

Can you try the solution in the Vite section?
https://lucia-auth.com/getting-started/#vite

the solution described in the vite section doesn't solve this for me

Closing this due to a lack of activity


PFI Developer Guide

What type of PR is this? (check all applicable)

[ ] ♻ Refactor
[ ] ✨ New Feature
[ ] 🐛 Bug Fix
[x ] 📝 Documentation Update
[ ] 👷 Example Application
[ ] 🧑💻 Code Snippet
[ ] 🎨 Design
[ ] 📖 Content
[ ] 🧪 Tests
[ ] 🔖 Release
[ ] 🚩 Other

Description
This PR introduces the developer guide for PFIs in Typescript
Related Tickets & Documents
Resolves #1006

I noticed the PR contains code but they are not using our code snippets testing framework. Should they be added for tbdex too? cc @dayhaysoos

I noticed the PR contains code but they are not using our code snippets testing framework. Should they be added for tbdex too? cc @dayhaysoos

It would be reasonable to turn these into code snippets but I don't know if Chris has time to add them to this PR.

I noticed the PR contains code but they are not using our code snippets testing framework. Should they be added for tbdex too? cc @dayhaysoos

It would be reasonable to turn these into code snippets but I don't know if Chris has time to add them to this PR.

this is what i flagged in Discord. we're not using Web5 here so need to add test support for the tbDEX SDKs. In all supported languages. This requires some discussion on how to enable this

It would be reasonable to turn these

Spoke with @dayhaysoos about this, I'm going to push to get these done  next week


Fixed translation

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Closed and Reopened this PR to attempt to resolve a specific Travis build failure.

Closed/Reopened again to get around 503 Travis error.

Thank you for your contribution to the page! 👍
We're happy to accept these changes, and look forward to future contributions. 🎉


ci(codecov): update threshold

ref: https://github.com/TanStack/query/pull/7502

I update codecov coverage threshold. because all pr could be as error in GitHub workflow checks

I don't know why codecov is suddenly failing, but cherry picking this commit in my PR still results in a codecov error.

For some reason codecov shows a commit from 3 months ago as base instead of the last commit on main.

There is this error message for codecov uploads on main ci:
info - 2024-05-27 18:16:24,691 -- ci service found: github-actions
Error: Codecov token not found. Please provide Codecov token with -t flag.
Warning: Codecov: Failed to properly create commit: The process '/home/runner/work/_actions/codecov/codecov-action/v4/dist/codecov' failed with exit code 1

I think this can only be fixed by using a token to upload the reports.

new baseline is uploaded correctly, but why don't we see the CI check here or a comment from the bot?

also, different thresholds per package would be really appreciated. We have vastly different coverage per package

also, different thresholds per package would be really appreciated. We have vastly different coverage per package

We could make it informational

Not ready to start using blocking status checks? Set them as informational while you and your team get started with code coverage.


Create Schema Registry URI without basic auth baked in

The Schema Registry URI we use comes with basic auth credentials for the avnadmin user baked in. To avoid this, generate the URI from the service.Components list instead.
Users should use their own credentials when using the Schema Registry (assuming this is possible, waiting for verification from Aiven).
If it turns out you can't use client certificates with the Schema Registry, we need to make changes to provide the teams service user password in the secret, instead of using the common avnadmin user.

Got a response from Aiven, schema registry only supports basic auth at this time. With that in mind, this PR needs to be extended to provide credentials for the schema registry (but still not baked into the URI I think). I will test to see if the service users can be used, or if indeed we have to use the avnadmin user for this.
Converted the PR to a draft while I work on the new needs.

I've added code to provide the username and password from the service user in the secret. These can be used with SASL authentication, but we primarily want teams to use client certificates, so I'm naming them as if they are schema registry specific.

Use url.URL and build it using String() instead of string interpolating it?

I can do that.

How about including the basic auth credentials in the URL instead?

The reason this came up to start with is that the schema registry URI had credentials included. Some libraries in some languages insist on logging the full URL when an error occurs, which leads to logging the credentials. By moving them out of the URI and providing them explicitly as basic auth credentials, that problem should go away.

Use url.URL and build it using String() instead of string interpolating it?

I can do that.

Looking at the docs for url.URL, it doesn't take a port. If your URL includes a port, you must interpolate it into the host field. Changing to use url.URL will not do anything other than shortening the formatstring used when interpolating. I don't see the point tbh.

Should the env vars be named KAFKA_SCHEMA_REGISTRY_* perhaps?

I had a reason for not naming them like that, but I don't remember what it was, so I'll change them.

I had a reason for not naming them like that, but I don't remember what it was, so I'll change them.

Fixed. @ambientsound please take another look.


Add an user friendly Events Aggregation example

Fix a bug on EventsAggregationITest
@jshaughn this should be an easy PR.
It adds a new example to make more easy to start with the Extension/Alerter.

Thanks @lucasponce !


Misclaneous improvements

To be done by the trainee in 2016 before trying to improve anything else:

[ ] Update image and README.md to be like this.

[ ] Use <package format="2"> in package.xml files.

[ ] Fix code style (some little errors here and there).

[ ] Remove this-> whenever possible to simplify code.

[ ] Rename variables:

grind_depth_ > maximum_depth_of_pass_

covering_ > covering_percentage_

[ ] Improve error messages (eg: print file name here bezier_library.cpp#L29).

[ ] Document the project clearly, images etc. Explain in detail the parameters:
grind_depth_, effector_diameter_, covering_, extrication_coefficient_, extrication_frequency_

[ ] Determine the VTK release version to include the VTK stripper fix and update the documentation accordingly. Also change the CMakeLists.txt to require this particular minimum version.

[ ] Add Travis CI continuous integration (+ tests if needed). Note: We need a VTK ppa including the fix for that to work! (https://launchpad.net/~nschloe/+archive/ubuntu/vtk-nightly)

[ ] Specify in the dependencies that VTK has to be compiled with OpenGL back-end because PCL does not support OpenGL2 back-end (see https://github.com/PointCloudLibrary/pcl/issues/1275). Add a check in CMakeLists.txt and abort configuring if VTK was built with OpenGL2.

[ ] Test if https://github.com/ros-industrial-consortium/bezier/issues/12 is still there with newer VTK versions. If not, close the issue.

[ ] Simplify bezier_application package.

[ ] Allow providing a lean angle for the pose generation (axis / angle).

[ ] Benchmark dilation time (number of faces in the model, distance of the dilation, etc..). Create an issue on the bug tracker with the figures. Check if newer VTK versions are faster. Check if there is a possibility of acceleration (multi-threading, GPU or whatever...)

[ ] Improve Doxygen documentation (some functions are not documented)

Fixed with #17


Ability to grab track metadata (tempo change messages?)

I'm converting an old DirectMusic application to use TML. I need to seek/loop to a specific part of the song, but the application I am using has the time stamps encoded in MUSIC_TIME (which is relative to tempo). In order to determine the actual milliseconds offset within the song, I need to seek from the beginning and see all tempo changes.
If the midi header has tempo data, it would also be useful to have that available, in case no change tempo messages are in the stream.

Because tml consists only of messages after loading it would either have to create a fake message which contains the divison (ticks per beat) of the MIDI header or extend tml_load with an optional second parameter that gets filled with that value. Other than that there is no tempo defined in the header. It is defaulted to 480000 for MIDI until a SET_TEMPO arrives.
Leaving the SET_TEMPO messages in the accessible messages would be possible but due to the layout of tml_message it would be kinda weird/confusing because the 3 byte integer tempo value ends up in channel, key and velocity. Adding even more unions would make this less weird in one way but more confusing especially for projects that don't need the tempo info.
Maybe leave it weird and have a int tml_get_tempo_value(tml_message* set_tempo_message) function that returns the 3 bytes value properly would be a good solution.

Speaking of that default tempo, the value you mentioned (and in the code) seems wrong - Shouldn't it be 500000? When I googled, I saw that fluid synth has that 480000 value, but as far as I can tell, it's a bug there too (?).
I have a midi file with division = 240, at 120bpm, and the first note is at 1.85 seconds. The ticks value for that is 888.
888 ticks * 480000 [µs/quarter note] / 240 [ticks/quarter note] / 1000 [µs/ms] = 1776 ms
Having looked at this in a separate midi debugger, the 1776 ms value is definitely wrong.
The midi file also has a SET_TEMPO at 0 delta time, with a value of 500000 (120bpm), so:
888 ticks * 500000 [µs/quarter note] / 240 [ticks/quarter note] / 1000 [µs/ms] = 1850 ms
Should I file another bug for this?

I tried commenting out the SET_TEMPO reaction code, and tested the song length vs a different midi player. When I have the constant set to 500000, I get a track length of 7.95s, which matches my other midi player. When I have the constant set to 480000, as it currently is in the code, I get a track length of 7.632s.
So yeah, I'm thinking bug.

I just committed 5506592

Leave MIDI messages of type SET_TEMPO accessible in the linked list
Add tml_get_tempo_value function to read the tempo value as int

So the TML_SET_TEMPO enum entry is now in the public header and such messages are in the linked list like any other channel based message.
A cleaner way of reading metadata would be nice but for now this is a minimal change. The SET_TEMPO messages were already allocated and in memory anyway, they just weren't accessible by the linked list.
A decade or so ago I showed embedded lyrics alongside MIDI playback in some game I made. I always wanted to support text metadata in tml but it either gets kinda hacky or it doesn't feel 'Tiny' anymore. Maybe one day (-:

Tried it out. Seems to do everything I need it to!
TY :)


Change the default font size for the Medium Scale

❔ Question
What's the proper way to change the base font-size site-wise?
Tangentially related to this issue, but different.
🔦 Context
I'm building a Gatsby website. The default font-size for the Medium Scale is --spectrum-global-dimension-font-size-100, too small. Even your Explore React Spectrum uses the bigger --spectrum-global-dimension-font-size-200.
I'm trying to set that as the default, but the following doesn't work:
body,
html {
  font-size: var(--spectrum-global-dimension-font-size-200);
}

This is in a global.css, but I suppose that <Provider> overrides it.
Could you please advise?
Thank you!

@undavide I believe you would have to make a custom theme, specify your new font-size there, and provide that to your Provider.

@undavide I believe you would have to make a custom theme, specify your new font-size there, and provide that to your Provider.

@undavide did you get it? How could I reset the font-size?


Time Services need cleanup relative to requirements

Per CCB on 3/27/19, Time Services goes way beyond it's requirements.  Need to re-evaluate configuration options and reduce mission specific code.
As part of the cleanup, factor out duplicate code.  Specifically referenced at code review in command handling.

CFE_TIME_SetTimeCmd, CFE_TIME_SetMETCmd, CFE_TIME_SetStcfCmd, and CFE_TIME_SetLeapSeconds are all basically the same logic, etc.
break of files #1322, specific note from CFS-43 was the lack of a cfe_time_tone.h
CFE_TIME_ToneSendGPS and CFE_TIME_ToneSendTime are basically the same logic, refactor
#1536
#1535
Mutually exclusive defines could just be a boolean (but will likely go away w/ refactor), note cfe_time_verify.h is excessively complex at this point
https://github.com/nasa/cFE/blob/84ba9a9974794e239b989cdc4e2359216e44fab0/modules/time/fsw/src/cfe_time_verify.h#L43-L51

Imported from trac issue 271.  Created by jhageman on 2019-04-01T09:44:50, last modified: 2019-05-23T16:43:54

Suggestions - Explicitly define TAT pulse and 1Hz pulse, the system should handle various configurations (any combination of 'virtual/internal' and external/API, synced or not)
TAT pulse source selection (SetSource) should be generalized to 'virtual' or passed to PSP, or get triggered via API
1Hz pulse source selection (new) should be generalized to 'virtual' or passed to PSP, or get triggered via API
MET source selection (new) should be generalized to 'virtual' or passed to PSP, or passed in via API
1Hz pulse when external shall flywheel after mission config elapsed time without a pulse (missing requirement)
Really TIME ifdefs need to be removed, and TIME should just do what's requested when requested.
Note #518 will fix some of the requirements but not all, so revisit after that update.

Note set clock state is not exactly the same as cTIME2012, the external time mode since it also does VALID/INVALID.  Code could be simplified.

See cTIME2013 - need to simplify configuration to adjust SCTF when requested (regardless of mode).

SetSourceCmd - not well defined requirement or implementation.  Suggest updates per the 1Hz comment above (sort of tied 1Hz cycle to Tone but needs work).

CFE_TIME_Locaal1HzISR related design also needs cleanup and implementation is not consistent with CFE_TIME_Tone1HzISR.  Wouldn't expect an "ISR" to be exposed in an API, Tone1HzISR has an ExternalTone API wrapper, etc.  See also #551 which only fixed the duplicate prototype, but bigger issues should be addressed as part of refactor.

Per CCB on 3/27/19, Time Services goes way beyond it's requirements. Need to re-evaluate configuration options and reduce mission specific code.
As part of the cleanup, factor out duplicate code. Specifically referenced at code review in command handling.

CFE_TIME_SetTimeCmd, CFE_TIME_SetMETCmd, CFE_TIME_SetStcfCmd, and CFE_TIME_SetLeapSeconds are all basically the same logic, etc.
...

This first point is addressed here (excl. CFE_TIME_SetLeapSeconds() which does not have enough common logic to justify being included):

https://github.com/nasa/cFE/pull/2340

Also noted in code review, inconsistent parameter names used in the APIs (Time1/2, TimeA/B). Improve consistency.

This is addressed here:

https://github.com/nasa/cFE/pull/2342


„Something broken. I'm shutting down.“

Please excuse I am asking such a trivial question! Is possible to use homebridge-telegram and another telegram service like in home assistant at the same time?
I am running Homebridge-telegram successfully for about one year. Now I tried home assistant and configured the same api_key and chat_id. And then suddenly, Homebridge-telegram has been sending me error messages with „Something broken. I'm shutting down.“
How can I fix that and use both services with the same bot and chat?

Had the same issue when trying to use my already in use Telegram bot for a Dafang service.
Ended up in creating another bot for the new service.
Dunno if this is the best practice...


Imports not resolved

use std::time::Duration;

fn main() {
    Duration::<|>
}

The completion doesn't work in this case. Also, the tooltip says "Failed to exactly resolve the symbol".

most likely https://github.com/rust-analyzer/rust-analyzer/issues/523 or https://github.com/rust-analyzer/rust-analyzer/issues/231 (specifically, glob import support).

I don't think glob imports are involved, but std::time::Duration is a re-export from core::time. Do you think it's #523?

Yep, looks like it!

Completion or resolution of associated method calls is simply not implemented yet.

The associated method limitation seems pretty big, should we open an issue for it?


Make sections settable for object editing purposes.

Any particular reason to make the setter private? I find it useful to be able to modify the sections for changing metadata information, adding new objects / modifying those objects, etc. Currently using this project to build a custom editor, so its useful to have all of the objects modifiable.

There is no reason to leave sections not settable anymore. I have long wanted to implement beatmap writing and making sections settable would be a good first step.

We can start working on that soon if you want, it'll be super useful
It'll make this so much easier to add a save function to if its right in this library

Sounds great! Will open a pull request after i push some important changes.

Actually, this is probably not a good idea. I don't think you'll be able to push changes to my branch.

I have a beatmap-writer branch now where i have already pushed general section writer.


Lock to the current folder

@addyosmani requested an option to lock it to the current folder so it won't switch if you go to another folder with a gulpfile.

Closing as this app is now deprecated.

Closing as this app is now deprecated.


Install python3 as part of the image

Python3 is required and called when metallb wants to reload the configuration, to call the reloader script.

/lgtm


Reminder to HR people that their employees are booking pubs

One of the reasons some HR people could not consider this is that they personally don't book pubs and forget to consider the fact that their employees do book pubs.
So we need to say that. We need to remind them that their employees are booking pubs to host their parties and celebrations.
This is the idea:

Right before the "This is how it works" title, we put the following line:
"Your employees already book pubs to host their parties and celebrations (birthdays, promotions, graduations, farewells, etc.) so why not give them another reason to celebrate?"
Yes, the full line in bold text.
Thanks 👍

Fixing the phrase:
"Your employees already book pubs to host their parties and celebrations (birthdays, promotions, graduations, farewells, etc.) so why not give them another reason to celebrate."
I removed the "?" at the end of the sentence.
👍

This have been added directly on staging.

This have been added directly on staging.

Thanks. It's missing the bold letters. 👍
Also please note that on Staging the Employees Benefit is not there as it is in Master.

Added it to be pushed to master this week.
Please be aware of the bold letters ;)
Thanks 👍

@RohrerHope & @lcoenen here we have a good example why I wanted to have dedicated tags with "Radu on it" etc. The issue is assigned to me and Loic works on it. It's not a big deal but I can't check every single issue that is assigned to me in detail before I start working on it, to be sure that no one took over.
What's the status with this now?

@buckwierd it's done as stated in the commit above. It is true we should be careful of updating the assignees.

Approved in staging 👍🏼

Approved in staging 👍


Automate - Add /System/Process/MiqEvent instance.

The new MiqEvent instance enables a user to create custom buttons and use simulate for MiqEvents.
https://bugzilla.redhat.com/show_bug.cgi?id=1348605

@gmcculloug I used event_type to be consistent with the event instance, but agree that "request" makes more sense here. Change made.


"mxnet.image.imdecode"  can not decode uint16 type image

Description
i encode depth map(uint16) to rec file, and use "mxnet.image.imdecode" api to gen ndarray, but i find that ndarray's type is uint8.

Hello @ronyuzhang
Can you please provide a minimum reproducible example?  This will help the members to debug the issue further. I looked at the documentation for mxnet.image.imdecode, it does not mention such limitation.
Thanks

@mxnet-label-bot add [NDArray]


[Request for External] page 408 "G/L Balance by Dimension" - GenerateColumnCaptions

Can you change procedure GenerateColumnCaptions to protected?

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.


Automated Release script and workflow

Summary
Background:
trigger can be manual, build/upload for 3 platforms should be automatic
add auto release script for darwin arm64
add githubactions for linux and darwin amd64
Description
using github.com/github-release/github-release for uploading assets
Related Issues
#364
Current Behavior
Describe the current behavior of this issue, if relevant.
New Behavior

build/package/ contains other files, such as build_linux_amd64.sh and Dockerfile

Yes, so what I mean is delete all files under the build/package. They are no use after release with gh-actions.


Use Android Architecture Components

Google I/O unveiled a new set of Android Architecture Components, and it seems some components, like LiveData and ViewModel, fit almost perfectly to the functions performed by the library. Are there any plans to use these components when they' are stable and are compatible with the support libraries?

@TheCraftKid Yeah, I definitely think that would be awesome to support!!! At the moment I've been reeling from all the announcement and updates at I/O so I've been overwhelmed with trying to learn Kotin and updating my app with all the new stuff. Once I have the time, I'd love to take a look at that and how we could implement it. 😄 For now though I think I have enough open PRs 😆

@SUPERCILEX I'd be happy to submit a PR while the rest of FirebaseUI is being sorted out.

@TheCraftKid Go for it! 😄 (Just make sure to base your PR off the version-2.0.0-dev branch)

Okay, I got a bit excited, and while the components will change before release, I think I can begin the process of implementing LiveData.
The first decision to make when implementing this is composition vs inheritance. In the 2.0.0 branch, FirebaseArray extends CachingObservableSnapshotArray which extends ObservableSnapshotArray which extends ImmutableList. Making ImmutableList extend LiveData doesn't make sense, so I'm thinking we make ObservableSnapshotArray implement List and have it extend LiveData instead.
What are your thoughts, @SUPERCILEX?

@TheCraftKid Nope. 😆 You're getting there though! 😀 You're right about the composition part, but extending ImmutableList is a hard requirement so we can't change that. Instead of updating the existing classes, let's make a new class that extends LiveData and takes in an ObservableSnapshotArray in the constructor. Then, you can add a listener to the snapshot array and notify the livedata of changes whenever they come in.

I'm curious about how LiveData notify the partial data updated (onChildChanged).
In google sample, I see they use DiffUtil stuff to calculate the partial data, which is unnecessary for library like Firebase has onChildChanged API already.

@TheCraftKid @b95505017
Hello everyone,
I've finally gotten around refactoring my app to use Arch Components and it's amazing! However, now that I'm more familiar with the AC api, I've realized that LiveData doesn't work well with the Firebase model of multi-state updates.
So LiveData is out of the picture, but what we can do is auto subscribe and unsubscribe from events for you!!! This is truly what makes AC amazing! Like what Yigit said on ADB, AC will enables libraries to remove those annoying startListening and cleanup callbacks. This is what I've done in #827.

Marking this as fix-implemented due to @SUPERCILEX's change and investigation.

The fix for this issue was released in version 2.2.0.


Scroll does not work well in Firefox

Already solved by https://github.com/egoist/vue-monaco/pull/54, only need a new release to npm!
See comment https://github.com/egoist/vue-monaco/pull/54#issuecomment-530613366

In the meantime I have an updated fork published here: https://www.npmjs.com/package/vue-monaco-d0x

Fixed in 1.2!


Error during upgrade: User "system:serviceaccount:system-upgrade:system-upgrade" cannot delete resource "pods"

Version

v0.13.4
Platform/Architecture

linux-amd64
Describe the bug

During an upgrade from k3s v1.29.3 to v1.30.2 with system-upgrade-controller v0.13.4 the Pods triggered by the upgrade apply-os-upgrade job fail early with Init:Error.
To Reproduce

Upgrade from k3s v1.29.3 to v1.30.2 with system-upgrade-controller v0.13.4
Expected behavior

Successful upgrade
Actual behavior

Early failure during upgrade
Additional context

Inspecting the logs of the drain InitContainer, the failure is caused by the following error:
User "system:serviceaccount:system-upgrade:system-upgrade" cannot delete resource "pods" in API group "" in the namespace "cert-manager"

This suggests a missing pods delete permission in the system-upgrade-controller-drainer ClusterRole.

I have the same issue, but I can't start the pod.
Fresh installed k3s v1.30.3
Pod logs:
W0806 22:45:48.476270       1 client_config.go:615] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2024-08-06T22:45:48Z" level=fatal msg="Error starting: namespaces \"kube-system\" is forbidden: User \"system:serviceaccount:system-upgrade:system-upgrade\" cannot get resource \"namespaces\" in API group \"\" in the namespace \"kube-system\""

We are on the same boat then @lexfrei
cc. @brandond could you please take a look at the linked PR thanks!

IDK why, but it just self healed on the night. Just found it's alive now.
My installation: https://github.com/lexfrei/k8s/commit/3e92bfca26ab1e3be39fd5ed17b3ab1a349f84f7


CRL addresses for App Proxy

Has this document been updated with this bulletin:
https://docs.microsoft.com/en-us/azure/security/fundamentals/tls-certificate-changes
[Enter feedback here]

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 861ceb04-ecea-4eb3-62b5-14163d12e3f2
Version Independent ID: edac4607-e5d1-4d17-0af5-9ea432bfc5c6
Content: Tutorial - Add an on-premises app - Application Proxy in Azure AD
Content Source: articles/active-directory/manage-apps/application-proxy-add-on-premises-application.md
Service: active-directory
Sub-service: app-mgmt
GitHub Login: @kenwith
Microsoft Alias: kenwith

As per the linked advisory above it looks like these need to be open on the firewall:
If you have an environment where firewall rules are set to allow outbound calls to only specific Certificate Revocation List (CRL) download and/or Online Certificate Status Protocol (OCSP) verification locations. You will need to allow the following CRL and OCSP URLs:
http://crl3.digicert.com
http://crl4.digicert.com
http://ocsp.digicert.com
http://www.d-trust.net
http://root-c3-ca2-2009.ocsp.d-trust.net
http://crl.microsoft.com
http://oneocsp.microsoft.com
http://ocsp.msocsp.com
http://www.microsoft.com/pkiops

@Coopem16
Thanks for your feedback! We will investigate and update as appropriate.

Thanks! I made a pull request to add a note. https://github.com/MicrosoftDocs/azure-docs-pr/pull/139698

Thank you. Any Idea when that will be complete?


Add space between list elements in motion text and pdf

@normanjaeckel I have to merge it now. Please review later. Thanks!

Ok.


Fix for not being able to ignore shadowing warnings on class scope

Fixes #75208
Unifies the code for checking both the class scope and local scope shadowing of variables inside the 'is_shadowing' function from the gdscript analyzer. The class scope shadowing was being incorrectly checked during the parsing stage, and thus the annotations to ignore warnings were not being taken into account.
Adds two new scenarios to the shadowing unit test that check for a class level shadow warning. Validating that it correctly appears when there's no annotation present and that it doesn't when there's an annotation that ignores it.
Modifies another test that would start breaking with this change as it contained a variable that was shadowing a global one but wasn't being detected as such.
This is my first PR :) please let me know if I'm missing something!

fixed formatting by running clang-format locally on every file and force pushed the changes into the same commit

Hi @jpcerrone! Sorry for the delay.
Thanks for your "first PR"! I saw that you finally contributed to the Godot game engine, so congratulations.
I set the milestone to 4.2, as we're close of launching 4.1. But I added your PR to the list of PRs that the team will have to review soon.
Thanks again for your contribution. You'll get news soon!

Hi @jpcerrone! Sorry for the delay. Thanks for your "first PR"! I saw that you finally contributed to the Godot game engine, so congratulations.
I set the milestone to 4.2, as we're close of launching 4.1. But I added your PR to the list of PRs that the team will have to review soon.
Thanks again for your contribution. You'll get news soon!

Thank you!!

Looks good to me! I have tested these changes, works fine. While I've noticed that shadowing warnings are not generated in some cases, that doesn't seem to be relevant to this PR. Note that the PR still needs to be reviewed at the GDScript team meeting. Also, this PR should be rebased so that CI will run tests for all platforms.

Got it, branch rebased

Thanks!


Disabling MPI's (deprecated) C++ interface

Fixes #3475
Proposed Changes
Disable MPI's (deprecated) C++ interface.
Any background context you want to provide?
Including mpi.h might result in undefined references since it contains both the C and C++ interfaces but HPX only links against the C runtime. As HPX only uses the C interface, the C++ interface can be safely disabled to resolve the linker errors.
#3477 can be closed after merging this PR since it only provides an alternative fix.

Please fix the inspect error: https://circleci.com/gh/STEllAR-GROUP/hpx/37978?utm_campaign=vcs-integration-link&utm_medium=referral&utm_source=github-build-link

I have updated the PR to fix the inspect error.


Course setup, Pytorch CPU

Hi - I've followed the instructions to setup an environment for the course on my machine. The only difference I am aware of is that miniconda was pre-installed.
When following the instructions, the version of pytorch installed was cpu only. To fix that, I ran the following command:
conda install pytorch=1.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia
This seems to have resolved it for me.

Sounds good! The setup.ipynb notebook asks people to go to the PyTorch homepage to choose their preferred method of installing PyTorch. As far as I know, this is the best solution for now, as the best choice is highly dependent on people's goals and computers.


Fix issue with header not showing on PPP

Pull Request Test Coverage Report for Build 466

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 64.234%

Totals

Change from base Build 465:
0.0%

Covered Lines:
2042

Relevant Lines:
3179

💛  - Coveralls


Elements in a flow down are jumping around when updated

I was designing a simple menu system and found that when I added a time signal for a fade in, the elements started bugging out and jumping around oddly. Without this quickly updating time signal, it still happens, but very rarely. I don't have any guesses as to what's causing it.
Problem example, cut down to show the bare minimum needed to reproduce it, as far as I can tell:
import Window
import Keyboard

menu (w, h) select t =
    container w h midLeft . flow down <|
        map (\s -> (if (s == select) then color grey . container w 20 midLeft else id) . plainText <| s)
            [ "new"
            , "resume"
            , "settings"
            , "quit"
            ]

step {x, y} (s, n) =
    let ss = ["new", "resume", "settings", "quit"]
        n' = clamp 0 3 (n - y)
    in  (head . drop n' <| ss, n')

selected = foldp step ("new", 0) Keyboard.arrows

main = menu <~ Window.dimensions ~ (fst <~ selected) ~ (count <| fps 60)

You can view it here: http://share-elm.com/sprout/521c2544e4b098db14c54c13/view
You use the keyboard up/down arrow to select different options. Sometimes when you move, the text jumps around and gets bunched up, and the highlight bar doesn't extend very far to the right.
But if I take out the count <| fps 60 the problem mostly goes away (but will still very rarely happen):
import Window
import Keyboard

menu (w, h) select t =
    container w h midLeft . flow down <|
        map (\s -> (if (s == select) then color grey . container w 20 midLeft else id) . plainText <| s)
            [ "new"
            , "resume"
            , "settings"
            , "quit"
            ]

step {x, y} (s, n) =
    let ss = ["new", "resume", "settings", "quit"]
        n' = clamp 0 3 (n - y)
    in  (head . drop n' <| ss, n')

selected = foldp step ("new", 0) Keyboard.arrows

main = menu <~ Window.dimensions ~ (fst <~ selected) ~ (constant 0)

Which you can see in action here: http://share-elm.com/sprout/521c2676e4b098db14c54c15/view

I am trying to clean up the issues in this repo, so I am going through and closing a bunch of issues with ideas on how to get them done.
In this case, we should verify that the issue still manifests and if so, open an issue at https://github.com/elm-lang/core/issues


[Event Request] codeunit 7302 "WMS Management" procedure GetDestinationEntityName()

Please can you add the following event/code at the end of the case statement in the above procedure...
else
    begin
        OnGetDestinationEntityName(DestinationType, DestName);
        exit(DestName);
    end;

with a local variable...
var
    DestName: Text[100];

The event publisher would be...
[IntegrationEvent(false, false)]
local procedure OnGetDestinationEntityName(DestinationType: Enum "Warehouse Destination Type"; DestNo: Code[20]; var DestName: Text[100])
begin
end;

Is there any extra info you need for this?
The Enum "Warehouse Destination Type" is extendable so it make sense to have this event to be able to return a name/description for the new entity that you are adding to the enum.


[Node.js SDK, Question] How to know when message was sent, via callback or other method?

Hello guys,
I have already saw the issue #1558 related to botbuilder on AWS lambda (nodejs). I was able to make it work but now I'm trying to integrate botbuilder (NodeJS) with a library called claudia-bot-builder (https://github.com/claudiajs/claudia-bot-builder), and as far as I investigated I need to now exactly when messages have been completely sent to the network.
I don't completely know the internal code of the claudia library so I'm following the implementations they use for other chatbots to expand for botbuilder. I'm returning a promise to a module of the library and trying to resolve it on the correct moment that the message has been sent. What I tried:

Resolve it on the 'end' call of the response object of the connector.listen(). Same suggestion as #1558. As I said, it works when I'm using lambda and botbuilder alone but it does not work when I'm integrating it with claudia in this way (not sure why, why lambda would be waiting the message to be send after I called the lambda callback but not after my returned promise is resolved on the second case?)
Resolve it on the 'send' middleware event of the UniversalBot. I install the middleware on UniversalBot.use and resolve on the send method.
Add listener to the 'outgoing' event on UniversalBot.on('outgoing', ...).

None of these things worked correctly. The first message from the user does not receive a response. On the second message, the first message is answered (there is something that only finishes execution on the next lambda call).
Finally I use the setTimeout with a timeout of 1500ms inside the outgoing event and this way the the messages are correctly responded. So the message is taking some time to finish execution and when I resolve the promise lambda stops execution right after it.
Is there some way of knowing when the message was completely sent to make it work?

Please open a new issue if you are still experiencing problems


mp_land.jnl and mp_land_detail.jnl need to better handle modulo-longitudes

Reported by ansley b manke on 16 Apr 2009 20:53 UTC
mp_land_detail.jnl has one section where it does
! Draw any lines outside 0 to 360
where it adds or subtracts 360 from the values for continental boundaries. The lines representing boundaries of countries, states, and rivers don't get that treatment.  And, the older script mp_land.jnl doesn't do this at all.
Migrated-From: http://dunkel.pmel.noaa.gov/trac/ferret/ticket/1654

Comment by ansley.b.manke on 1 Apr 2015 22:06 UTC
This was resolved with the fix to ticket #1946.  Both mp_land.jnl and mp_land_detail.jnl do modulo replications of the national and state boundaries; and mp_land_detail also does the same for the rivers and marine boundaries.


Wildcard support for make mth5 from FDSN

Currently, issue #252 works around wildcards by using data_availability tables built by Laura's ipynb get_MT_numbers.ipynb.
Using a single * for channels does not work in a request df, but using *F* does work (in limited testing) for pulling all magnetomter channels.
It should be tested that passing ['F', 'Q'] as a channels list works for widescale mth5 building.

The wildcards do not work for making dataless mth5 (stage 02 of widescale testing).
The issue is in the get_inventory_from_df method  of mth5/mth5/clients/fdsn.py.
around line 463 is the following code:

returned_chan = cha_inv.networks[0].stations[0].channels[0]
returned_sta.channels.append(returned_chan)

which assumes there is only one channel returned from the query.
This could possibly be substituted with a loop for each channel.  Another solution would be to reform the dataframe without wildcards before the request.
This might involve:
tmp_inv = client.get_stations(ch_row.start, ch_row.end, network=ch_row.network, station=ch_row.station, level="channel")
channels = tmp_inv[0][0].channels
channel_codes =  [x.code for x in channels]

And then we could, for example melt these channel codes over the dataframe row.
The first option is a fairly quick fix, but adds complexity to an already complex piece of code.
The second option will be simpler to debug in future if needed.
With the second option is that the request_df may have many rows with wildcards, and
some uniqueness-checking should be done after it is wildcard-expanded.


error/warning count in output

I was just doing some work on generating an epub from the specs and got to thinking it would be nice to see the total error/warning count after the message that the file contains errors.
When I'm tweaking xslts, it's not always clear if I've fixed the problem without scrolling back through all the messages output to the console. A count would at least give me a quick visual whether things have gotten better, worse or stayed the same.
Anyway, another of my non-critical feature requests...

While this is very easy to implement as Check finished with 5 warnings, it may break all those tools which rely on or grep the message Check finished with warnings / Check finished with errors.
Therefore I would suggest to include a message counter at the very end like this:
Current:
…

Check finished with errors

epubcheck completed

Suggestion:
…

Check finished with errors

0 fatal errors
3 errors
5 warnings
2 informations
10 usage messages

epubcheck completed

or in a one-liner:
messages: 0 fatal errors / 3 errors / 5 warnings / 2 informations / 10 usage messages

What would you prefer, @mattgarrish?

I'd vote to save space and go with the latter. The more actual errors you can read from the command line without scrolling the better.
You could maybe save some further space by trimming to:

messages: 0 fatal / 3 errors / 5 warnings / 2 informational / 10 usage


Test parser [Do not Merge Yet]

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Files with missing lines
Coverage Δ
Complexity Δ

...eedu/address/logic/parser/SearchCommandParser.java
88.88% <100.00%> (+33.33%)
7.00 <0.00> (+2.00)

... and 8 files with indirect coverage changes


How to read the bytes of a VirtualFileSystemFile?

Hi, I'm trying to access the bytes of my sqlite database file. How do I do that on the web? xOpen and xRead are super confusing and I can't find an example.
Working none-web implementation

import 'dart:async';
import 'dart:io';
import 'dart:typed_data';
import 'package:path_provider/path_provider.dart';
import 'package:sqlite3/common.dart';
import 'package:sqlite3/sqlite3.dart';

Future<CommonDatabase> loadDb() async {
  final applicationDir = await getApplicationDocumentsDirectory();
  final file = File(applicationDir.path + '/foobar.db');
  return sqlite3.open(file.path);
}

Future<Uint8List> dbBytes() async {
  final applicationDir = await getApplicationDocumentsDirectory();
  final file = File(applicationDir.path + '/foobar.db');
  return file.readAsBytes();
}

Not working web implementation

import 'dart:async';
import 'dart:io';
import 'dart:typed_data';
import 'package:sqlite3/wasm.dart';

Future<CommonDatabase> loadDb() async {
  final sqlite = await WasmSqlite3.loadFromUrl(Uri.parse('sqlite3.wasm'));
  final fileSystem = await IndexedDbFileSystem.open(dbName: 'foobar');

  sqlite.registerVirtualFileSystem(fileSystem, makeDefault: true);
  return sqlite.open('foobar.db', mode: OpenMode.readWriteCreate);
}

Future<Uint8List> dbBytes() async {
  final fileSystem = await IndexedDbFileSystem.open(dbName: 'foobar');
  final open = fileSystem.xOpen(
      Sqlite3Filename('foobar.db'), SqlFlag.SQLITE_OPEN_READONLY);
  print(open.file);
  return (open.file as File).readAsBytes();
}

Thanks!

There's a somewhat-related example here.
We're not using dart:io files on the web and instead mirror structures used by sqlite3 internally, which is also the reason the methods are named the way they are. So the way to go is to xOpen the file as you're doing it, and then call xRead with a Uint8List that you've allocated (you can use xFileSize() to get the current size) to read bytes from the file into a buffer. Then you just need to xClose() the file after you're done. I didn't test this, but I imagine something like this should work:
Future<Uint8List> dbBytes() async {
  final fileSystem = await IndexedDbFileSystem.open(dbName: 'foobar');
  final open = fileSystem.xOpen(
      Sqlite3Filename('foobar.db'), SqlFlag.SQLITE_OPEN_READONLY);
  final buffer = Uint8List(open.xFileSize());
  file.xRead(buffer, 0); // read from offset 0 (entire file)
  file.xClose();
  fileSystem.close();
}


metric prefix gone in latest version?

I used the old version. Run in k8s pod that has an option for changing metric prefix: (METRICS_PREFIX)
https://github.com/redpanda-data/kminion/blob/ff5320fcf44d830f69a33b88d61dcd484937fa98/README.md
Since I do have multiple clusters, in the past I used to change the metric prefixes for each cluster for easy management.
But right now that option has gone / no effects at all. How i can do it in the current version (redpandadata/kminion:v2.2.3 ) or do you guys have a better way to do it?

LOL. I don't know why you guys don't write a document for environment variables for this or removed :joy:
I have to read the code to see how it works.
Old version: https://github.com/redpanda-data/kminion/blob/ff5320fcf44d830f69a33b88d61dcd484937fa98/options/options.go#L51
Current version ( 2.2.5 ):
https://github.com/redpanda-data/kminion/blob/master/docs/reference-config.yaml#L162C13-L162C13
So from what I'm finding, it is EXPORTER_NAMESPACE

@BlackMetalz KMinion adheres to semver releases. You linked a very old commit, which belongs to version 1 (written 4 years ago). Version 2 has been released more than 2 years ago and no breaking changes have been made since then. All configurations are documented here: https://github.com/redpanda-data/kminion/blob/master/docs/reference-config.yaml , the env variable names are auto generated based on the indentation as described in the linked reference config.

@BlackMetalz KMinion adheres to semver releases. You linked a very old commit, which belongs to version 1 (written 4 years ago). Version 2 has been released more than 2 years ago and no breaking changes have been made since then. All configurations are documented here: https://github.com/redpanda-data/kminion/blob/master/docs/reference-config.yaml , the env variable names are auto generated based on the indentation as described in the linked reference config.

Yep, I understand. That is why I said I have to read in other location, before it was shown in README and I don't need to look at other locations:grin:


Updated programming playground en document (Hacktoberfest 2021)

What does this PR do?
Add resource(s) | Remove resource(s) | Add info | Improve repo
Added resources
For resources
Description
Added URLs for Python playground
Why is this valuable (or not)?
It's free and easy, it's based on the RPG game
How do we know it's really free?
I tested it when learned Python
For book lists, is it a book? For course lists, is it a course? etc.
Checklist:

[x] Read our contributing guidelines
[x] Search for duplicates.
[x] Include author(s) and platform where appropriate.
[x] Put lists in alphabetical order, correct spacing.
[x] Add needed indications (PDF, access notes, under construction)

Follow-up

Check the status of GitHub Actions and resolve any reported warnings!

Already listed.
Remember use repository search before make contributions: https://github.com/EbookFoundation/free-programming-books/search?q=codecombat

/labelthis: duplicated
/lockthis: resolved


update the doc Derivation Concepts

What are the guiding principles to split or combine functions together.
This needs to be clear before open source contributors start challenging our design choices.

@Roche-GSK/admiral-devs , we have discussed the issue and decided that we want to create an overview of the existing functions and future derivations and group them into admiral derivation concepts. This should help to develop guiding principles for splitting and combining functions.
I have created a document (admiral Derivation Concepts) for this.
Please feel free to add to and comment on the document.

I had a go at this.  Basically just dumped all the functions at the bottom of the document and trying to work through each one.  If I classify one, then I strike it out.
I got the list of all the functions from the Reference section for 0.6.0 release.

I've not been part of all these background discussions here but as you tagged me @bms63 i'll do my best to comment with my understanding. i think the history here comes from the fact we tried to start with the principle of making admiral as flat as possible so each function would create a dedicated variable/parameter. but then i think we got external testing feedback saying we had redundant or very similar functions that could be grouped. so now we're trying to find ways in which to justify when to group and when not to. correct me if any of this understanding is wrong!
in my mind i do think we're moving towards the idea of grouping common derivations around an "analysis concept", e.g. i totally understand why derive_vars_dy() means we could deprecate derive_var_ady(), derive_var_astdy() & derive_var_aendy(). this all links to this related issue https://github.com/pharmaverse/admiral/issues/954 as i see it. as Stefan points out there we would need to be transparent on such analysis concepts to justify our decision making.
Tagging @koegerr in case he wants to add any more.

Thanks Ross.  I have had this issue tagged to me for a while.  I just wanted to make sure it was still relevant.  This takes time to do, but hopefully we can make some more headway on it.

hi @bms63 , I’ve reflected on this one and I would suggest to help new developers and users understand our strategy, we should add an extra bullet to the Usage section of our homepage (so that it’s one of the first things people see) that says something like:

In our effort to create simple modular functions, we sometimes group similar derivations under one “analysis concept” that can be achieved by a single more generic function. Most commonly, this would be for ADaM variable conventions that use the same suffix. An example would be study day variables (---DY) where we have a derive_vars_**dy** function that can be used for all, instead of maintaining separate derive_var_ady,  derive_var_astdy, etc. This is only done for highly similar derivations that does not result in overly generic functions with many different arguments that would become difficult to use. For example, ONTRTFL and TRTEMFL may both use the same suffix (---FL) but the derivations are sufficiently different to warrant their own functions.

Also I don’t think we need this in the above paragraph, but as a development team we have to consider findability of our functions as well. If we end up with lots of overly generic functions with inconsistent namings then people will struggle to find what they need, and will end up relying too heavily on the ADaM vignettes/templates. Maybe it justifies adding to https://pharmaverse.github.io/admiral/articles/programming_strategy.html#function-names-1 an extra naming convention as follows:

derive_var_dy – for grouped functions under one “analysis concept” use the same ADaM variable naming convention suffix, e.g. ---DY in this case

I'll start drafting something for #954 as well, as I see now how it's difficult for new developers to make these calls without a clear documented strategy for function design choices. I had added the Expectations section to the homepage before, but that's too high level I see.

@rossfarrugia , the --DY suffix is a nice example but I wonder if it can be generalized. As you have already pointed out it does not work for the --FL suffix. Do you have other examples where the suffix approach works?
Furthermore, variable derivations are just one half of the derivations. The other one are the parameter derivations. But CDISC does not define any standard parameter codes. Thus we can not use them to group functions.
I doubt that there is a quick solution. I think we need to analyses some hundreds derivations and try to group them based on the steps performed within the derivation. If the steps are similar, the derivations can be done by a single function like derive_vars_dy() or a class of similar functions like the derive_vars_merged_* functions.  I started this in https://exbpbox.box.com/s/hxngtc941diiocghoaoez3r34salkq77. However, this will be a lot of work and take some time.

@bundfussr i've drafted something for #954 this morning and shared with @koegerr for a quick sanity check. if he agrees then will add to our box tomorrow for the core team to check over.
my personal thinking is we shouldn't go overboard with grouping our existing functions (beyond the obvious examples like DY) as it just makes it that one step harder for users to find what they're looking for - and generic functions (although less in number) are not always easy to maintain, test and use, especially for the more complex derivations. for your derive_vars_merged_* I'm OK with including these as extra offerings as they open up flexibility to cover more company-specific needs, but i wouldn't like to see now all our more targeted functions start to get deprecated because of these, especially for the very common needed variables.
anyway, once we agree 954, we can go more into things like parameters and admiralonco will be a good exercise for this. we learn as we go!


Bug: Can't add C310 camera

Describe the bug
Integration ask a cloud password, but C310 does'nt support cloud
To Reproduce
Try to add a c310 cam, last step ask cloud password
Test the tpcamera ( for tplink cloud ) it only support NCxxx cam.

Add it via official tapo app first, then follow instructions in integration.

This is exactly what i done. First installed on my android phone in the official app, and after tested to integrate...
I am sure about the passord...

What are you getting when you enter cloud password?

Password error, something like that, i can test again tomorrow to be more precise, it's late in france ^^

Make sure to follow all the steps. You need to create an account for rtsp stream. Then use that username and password in the integration along with the password of your tapo cloud account.


[Bug]: Pagination scroll to top issue

Give a brief about the bug ✍
On pagination page should be scrolled to top automatically as if now user have to manually scroll to top on every pagination. which is not a great user experience.
Screen Recording
https://github.com/kunjgit/GameZone/assets/68184118/313f6ace-7501-4a22-9d15-75f6d5f1f8ff
What is the expected behavior? 🤔
After paginate page should be scrolled to the top so that user don't have to scroll manullay.
Provide step by step information reproduce the bug 📄

Go to home page
Try to paginate
Page is not getting scrolled automatically

Select program in which you are contributing
GSSoC23
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

Hey @777Prabhjot !
Thank you for raising an issue 💗
You can self assign the issue by commenting /assign in comment 😀
Make sure you follow CODE OF CONDUCT and CONTRIBUTING GUIDELINES 🚀
Don’t Forget to ⭐ our GameZone🎮
Make sure you join our Discord🕹

/assign

/Assign

Hey @777Prabhjot 👋!
@kunjgit here,
Hope you are doing extremely well 😇
It's confirmed 🥳, GameZone is taking part in hacktoberfest and ready to have another 💥
Ready to have some amazing contributions once again also thank you for you support in GSSoC23 you have took us on top 5 ❤🔥
if you still haven't joined us join us on Discord
See you soon 😊

Hey @777Prabhjot 👋!
@kunjgit here,
Hope you are enjoying this hacktober 😀
We are excited to share that we are opening issue from our side where you will be going to add games on our website 🚀
Work on this issue 🔥
and help us building GameZone 💗
if you still haven't joined us join us on Discord
See you soon 😊

Hello @777Prabhjot, Time's Uppp!⏰
Sorry for closing your issue!
But it's more than a week since we haven't received anything from your side 😢 .
Come up with new ideas, create a new issue and make sure you finish it within a week! 🔥
All the best! 🚀
Happy Hacking! 💗

Hey @777Prabhjot ! Thank you so much for your raising the issue💗
It’s all yours, you can come anytime again and make some contributions! 🚀
Alone, we can do little, but together we can do so much! 😇


JWT parse failure and unit test fixes

Found this issue when I was working on the XBL sign in flow.

Fixed issue
Added unit test for this flow
Fixed other unit test (it was 'passing' by swallowing an exception and never evaluating the assertions)

@Fitzpasd, thanks for your PR! By analyzing the history of the files in this pull request, we identified @ProbablePrime and @JamyDev to be potential reviewers.


Module SWXMLHash has no module named parse

I guess this is me not configuring this well. I'm using carthage. I've followed all the steps, but just can't use it why?

Which version of Carthage are you using? Did Carthage report any errors? Which version of Xcode are you using? Which version of SWXMLHash are you targeting in your Cartfile?

I'm using version 0.75 for carthage and in targeting master in my cartfile.
Xcode version is 6.3 and no errors from carthage on build.
Thanks
Sent using CloudMagic [https://cloudmagic.com/k/d/mailapp?ct=pa&cv=7.0.42&pv=5.1] On Sat, Aug 01, 2015 at 11:30 PM, David Mohundro <<EMAIL_ADDRESS><EMAIL_ADDRESS>> wrote:
Which version of Carthage are you using? Did Carthage report any errors? Which
version of Xcode are you using? Which version of SWXMLHash are you targeting in
your Cartfile?
—
Reply to this email directly or view it on GitHub
[https://github.com/drmohundro/SWXMLHash/issues/38#issuecomment-126958586] .[https://github.com/notifications/beacon/AA_7FL00uTMMVFKe2jb6Q7h5kA_UBCZ8ks5ojUAggaJpZM4Fj8p7.gif]

It sounds like Carthage installed everything correctly - could you send the entire file that is failing over?

The file
import Foundation
import SWXMLHash
import SQLite

class FileNavInteractor: NSObject {

  let xmlFile = NSBundle.mainBundle().pathForResource("file", ofType: "xml")
  let sqliteFile = NSBundle.mainBundle().pathForResource("file", ofType: "db")
  static var db: Database!

  func loadXML() {
    // Loading XML
    let xmlData = NSData(contentsOfFile: xmlFile!)
    let xmlParse = SWXMLHash.parse(xmlData) // the failing code
  }

  func loadSQLiteDB() {
    FileNavInteractor.db = Database(sqliteFile!, readonly: true)
  }
}

I think I'm reproducing this locally - I think it is related to a build setting. Do you have any build warnings in addition to the compiler errors?

Hi @casoetan - I just pushed a small change (see 35756609) which seems to resolve my local repro. If you run carthage update again and then try to rebuild, does it now work?

Hey David,
Will try once home.
Thanks
Sent using CloudMagic [https://cloudmagic.com/k/d/mailapp?ct=pi&cv=6.3.16&pv=8.3]
On Mon, Aug 3, 2015 at 15:19, David Mohundro<EMAIL_ADDRESS>wrote:
Hi @casoetan [https://github.com/casoetan] - I just pushed a small change (see 3575660
[https://github.com/drmohundro/SWXMLHash/commit/3575660933fa8d88eb54bfa03de442c4580ae8e8] ) which seems to resolve my local repro. If you run carthage update again and then try to rebuild, does it now work?
—
Reply to this email directly or view it on GitHub
[https://github.com/drmohundro/SWXMLHash/issues/38#issuecomment-127258382] .[https://github.com/notifications/beacon/AA_7FINUKqh8N8zqRRpIPUCN_UA7MT1gks5oj2_kgaJpZM4Fj8p7.gif]

@drmohundro Great. It works. Now back to taking over the world.
God bless

:+1: awesome! Thanks for reporting the issue!

what is solution?

👍 awesome! Thanks for reporting the issue!

what is solution


add Halley

SteamDB app page links to a few games using this

Wargroove
Wargroove 2
Wargroove 2 Demo

Brief explanation of the change
added a rule for an engine that powers (newer) games by Chucklefish Games. their upcoming game might also be Halley, but I have no information bout that unfortunately.

After running changed rules in this pull request (this bot only tests rules.ini changes):
Changed technologies: Engine.Halley
These apps now match: (4)<PHONE_NUMBER>50 1346020 2358940
Please confirm that all these changed apps are correct.

not used by enough apps


Update protobuf build for their upstream changes.

Bazel doesn't seem to list focal (20.x) - https://bazel.build/install/ubuntu. So the steps are a little more complex, but it doesn't seem worth moving our Swift images back to simplify the CI.

We can also go down the path of using CMake if we think that might be better.

We can also go down the path of using CMake if we think that might be better.
Talking to some protobuf folks, CMake will be supported long term, so it should be fine if we'd rather that.

Make a run at this in another PR, and it seems to have some of it's own things to sort out, so for now, bazel seems easier.  Maybe after protobuf documents a linux based CMake build a little more we can revisit it.

Ok, got CMake working in #1273, since it keeps caching, I think I prefer that one. That version also removes support in the Makefile for rebuilding the conformance runner, which I sorta prefer since it lets folks build which ever way they would prefer.


cmd/vet: structtag field repeats json warning with valid override

What version of Go are you using (go version)?

$ go version
go version go1.14.1 darwin/amd64

Does this issue reproduce with the latest release?
Yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GO111MODULE="on"
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/[XX]/Library/Caches/go-build"
GOENV="/Users/[XX]/Library/Application Support/go/env"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOINSECURE=""
GONOPROXY=""
GONOSUMDB=""
GOOS="darwin"
GOPATH="/Users/[XX]/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/Cellar/go/1.14.1/libexec"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/Cellar/go/1.14.1/libexec/pkg/tool/darwin_amd64"
GCCGO="gccgo"
AR="ar"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/dev/null"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/w9/kv18_grs18x65fyzv1p5mvk00000gn/T/go-build893878327=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?
When embedding two structs with duplicate JSON tags, e.g.:
type A struct {
   name string `json:"name"`
   ... // additional fields
}

type B struct {
   name string `json:"name"`
   ... // additional fields
}

type C struct {
    A
    B // raises go vet structtag warning
}

A structtag warning is raised by go vet. I think a reasonable workaround to the warning is to override the duplicate-tag on the top level, per extra rules here: https://golang.org/pkg/encoding/json/#Marshal, e.g.
type C struct {
   A
   B
   name string `json:"name"`
}

But go vet still raises the warning.
Note I did add the flag -structtag=false as a workaround but there are cases where I would like to be alerted, but only when no override has been set
What did you expect to see?
go vet treats top-level structtag overrides as a valid solution and no longer raises a warning.
What did you see instead?
go vet ignores the top-level override, resulting in structtag: struct field X repeats json tag "[X]" also at XXXX.go:XXX (govet)

/cc @alandonovan (per owners) @ianlancetaylor @matloob.

It does this for the "-" tag as well.

any update on this ?


I made changes in dark & light mode

Please review this changes and approve
fixes issue #103
in light mode
Before

After

In Dark Mode
Before

After

hello @subhadipbhowmik, please review it. as soon as possible


Extend ContextMapStrategy to mapAsyncUnordered

This extends the ContextMapStrategy idea to mapAsyncUnordered. This
might help motivate the feature:
Previously, a big limitation of FlowWithContext is that it was somewhat
unclear what kinds of operations were allowed on streams in order not to
violate the expectations of the sinks that use that context.
For example, the current approach for dealing with Kafka commits in
contexts would allow filtering, but not reordering of the elements, and
mapConcat needed some careful massaging.
By putting the information of what is supported in the type of the ContextMapStrategy,
components that care about the offsets (like Alpakka Kafka) can provide
a strategy (or multiple) that allows only those operations that are safe
for them.
Components that provide context-aware flows but don't care about the
offsets themselves (such as generic alpakka components) can indicate
their restrictions in the type of the strategy they accept.
The test shows 2 possible Kafka strategies, one allowing iteration (but
not reordering) and one allowing reordering (but not filtering), and 2
example streams showing how this can be composed in a type-safe way.
This still doesn't cover flatMapConcat. For flatMapConcat, there are some
trade-offs: i.e. in the Kafka case, if you absolutely want all input elements
to be committed, AFAICS we would have to delay each element (until we know
whether the next event is the next element or the stream completion), which is
quite a cost. If you're OK with skipping some commits for filtered-out
input elements (which I'd say is typically reasonable), you don't have to
incur this cost by using the 'commit when changed' strategy. Signalling whether
this is necessary could also be done from the mapping strategy, and we could
provide 'strict' and 'loose' strategies corresponding the the different behaviours.
That sounds like it might fit rather nicely.
(I think there is another option that would only delay the commits, also fit
flatMapMerge and reordering (even at the same time), while only possibly missing
commits at the 'end' of the stream - but let's not get into the woods too far
yet ;))

This extends the ContextMapStrategy idea to mapAsyncUnordered. This
might help motivate the feature:
Previously, a big limitation of FlowWithContext is that it was somewhat
unclear what kinds of operations were allowed on streams in order not to
violate the expectations of the sinks that use that context.
For example, the current approach for dealing with Kafka commits in
contexts would allow filtering, but not reordering of the elements, and
mapConcat needed some careful massaging.
By putting the information of what is supported in the type of the ContextMapStrategy,
components that care about the offsets (like Alpakka Kafka) can provide
a strategy (or multiple) that allows only those operations that are safe
for them.
Components that provide context-aware flows but don't care about the
offsets themselves (such as generic alpakka components) can indicate
their restrictions in the type of the strategy they accept.
The test shows 2 possible Kafka strategies, one allowing iteration (but
not reordering) and one allowing reordering (but not filtering), and 2
example streams showing how this can be composed in a type-safe way.

Thanks for refactoring ContextMapStrategy into types that can be composed together.

This still doesn't cover flatMapConcat. For flatMapConcat, there are some
trade-offs: i.e. in the Kafka case, if you absolutely want all input elements
to be committed, AFAICS we would have to delay each element (until we know
whether the next event is the next element or the stream completion), which is
quite a cost.

I arrived at the same conclusion. I don't see any other way around this problem when using flatMapConcat, other than injecting "book end" type elements into the stream, for example by appending and prepending the stream with no-op elements and contexts defined by a ContextMapStrategy.  I don't really like this though because it injects context metadata into the stream as elements, though maybe we could skip these elements when using the WithContext flow operators.  I'll experiment with this further.
For now I've implemented flatMapConcat by delaying elements. Perhaps this can be optional in some way.

If you're OK with skipping some commits for filtered-out
input elements (which I'd say is typically reasonable), you don't have to
incur this cost by using the 'commit when changed' strategy. Signalling whether
this is necessary could also be done from the mapping strategy, and we could
provide 'strict' and 'loose' strategies corresponding the the different behaviours.
That sounds like it might fit rather nicely.

I think this will depend on the use case. The user may not always have a need to emit an element downstream that was filtered out by mapConcat/flatMapConcat, but they'll still want to commit that the work was completed.

(I think there is another option that would only delay the commits, also fit
flatMapMerge and reordering (even at the same time), while only possibly missing
commits at the 'end' of the stream - but let's not get into the woods too far
yet ;))

Too late! ;) I pushed a new branch that attempts to merge my latest work with yours.  Let's discuss tomorrow how best we can work together on this together so we don't have too many branches and PRs floating around.  My branch for reference: https://github.com/seglo/akka/tree/seglo/streamcontext-flatmap-strategy-merge

I don't really like this though because it injects context metadata into the stream as elements, though maybe we could skip these elements when using the WithContext flow operators.

If we created a new context container type like
case class ContextElement[Ctx, T](context: Ctx, elm: Option[T])

and instead of a tuple in the inner flow of the WithContext APIs of Flow[(Ctx, T)], we had Flow[ContextElement[Ctx, T]], then the Iterate and similar ordered strategies could concatenate the elements emitted from flatMap-like operators to insert bookends like ContextElement(context = beginning, elm = None).  For the "last element" use case in flatMapConcat we could emit a ContextElement(context = end, elm = None) when onDownstreamFinished is called instead of holding up the last element.
All the other operators of the WithContext APIs would skip these elements, except perhaps for new operators that specifically map everything, i.e. mapContextElement.
If the user drops down to a non-context API we could filter out all ContextElements where elm.isEmpty.

instead of a tuple in the inner flow of the WithContext APIs of Flow[(Ctx, T)], we had Flow[ContextElement[Ctx, T]],

Hmm, I think we could make this work, but perhaps it is going too far: it would mean introducing quite a lot of machinery and complexity (both run-time and code-wise), for what might be a relatively narrow use case.


Issue realted to torch.nn.utils.rnn.pack_padded_sequence

_pack_padded_sequence() code line I faced RuntimeError: 'lengths' argument should be a 1D CPU int64 tensor, but got 1D cuda:0 Long tensor. how to resolve this error?

This error is due to the input is now on GPU but expected to be on CPU. To solve it, you can simply "a.cpu()" where a is the input tensor of your function.


[WIP] wait for all domains in acl

Seems, we can get netstat results out of order of request we make, so we should wait for all domains in wait_netstat.sh.
Signed-off-by: Petr Fedchenkov<EMAIL_ADDRESS>

Hmm, could it be actually that DNS records are not properly spread between per-app flow records?
I'm not sure if I'm reading it right, but I do not see how DNS records are filtered here based on appIdx: https://github.com/lf-edge/eve/blob/master/pkg/pillar/cmd/zedrouter/flowstats.go#L276-L305

Inside Eden I use this field: https://github.com/lf-edge/eve/blob/a6ad139260e69ff00126080c2686c4c07e1e2979/pkg/pillar/cmd/zedrouter/flowstats.go#L165. Seems, we skip all data with different appIdx https://github.com/lf-edge/eve/blob/a6ad139260e69ff00126080c2686c4c07e1e2979/pkg/pillar/cmd/zedrouter/flowstats.go#L183.
Do you see any problems with filtering with trace level logs?

That filtering is only for timeOutTuples. DNS records are collected in the next for cycle.
If two apps are created on the same network and even if only one of them runs curl, both will get the same DNS reqs in the logs it seems.
For example:
./eden pod logs --fields=netstat curl-acl1
netstat list for app 7471f584-aab8-41ee-b05c-4c1166b4ec7e:
... "dnsReqs":[{"hostName":"theofficialabsolutelongestdomainnameregisteredontheworldwideweb.international","addrs":["<IP_ADDRESS>","<IP_ADDRESS>","<IP_ADDRESS>","<IP_ADDRESS>"],"requestTime":{"seconds":1622112495,"nanos":133929700}},{"hostName":"this-fake-domain-is-associated-with-zededa.com","addrs":["<IP_ADDRESS>"],"requestTime":{"seconds":1622112497,"nanos":253010200}},{"hostName":"google.com","addrs":["<IP_ADDRESS>"],"requestTime":{"seconds":1622112529,"nanos":111220500}},{"hostName":"github.com","addrs":["<IP_ADDRESS>"],"requestTime":{"seconds":1622112492,"nanos":879083300}},{"hostName":"google.com","addrs":["2a00:1450:4014:80d::200e"],"requestTime":{"seconds":1622112529,"nanos":111067400}}]}

./eden pod logs --fields=netstat curl-acl2
netstat list for app 1f5c60ca-a397-4532-b29d-50d32a0975a6:
... "dnsReqs":[{"hostName":"theofficialabsolutelongestdomainnameregisteredontheworldwideweb.international","addrs":["<IP_ADDRESS>","<IP_ADDRESS>","<IP_ADDRESS>","<IP_ADDRESS>"],"requestTime":{"seconds":1622112495,"nanos":133929700}},{"hostName":"this-fake-domain-is-associated-with-zededa.com","addrs":["<IP_ADDRESS>"],"requestTime":{"seconds":1622112497,"nanos":253010200}},{"hostName":"google.com","addrs":["<IP_ADDRESS>"],"requestTime":{"seconds":1622112529,"nanos":111220500}},{"hostName":"github.com","addrs":["<IP_ADDRESS>"],"requestTime":{"seconds":1622112492,"nanos":879083300}},{"hostName":"google.com","addrs":["2a00:1450:4014:80d::200e"],"requestTime":{"seconds":1622112529,"nanos":111067400}}]}

Ah, well, so do we filter by bridge (which one is equal for the same local network) there?
Anyway, I think the problem of the particular failures of current test is inside out of order and timeout.


ProcessCellCallback

I am having some trouble creating my excel file because I have a lot of nested properties.
Say I want the value of the column with identifier 'machineName' to be value.name
How do I accomplisch this with processCellCallback?

Are you sure this issue is for the right project ?
Thanks ...
Frank


ignored_parameters leaks private information via serialized responses

The problem
We have some private tokens for API calls, and these private tokens end up cached regardless of what back-end we utilize, because, although the response.request.url is cleaned-up, the secret is still present in the string attribute response.url.
Expected behavior
I expect, if a certain URL param is ignored, for it to be ignored both in the request and in the response.
Steps to reproduce the behavior

Install the cache to intercept all requests with backend to filesystem and the serializer to json, and provide ignored_parameters=[<secret>].
Make a request with a "secret" token.
Look at cached response file, it will have removed the secret from request.url, but it still exists on the top-level url.

Workarounds
Hacking the code like this stops the secret from appearing in the cache files (/backends/base.py):

Environment

requests-cache version: 0.8.0
Python version: 3.9
Platform: OSX

Thanks for reporting this! I'll get that fixed shortly.

This has been fixed in v0.8.1, and also backported to v0.7.5 for python 3.6 compatibility.
A somewhat related issue is #388, so any feedback on that would be appreciated.


Creating a new user with groups and roles assigned in one go fails

Describe the issue:

$subject generates an issue in the UI as in the above screen.
The issue is not reproducible in a local environment but in a cloud environment.
It seems a slight delay in user creation can fail the role or group assignment.
No errors are logged.
@DimalChandrasiri please add if you have more information.

Group assignment to an existing user is also not working properly in remotely hosted environments.

Even though no errors are shown the group is not assigned to the user in the UI.
/cc @DimalChandrasiri

For scim group patch operation in the network tab, ccould see the response as the user is not in the user store. But when listing could able to see the user. This is not reproducible in 5.12.0 latest milestones. Only could able to reproduce in cloud environment.

For scim group patch operation in the network tab, ccould see the response as the user is not in the user store. But when listing could able to see the user. This is not reproducible in 5.12.0 latest milestones. Only could able to reproduce in cloud environment.


MINOR: Upgrade ducktape to 0.7.6

Committer Checklist (excluded from commit message)

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation (including upgrade notes)

How far back is this going? I can't remember what's changed between these two versions of ducktape.

@ewencp functionally, the only thing that has changed seems to be this https://github.com/confluentinc/ducktape/pull/210 SSH timeout issue and also some extra logging

let's just fix forward here since there's nothing broken in this project at the moment

@ewencp how's this looking?


[Bugfix] Fix value unpack error of simple connector for KVCache transfer.

Currently the send_kv_caches_and_hidden_states get the value of num_heads and head_size from kv_cache[0].shape, which will raise ValueError when the KVCache is compacted. Since we have model_executable as the function input, we can directly get these values from the model config to avoid this error. Also, we do not need to calculate this for every single layer, so we calculate this only once for all layers.
For example,
when kv_cache[0].shape == torch.Size([2162, 16, 40, 128]), this line works normally,
when kv_cache[0].shape == torch.Size([2162, 81920]), it will raise ValueError.
ERROR 12-03 14:31:48 engine.py:135] ValueError('Error in model execution (input dumped to /tmp/err_execute_model_input_20241203-143148.pkl): not enough values to unpack (expected 4, got 2)')
ERROR 12-03 14:31:48 engine.py:135] Traceback (most recent call last):
ERROR 12-03 14:31:48 engine.py:135] File "/mnt/data_disk101/data_disk/lwq/LLM_INFER/split_platform/opensource/vllm-kuntai-disagg-refactor_1202/vllm/worker/model_runner_base.py", line 116, in _wrapper
ERROR 12-03 14:31:48 engine.py:135] return func(*args, **kwargs)
ERROR 12-03 14:31:48 engine.py:135] File "/mnt/data_disk101/data_disk/lwq/LLM_INFER/split_platform/opensource/vllm-kuntai-disagg-refactor_1202/vllm/worker/model_runner.py", line 1718, in execute_model
ERROR 12-03 14:31:48 engine.py:135] get_kv_transfer_group().send_kv_caches_and_hidden_states(
ERROR 12-03 14:31:48 engine.py:135] File "/mnt/data_disk101/data_disk/lwq/LLM_INFER/split_platform/opensource/vllm-kuntai-disagg-refactor_1202/vllm/distributed/kv_transfer/kv_transfer_agent.py", line 60, in send_kv_caches_and_hidden_states
ERROR 12-03 14:31:48 engine.py:135] self.connector.send_kv_caches_and_hidden_states(
ERROR 12-03 14:31:48 engine.py:135] File "/mnt/data_disk101/data_disk/lwq/LLM_INFER/split_platform/opensource/vllm-kuntai-disagg-refactor_1202/vllm/distributed/kv_transfer/kv_connector/simple_connector.py", line 134, in send_kv_caches_and_hidden_states
ERROR 12-03 14:31:48 engine.py:135] _, _, num_heads, head_size = kv_cache[0].shape
ERROR 12-03 14:31:48 engine.py:135] ValueError: not enough values to unpack (expected 4, got 2)

CC list: @KuntaiDu @youkaichao

This PR fixes disaggregated prefill crash when the KV cache size is not 4-dimentional tensor, which will happen for specific models and GPU architectures.


tridentctl should have a flag to provide path to kubeconfig

Describe the solution you'd like
It would be nice to have a flag like it is already available in kubectl to provide a path to a kubeconfig file.
Describe alternatives you've considered
An alternative could be to install trident without tridentctl for example as YAML for kubectl. But this does not work at the moment because there is no possibility to get all required files used by tridentctl
Additional context
Currently it is hard to provide trident via helm and because of this I am using a pipeline to install it. But for this I have to use a dedicated runner (GitLab docker runner instead of the default kubernetes runner) because tridentctl uses the wrong credentials all the time. With kubectl all works fine :/

yes it's really something that is missing at the moment because without it it's very complicated to automate the installation of Trident.
A flag for a custom kubectl path would also be nice.

I just ran into this problem. I use gitlab ci/cd pipeline. I fed the kubeconfig via variable, but the tridentctl is trying to use the gitlab-runner service account to deploy. The runner is not even in the same cluster.

@gfvirga If you need a workaround: Try using docker runner and use KUBECONFIG variable (export KUBECONFIG=<Path_to_kubeconfig>). This is how I got it to work.
Anyway I want to have a feature like a kubeconfig flag to use one runner for all of my projects and not a dedicated one for trident :/ .

The remote install section of the documentation does state to set the KUBECONFIG env variable. We will update the documentation to indicate that any use of tridentctl needs the KUBECONFIG env var set if the kube config is not in the expected location.

We have the kubeconfig variable exported. When running this command in gitlab pipelines in a kubernetes container it will use the serviceaccounttoken (https://kubernetes.io/docs/tasks/configure-pod-container/configure-service-account/#use-the-default-service-account-to-access-the-api-server) instead of the kubeconfig. If there will be a helm chart for this in the near future, I will stop trying to use tridentctl in gitlab pipelines.
There is also a ticket with gitlab to allow the runner to start containers without the serviceaccounttoken - https://gitlab.com/gitlab-org/gitlab-runner/-/merge_requests/1350

The documentation for Trident 20.04 was updated in additional sections to indicate that the KUBECONFIG variable should be set when using tridentctl.


Fix RI scraper

Closes #413

I'm seeing an empty row in the outfile at the top. Just me, or a bug?

I think I got that patched. Thanks for the PR.


jenkins_exec type

  jenkins_exec{ 'job-dsl security':
    script => @(END)
      import jenkins.model.*

      def j = Jenkins.getInstance()
      def jobDsl = j.getDescriptor("javaposse.jobdsl.plugin.GlobalJobDslSecurityConfiguration")
      jobDsl.setUseScriptSecurity(false)
    END
  }

@rtyler  I've been sitting on this for over a year as I never got around to writing acceptance tests.  However, it seems to be in a working state.

Is this likely to be merged soon? It's exactly what I need and I had already started writing something similar.

@joshuaspence I got it as far as basic functionality but haven't had time to sort out the tests.

Instead of jenkins_exec, maybe jenkins_script or jenkins_groovy?

The provider started out as a cut'n'paste of an exec provider from core puppet and the semantics of the type are intended to be essentially the same.

@jhoblitt any plans to revisit this?

@ekohl Nope.


Returning code 400

Hello, all parameters are correct. I'm using module since 2-3 weeks. Suddenly stopped working. Giving code 400. Everything is correct. I didn't change any code.

Yes, it had given this error on the server: EIO: i/o error, read
but I already solved it

Resolved.

The issue is back :(


V3 Testing - Known Issues

Known Issues
None right now!
Pending Merge

The window keeps getting bigger on each load with non-default global scales
Migration keeps failing on the same player (rare so far, two occurrences)
Move backups out of config folder
Note saving

Fixed

DB migration not respecting date timestamps
Leaking hooks warning in logs
Blank alert chat messages
The window keeps opening on startup
Icon list not showing all used icons

hey there, I accidentally got version <IP_ADDRESS> and while old notes have been kept, modifying them now simply doesn't save. I am waiting for a release to untick the use testing checkbox and hope that solves it.
Also the 'last seen x days ago' message is now 'x is nearby', is there a way to get the old message format back?

Hey, the note saving has been fixed and is waiting for merge. It'll be in the next version.
The old format is gone, for now, I'm considering more alert customization options for a future release.