Issue #16 Installed TomEE

Downloaded the zip file, unzip it, and authorized .sh/.exe files to execute.

Thanks! :+1:


TODO: filtering by timestamp

Add command-line option to support start and end timestamps.
Can trim down large logs to a period of interest.
Default to start=dawn of time, end=end of time.

Will be in version 0.2.0

Released in 0.2.0


feature request: set all pixels in one call / memcpy

would it be easily possible to add some sort of fast way to  set all pixels at once?
something similar to a memory copy memcpy?
or is it possible to use memcpy on the internal representation in a relative save way?
in my measurement the setRGB(r, g, b); function needed 1.56ms for 8 chips (32leds). if i do my own for-loop with some simple ordering mapping i get to about 2ms.
and i would hope there is a faster way if all the rgb data is already somewhere predefined ;-)

ok - after adding #3 i now know how the buffer is build up...
the channels are mapped relative straight forward.. you only have to spare out the other register settings that are also stored in the buffer..
could be possible to add an 'copy to' function. but i don't know if it will be faster than just calls to setRGB(idx, r, g, b);....


Loss device for ORPOTrainer

I hit upon an error in HuggingFace for which there are strangely zero google search results
"ValueError: Calculated loss must be on the original device" I can see this error source code in huggingface trainer.py file
The full error  is "ValueError: Calculated loss must be on the original device: cuda:0 but device in use is cuda:3"
This happens when I use multi-gpu using accelerate with this code
model_name = "aihello/podcast"
model = AutoModelForCausalLM.from_pretrained(
          model_name, torch_dtype=torch_dtype, quantization_config=bnb_config, device_map='auto'
)

I can set the device map to specific GPU to avoid this but one GPU doesnt have enough memory to support our ORPO training
 model = AutoModelForCausalLM.from_pretrained(
           model_name, torch_dtype=torch_dtype, quantization_config=bnb_config, device_map={"": 0},  attn_implementation=attn_implementation
 )

torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 28.00 MiB. GPU 0 has a total capacity of 14.58 GiB of which 14.50 MiB is free. yadda yadda
orpo_config = ORPOConfig(
    output_dir="./output/",
    evaluation_strategy="steps",
    do_eval=True,
    optim="paged_adamw_8bit",
    per_device_train_batch_size=1,
    gradient_accumulation_steps=4,
    per_device_eval_batch_size=1,
    log_level="debug",
    logging_steps=20,
    learning_rate=8e-6,
    eval_steps=20,
    num_train_epochs=3,
    # max_steps=9000,
    save_steps=20,
    save_strategy='epoch',
    warmup_ratio=0.1,
    lr_scheduler_type="linear",
    beta=0.1, #beta is ORPO's lambda
    max_length=1024,
)

trainer = ORPOTrainer(
        model=model,
        train_dataset=dataset[0],
        eval_dataset=dataset[1],
        peft_config=peft_config,
        args=orpo_config,
        tokenizer=tokenizer,
)

trainer.train()

This is specific to ORPO as I have no issues with PEFT finetuning and multi gpu setup

Hello @ganeshkrishnan1,
Could you try calling the model to the CPU first before passing the model to the ORPOTrainer by removing device_map='auto'?
model_name = "aihello/podcast"
model = AutoModelForCausalLM.from_pretrained(
          model_name, torch_dtype=torch_dtype, quantization_config=bnb_config
)

Accelerate usually allocates the model and the loss automatically to the appropriate GPUs, so let me know if loading the model to the CPU first could resolve it.

If I remove the device_map then only one GPU is used and I get a device out of memory error. If I add device_map then I get this error "ValueError: Calculated loss must be on the original device: cuda:0 but device in use is cuda:3"
Also I tried replacing the ORPO trainer with the DPO trainer and it worked without any issues.

Hi @ganeshkrishnan1 , @jiwooya1000 , I just face the same situation and raise an issue in trl here, any suggestions to fix this error?

I'm facing the same issue, anyone know how to fix the error?

@blaze7451 @huangxinping  there is no known fix for now. We have reverted to DPO for now and might revisit this later or try to fix it ourselves

Hello, @nlee-208 and I are currently using alignment-handbook and TRL too, but we were not able to reproduce the issue for now. Could you specify which setting of accelerate are you using @ganeshkrishnan1 @huangxinping @blaze7451 (e.g., FSDP, DS2, --multi-gpu)?

I am using FDSP
fsdp_plugin = FullyShardedDataParallelPlugin(
    state_dict_config=FullStateDictConfig(offload_to_cpu=True, rank0_only=False),
    optim_state_dict_config=FullOptimStateDictConfig(offload_to_cpu=True, rank0_only=False),
)
accelerator = Accelerator(fsdp_plugin=fsdp_plugin)
device = accelerator.device

@jiwooya1000  I am just using ORPORTrainer and following a blog tutorial. Fine-tune Llama 3 with ORPO
If I only set up one GPU to fine tune Llama 3, it can be trained successfully.

I simply used ORPOTrainer just like what huangxinping did, didn't specifically set any accelerate config.

Hey @alvarobartt, do you perhaps have any solution/similar experience using the ORPOTrainer from trl? Seems like there are some issues with the device mapping from either bnb or peft for the trl ORPOTrainer.

Thanks for the ping @nlee-208! Indeed AFAIK device_map is only intended to be used for inference, other than that accelerate handles the device placement and so does the alignment-handbook, so setting device_map for training is just not correct AFAIK.

Also could you guys clarify what the issue is? Does removing the device_map work on a multi-GPU environment, or is it also failing? Also how many processes are you using? If you could share the accelerate config for multi-GPU that would be great to help debug that

Could you guys try using the FSDP configuration at https://github.com/huggingface/alignment-handbook/blob/main/recipes/accelerate_configs/fsdp.yaml, and run that as accelerate launch --config_file fsdp.yaml your_script.py using the same number of processes in num_processes as GPUs you want to use, and also removing the device_map="auto" from AutoModelForCausalLM.from_pretrained?

So to replicate Maxime's script via the alignment-handbook you should use the following configuration, say config.yaml:
# Model arguments
model_name_or_path: meta-llama/Meta-Llama-3-8B
torch_dtype: bfloat16
use_flash_attention_2: true

# LoRA arguments
use_peft: true
load_in_4bit: true
lora_r: 16
lora_alpha: 32
lora_dropout: 0.05
lora_target_modules:
- q_proj
- k_proj
- v_proj
- o_proj
- gate_proj
- up_proj
- down_proj

# Data training arguments
dataset_mixer:
  mlabonne/orpo-dpo-mix-40k: 0.1
dataset_splits:
- train
preprocessing_num_workers: 12

# ORPOTrainer arguments
beta: 0.1
do_eval: true
evaluation_strategy: steps
eval_steps: 0.2
gradient_accumulation_steps: 4
gradient_checkpointing: true
gradient_checkpointing_kwargs:
  use_reentrant: false
hub_model_id: llama-3-orpo-qlora
learning_rate: 8.0e-6
log_level: info
logging_steps: 1
lr_scheduler_type: linear
max_length: 1024
max_prompt_length: 512
num_train_epochs: 1
optim: paged_adamw_8bit
output_dir: results/
per_device_train_batch_size: 2
per_device_eval_batch_size: 2
seed: 42
warmup_ratio: 0.1
warmup_steps: 10

Then the following FSDP configuration file (tweaking the num_processes), say fsdp.yaml:
compute_environment: LOCAL_MACHINE
debug: false
distributed_type: FSDP
downcast_bf16: 'no'
enable_cpu_affinity: false
fsdp_config:
  fsdp_auto_wrap_policy: TRANSFORMER_BASED_WRAP
  fsdp_backward_prefetch: BACKWARD_PRE
  fsdp_cpu_ram_efficient_loading: true
  fsdp_forward_prefetch: true
  fsdp_offload_params: false
  fsdp_sharding_strategy: FULL_SHARD
  fsdp_state_dict_type: SHARDED_STATE_DICT
  fsdp_sync_module_states: true
  fsdp_use_orig_params: true
machine_rank: 0
main_training_function: main
mixed_precision: bf16
num_machines: 1
num_processes: 8
rdzv_backend: static
same_network: true
tpu_env: []
tpu_use_cluster: false
tpu_use_sudo: false
use_cpu: false

And then run that as:
ACCELERATE_LOG_LEVEL=info TRANSFORMERS_VERBOSITY=info accelerate launch --config_file fsdp.yaml scripts/run_orpo.py config.yaml

Otherwise, if you prefer to use custom code, you can look at run_orpo.py for reference on how to properly initialize accelerate to use multiple GPUs for fine-tuning.
Hope that helped you in the meantime 👍🏻

Thanks, got it working though there is the bug of Ampere devices with bfloat16. I created a pull request to fix it

So to replicate Maxime's script via the alignment-handbook you should use the following configuration, say config.yaml:因此，要通过 alignment-handbook 复制 Maxime 的脚本，您应该使用以下配置，例如 config.yaml ：
# Model arguments
model_name_or_path: meta-llama/Meta-Llama-3-8B
torch_dtype: bfloat16
use_flash_attention_2: true

# LoRA arguments
use_peft: true
load_in_4bit: true
lora_r: 16
lora_alpha: 32
lora_dropout: 0.05
lora_target_modules:
- q_proj
- k_proj
- v_proj
- o_proj
- gate_proj
- up_proj
- down_proj

# Data training arguments
dataset_mixer:
  mlabonne/orpo-dpo-mix-40k: 0.1
dataset_splits:
- train
preprocessing_num_workers: 12

# ORPOTrainer arguments
beta: 0.1
do_eval: true
evaluation_strategy: steps
eval_steps: 0.2
gradient_accumulation_steps: 4
gradient_checkpointing: true
gradient_checkpointing_kwargs:
  use_reentrant: false
hub_model_id: llama-3-orpo-qlora
learning_rate: 8.0e-6
log_level: info
logging_steps: 1
lr_scheduler_type: linear
max_length: 1024
max_prompt_length: 512
num_train_epochs: 1
optim: paged_adamw_8bit
output_dir: results/
per_device_train_batch_size: 2
per_device_eval_batch_size: 2
seed: 42
warmup_ratio: 0.1
warmup_steps: 10

Then the following FSDP configuration file (tweaking the num_processes), say fsdp.yaml:然后是以下 FSDP 配置文件（调整 num_processes ），例如 fsdp.yaml ：
compute_environment: LOCAL_MACHINE
debug: false
distributed_type: FSDP
downcast_bf16: 'no'
enable_cpu_affinity: false
fsdp_config:
  fsdp_auto_wrap_policy: TRANSFORMER_BASED_WRAP
  fsdp_backward_prefetch: BACKWARD_PRE
  fsdp_cpu_ram_efficient_loading: true
  fsdp_forward_prefetch: true
  fsdp_offload_params: false
  fsdp_sharding_strategy: FULL_SHARD
  fsdp_state_dict_type: SHARDED_STATE_DICT
  fsdp_sync_module_states: true
  fsdp_use_orig_params: true
machine_rank: 0
main_training_function: main
mixed_precision: bf16
num_machines: 1
num_processes: 8
rdzv_backend: static
same_network: true
tpu_env: []
tpu_use_cluster: false
tpu_use_sudo: false
use_cpu: false

And then run that as:然后运行它：
ACCELERATE_LOG_LEVEL=info TRANSFORMERS_VERBOSITY=info accelerate launch --config_file fsdp.yaml scripts/run_orpo.py config.yaml

Otherwise, if you prefer to use custom code, you can look at run_orpo.py for reference on how to properly initialize accelerate to use multiple GPUs for fine-tuning.否则，如果您更喜欢使用自定义代码，可以查看 run_orpo.py 以获取有关如何正确初始化 accelerate 以使用多个 GPU 进行微调的参考。
Hope that helped you in the meantime 👍🏻希望同时对您有所帮助👍🏻

哈喽，我想知道这样的配置在加载模型时候是否会出现warning：You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with 'model. to (' cuda' )'.


workload identity federation in gcp for multiple projects

TL;DR
i set up workload identity federation for a couple of projects in GCP. can i set up workload identity federation for multiple projects?
can I do it by one service account between the GCP projects? how?
Detailed design
No response
Additional information
No response

I'm not sure to understand what is really your question, but it is close to some question I got in my organization so I will try this answer.
Are you asking for this action to authenticate multiple service account at once?
If so, imagine this:  You want to travel to multiple country. Will you ask for multiple passport with potentially different name   or will you ask for 1 passport and put on it multiple visa.

You CI job should work the same way:  you should have 1 identity (let say the service account my-ci@my-project ) and you can ask for this service account multiple permission  like access the pubsub  XXX on project  io_project,  read access on big query table in project  bi_project,   kubernetes deployment permission on cluster YYY on project apps_project  and so on and so on.
It is easier to manage / control / use the permission this way.

Hi there. This issue tracker is for questions related to the GitHub Action for authenticating to Google Cloud. For general Google Cloud questions, please see https://cloud.google.com/support. Thanks!


Using GOPROXY=direct when adding this library as a dependency causing the build to hang

ACH Version: v1.5.2
Go Version: v1.15.6
What were you trying to do?
Run GOPROXY=direct GOSUMDB=off go get github.com/moov-io/ach in a Docker container using golang:1.15.6-apline3.12
What did you see?
The build hangs indefinitely for me.
docker build -t my-go-app .
Sending build context to Docker daemon  18.94kB
Step 1/8 : FROM golang:1.15.6-alpine3.12
 ---> 1463476d8605
Step 2/8 : RUN mkdir /app
 ---> Using cache
 ---> edd141cc43de
Step 3/8 : ADD . /app
 ---> Using cache
 ---> 50decfc41d41
Step 4/8 : WORKDIR /app
 ---> Using cache
 ---> cd24b35874f7
Step 5/8 : RUN go build -o main .
 ---> Using cache
 ---> d5936f223cb1
Step 6/8 : RUN apk add git
 ---> Using cache
 ---> 3f4f81b9083e
Step 7/8 : RUN GOPROXY=direct GOSUMDB=off go get github.com/moov-io/ach
 ---> Running in 61f7e2ab93b5
go: downloading github.com/moov-io/ach v1.5.2
go: github.com/moov-io/ach upgrade => v1.5.2

How can we reproduce the problem?
Run docker build -t my-go-app using the following Dockerfile
FROM golang:1.15.6-alpine3.12
RUN mkdir /app
ADD . /app
WORKDIR /app

RUN go build -o main .

RUN apk add git
RUN GOPROXY=direct GOSUMDB=off go get github.com/moov-io/ach

My issue was resolved. It turns out that the dependencies were downloading very slowly (7+ minutes).


[Event Request] Codeunit 99000845 "Reservation Management"

Describe the request
Hello,
we need an event in the Codeunit 99000845 "Reservation Management" in the procedure DeleteReservEntries:
procedure DeleteReservEntries(DeleteAll: Boolean; DownToQuantity: Decimal; var ReservEntry: Record "Reservation Entry")
We need the event to modify the parameter "ReservEntry" when the Reservation Status is "Surplus".
`
 procedure DeleteReservEntries(DeleteAll: Boolean; DownToQuantity: Decimal; var ReservEntry: Record "Reservation Entry")
var
    .....
begin
    IsHandled := false;
    OnBeforeDeleteReservEntries(ReservEntry, DownToQuantity, CalcReservEntry, CalcReservEntry2, IsHandled, ItemTrackingHandling);
    if IsHandled then
        exit;

    ReservEntry.SetRange("Reservation Status");
    if ReservEntry.IsEmpty() then
        exit;
  ...

  for ReservStatus := ReservStatus::Prospect downto ReservStatus::Reservation do begin
        ReservEntry.SetRange("Reservation Status", ReservStatus);
        if ReservEntry.FindSet() and (QtyToRelease <> 0) then
            case ReservStatus of
                Enum::"Reservation Status"::Prospect:
                    repeat
                      ......
                    until (ReservEntry.Next() = 0) or ((not DeleteAll) and (QtyToRelease = 0));
                Enum::"Reservation Status"::Surplus:
                    repeat
                        if CalcReservEntry4.Get(ReservEntry."Entry No.", not ReservEntry.Positive) then // Find related entry
                            Error(Text007);
                        if (Abs(ReservEntry."Quantity (Base)") <= Abs(QtyToRelease)) or DeleteAll then begin
                            ReservEngineMgt.CloseReservEntry(ReservEntry, false, DeleteAll);
                            SaveTrackingSpecification(ReservEntry, ReservEntry."Quantity (Base)");
                            QtyToRelease := QtyToRelease - ReservEntry."Quantity (Base)";
                            if not DeleteAll and CalcReservEntry4.TrackingExists() then begin
                                CalcReservEntry4."Reservation Status" := CalcReservEntry4."Reservation Status"::Surplus;
                                CalcReservEntry4.Insert();
                            end;
                            ModifyActionMessage(ReservEntry."Entry No.", 0, true); // Delete action messages
                        end else begin
                            ReservEntry.Validate("Quantity (Base)", ReservEntry."Quantity (Base)" - QtyToRelease);
                            ReservEntry.Modify();

                            // Start Event
                                OnAfterModifyReservEntryReservationStatusSurplus(ReservEntry, QtyToRelease);
                           //  End Event

                            SaveTrackingSpecification(ReservEntry, QtyToRelease);
                            ModifyActionMessage(ReservEntry."Entry No.", QtyToRelease, false); // Modify action messages
                            QtyToRelease := 0;
                        end;
                    until (ReservEntry.Next() = 0) or ((not DeleteAll) and (QtyToRelease = 0));
                Enum::"Reservation Status"::Tracking,
                Enum::"Reservation Status"::Reservation:
                    for Release := Release::"Non-Inventory" to Release::Inventory do begin
                        // Release non-inventory reservations in first cycle
                        repeat
                            .......
                        until (ReservEntry.Next() = 0) or ((not DeleteAll) and (QtyToRelease = 0));
                        if not ReservEntry.FindFirst() then // Rewind for second cycle
                            Release := Release::Inventory;
                    end;
            end;
    end;`

Event
[IntegrationEvent(false, false)] local procedure OnAfterModifyReservEntryReservationStatusSurplus(var ReservationEntry: Record "Reservation Entry"; QtyReleased: Decimal)     begin     end;
Additional context
.
Internal work item: AB#540085

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.
Build ID: 21513.


[Question] is there a way to reference Microsoft.AspNetCore.Mvc.Core 5 from Paket?

This is more a question rather than issue.
Is there a way to reference ASP .NET Core 5 assemblies with Paket?
It seems some packages (like Microsoft.AspNetCore.Mvc.Core, but also Microsoft.AspNetCore.Http, Microsoft.AspNetCore.Http.Extensions, Microsoft.AspNetCore.Routing.Abstractions, and many more) became implicit / part of the framework and are refrenced... well implicitly when you use .NET 5 (I guess you also need to declare right SDK).
You cannot reference them from .NET Standard 2.1 assembly, I mean if you do you actually reference 2.2 version of corresponding assembly because they are most recent on nuget.
Is it even possible? Or now I just have to use net5 for my assemblies if they touch Microsoft.AspNetCore.Mvc.Abstractions for example?

I'm pretty sure this applies only to <FrameworkReference> so I think problem solved.
If you came here looking for the same thing check out:
https://docs.microsoft.com/en-us/aspnet/core/migration/22-to-30?view=aspnetcore-5.0&tabs=visual-studio#framework-reference


Option to download all bookmarks in a CSV file

It would be nice to have this feature to download all the bookmarks in a single file.

That's a great idea! Hopefully someone will submit a PR for this

I am looking since a long time for a script, which (basically stated)

downloads all bookmarks in time-sorted sequence
creates an index.html as a start page
makes the bookmarks "offline" available
including all media content, especially all images
including (optionally) videos (we could call youtube-dl to download media locally)

+1 for this. And/or JSON of course.
Side note: totally surprised me that bookmarks are apparently not part of Twitter's takeout zip!? (the takeout is otherwise formatted as a reasonable home page, not just an xml blob)

We can simple add download json. Is that solve part of the issue?
Anyway you can explore network activity and find bookmarks request and save the response


Error in Kmer Corpus step

Hi!  Firstly, this is a rad tool and I can't wait to see the results for my metagenomic time series.  Thanks very much for developing it!
I'm stuck at the Kmer Corpus step and my error log is giving me this traceback, which says that the matrices are not aligned:
Traceback (most recent call last):
  File "LSA/kmer_corpus.py", line 33, in <module>
    hashobject.kmer_corpus_to_disk(Kmer_Hash_Count_Files[fr],mask=M)
  File "/LatentStrainAnalysis/LSA/streaming_eigenhashes.py", line 42, in kmer_corpus_to_disk
    norm = np.linalg.norm(H)/len(H)**.5
  File "/local/cluster/lib/python2.7/site-packages/numpy/linalg/linalg.py", line 2060, in norm
    sqnorm = dot(x, x)
ValueError: matrices are not aligned

This is the only error message when the job dies within a fraction of a second of starting.  I checked out the error message online and it's a generic problem with unmatched matrix/vector dimensions in the dotproduct.  Any clues as to where that cropped up in my workflow?  Thanks for your time!

Hi,
Thanks for your feedback!
First - have you successfully run through the test data? If not, that's a
good starting place just to make sure everything is installed and so on.
Is a bit hard to diagnose that problem without more info. Do you mind
sending me the output of "ls -l" on original_reads/ hashed_reads/ and
cluster_vectors? That would make it easier for me to tell what's going on.
On Mon, Nov 2, 2015 at 10:11 PM, russianconcussion<EMAIL_ADDRESS>
wrote:

Hi! Firstly, this is a rad tool and I can't wait to see the results for my
metagenomic time series. Thanks very much for developing it!
I'm stuck at the Kmer Corpus step and my error log is giving me this
traceback, which says that the matrices are not aligned:
Traceback (most recent call last):
File "LSA/kmer_corpus.py", line 33, in
hashobject.kmer_corpus_to_disk(Kmer_Hash_Count_Files[fr],mask=M)
File "/LatentStrainAnalysis/LSA/streaming_eigenhashes.py", line 42, in
kmer_corpus_to_disk
norm = np.linalg.norm(H)/len(H)**.5
File "/local/cluster/lib/python2.7/site-packages/numpy/linalg/linalg.py",
line 2060, in norm
sqnorm = dot(x, x)
ValueError: matrices are not aligned
This is the only error message when the job dies within a fraction of a
second of starting. I checked out the error message online and it's a
generic problem with unmatched matrix/vector dimensions in the dotproduct.
Any clues as to where that cropped up in my workflow? Thanks for your time!
—
Reply to this email directly or view it on GitHub
https://github.com/brian-cleary/LatentStrainAnalysis/issues/6.

Hi,
Sorry for the delay and incomplete explanation. I attached the error files for each step, which were run multiple times and dumped into the same file.  Sorry for the messy files; I included them for reference, just in case.  Your code works well on the test data.  I've tried LSA on two datasets that I have from freshwater lake metagenomes.  One dataset has four metagenome samples, the other six: both are time series.  One sample in each time series has a full lane of Illumina HiSeq 3000 data, which is more than 100 GB.  I am able to get both datasets to the KmerCorpus step when it complains about the matrices not being aligned (as shown above).  Does any of this information help diagnose the problem?
CombineFractions-Err.txt
CombineFractions-Out.txt
CreateHash-Err.txt
CreateHash-Out.txt
GlobalWeights-Err.txt
GlobalWeights-Out.txt
HashReads-Err.txt
HashReads-Out.txt
KmerCorpus-Err.txt
KmerCorpus-Out.txt
MergeHash-Err.txt
MergeHash-Out.txt
SplitInput-Err.txt
SplitInput-Out.txt

It's still a bit hard to tell where the problem is.
It looks like you had some errors in the very first step (SplitInput). Are
you sure this step ran correctly? This step splits all of your input data
into chunks that will be worked on in the individual distributed tasks
downstream, and it expects a certain formatting of the input file names
(see relevant section of docs below).
If you think that that ran correctly (despite the errors), then the next
thing I would ask is to see the output of "ls -l" for hashed_reads/ and
cluster_vectors/
Splitting the input files
Begin by splitting the original reads (from many samples) into many small
files:
$ bsub < LSFScripts/SplitInput_ArrayJob.q
The purpose of this is to create many small files that can each be operated
on by a single task in a distributed environment. The size of many job
arrays downstream from this point are set by the number of chunks created
in this step. Note that this code assumes the files are named
sample_id..fastq.1 and sample_id..fastq.2 for paired reads. If you used
some other naming convention, this needs to be reflected in line 26 in
array_merge.py:
WARNING
If your input files are significantly different from paired fastq files
separated into 2 parts (.fastq.1 and .fastq.2) plus a singleton file
(.single.fastq.1), then you will either need to modify these python files,
or just take it upon yourself to split your files into chunks containing
~1million reads each, and named like: sample_id.fastq.xxx, where ”.xxx” is
the chunk number (eg ‘.021’)
On Sun, Nov 29, 2015 at 2:11 PM, russianconcussion<EMAIL_ADDRESS>
wrote:

Hi,
Sorry for the delay and incomplete explanation. I attached the error files
for each step, which were run multiple times and dumped into the same file.
Sorry for the messy files; I included them for reference, just in case.
Your code works well on the test data. I've tried LSA on two datasets that
I have from freshwater lake metagenomes. One dataset has four metagenome
samples, the other six: both are time series. One sample in each time
series has a full lane of Illumina HiSeq 3000 data, which is more than 100
GB. I am able to get both datasets to the KmerCorpus step when it complains
about the matrices not being aligned (as shown above). Does any of this
information help diagnose the problem?
CombineFractions-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46698/CombineFractions-Err.txt
CombineFractions-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46699/CombineFractions-Out.txt
CreateHash-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46700/CreateHash-Err.txt
CreateHash-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46702/CreateHash-Out.txt
GlobalWeights-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46701/GlobalWeights-Err.txt
GlobalWeights-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46697/GlobalWeights-Out.txt
HashReads-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46703/HashReads-Err.txt
HashReads-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46706/HashReads-Out.txt
KmerCorpus-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46707/KmerCorpus-Err.txt
KmerCorpus-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46705/KmerCorpus-Out.txt
MergeHash-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46708/MergeHash-Err.txt
MergeHash-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46704/MergeHash-Out.txt
SplitInput-Err.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46709/SplitInput-Err.txt
SplitInput-Out.txt
https://github.com/brian-cleary/LatentStrainAnalysis/files/46710/SplitInput-Out.txt
—
Reply to this email directly or view it on GitHub
https://github.com/brian-cleary/LatentStrainAnalysis/issues/6#issuecomment-160453819
.

Hi, Brian,
Thanks for the feedback.  Many of those complaints from the bash shell occur on all our jobs (our admin hasn't bothered to fix them because they're innocuous).  I'm pretty sure the split reads step worked properly and I followed your - very well written - instructions carefully.  I will try again from scratch then send you the ls -l on the output directories.  Thanks very much for your time; it's probably nearly impossible to troubleshoot from across the continent, but I appreciate your help.

Brian, I was able to resolve this by carefully heeding your warning:
If you used some other naming convention, this needs to be reflected in line 26 in array_merge.py
Thanks very much for pointing out the error; not sure why I missed that error message before.  I appreciate your time!

That's great! Sorry again for any of my slow responses.
Let me know if you run into any more issues.
On Mon, Dec 14, 2015 at 2:59 PM, russianconcussion<EMAIL_ADDRESS>
wrote:

Brian, I was able to resolve this by carefully heeding your warning:
If you used some other naming convention, this needs to be reflected in
line 26 in array_merge.py
Thanks very much for pointing out the error; not sure why I missed that
error message before. I appreciate your time!
—
Reply to this email directly or view it on GitHub
https://github.com/brian-cleary/LatentStrainAnalysis/issues/6#issuecomment-164542528
.

No worries Brian, I did have the same issue as #7 .  If you check over there, I posted all the relevant data I could find about the problem.  Thanks again, man!


scheduler: add reservation preemption

Ⅰ. Describe what this PR does

Support the reservation preemption (Currently, only support a reservation preempt pods).

Ⅱ. Does this pull request fix one issue?

Ⅲ. Describe how to verify it
Ⅳ. Special notes for reviews

Q: Why not adopt the DefaultPreemption?
A: We want to support the case where a reservation preempts scheduled pods on a node. Perhaps, support the case where a pod preempts available reservations in the future. However, the DefaultPreemption relies on a real pod of the preemptor to work. In this patch, we leverage the framework's preemption package and overwrite the SelectVictimsOnNode and PodLister of the DefaultPreemption to achieve the reservation preemption.

V. Checklist

[x] I have written necessary docs and comments
[x] I have added necessary unit tests and integration tests
[x] All checks passed in make test

@ZiMengSheng @hormes The implementation of the reservation ignored can be a large patch. So it is split to another PR.

/lgtm

please give a points list of why we don't use upstream DefaultPreemption in PR Description

Added.

/lgtm

/approve


Space War Game

Have you read the Contributing Guidelines ?
(Write your answer here.)
Description
It Is a space war game
Fixes #656
Checklist

[x] I've read the contribution guidelines.
[x] I've checked the issue list before deciding what to submit.
[x] I've edited the README.md and link to my code.

Related Issues or Pull Requests

@photon149 all changes done


Add single track TRAX routes from UTA

Summary

Proposed Readable Name: Utah UTA Light Rail Routes
Proposed Internal Dataset Name: LightRail_UTA
Proposed External Dataset Name: uta_light_rail_routes
Proposed Data Category: TRANSPORTATION
Data Description: Centerlines representing each TRAX route/line
Source Agency/Entity: UTA
Contact: Sumerset Ellis
Update Frequency: As Needed

This is could be a can of worms... UTA has requested that our existing double track representation of TRAX routes be replaced with a version showing the centerline for each route. Where the different TRAX routes (R, B, G) share the same physical tracks the centerlines overlap. I think UTA would prefer that TRANSPORTATION.LightRail_UTA be replaced with the new centerline version but there is value (i.e. multi modal) in keeping our existing double track data. Does it make sense to have 2 versions of TRAX in the SGID or would it be better to have the double track version available in TRANSPORTATION.Railroads?
The data should be available in
1 Check [x] all the areas where you expect the data to show up.

[x] Internal SGID
[x] Open SGID
[x] ArcGIS Online
[x] Open Data

The data is of high quality

[ ] Sweeper checks have run and passed (@gregbunce on 2021/00/00)
[ ] The minimum requirements for metadata are populated (@gregbunce on 2021/00/00)
[ ] The data complies with our domain rules (@gregbunce on 2021/00/00)

Where is the data source
Choose one.

[ ] Internal SGID
[ ] Farm from AGOL (agol item url)

Action items

Assign a person who should complete the task by replacing name with their github @name.
Check [x] the box when the task is completed and add the date of completion.
~Strike~ out all items that do not apply.

[ ] Add data to the Internal SGID (@ZachBeck, completed: 2021/00/00)
[ ] Configure forklift for Farm from AGOL (@stdavis, completed: 2021/00/00)
[ ] Update relevant gis.utah.gov data pages (@ZachBeck, completed: 2021/00/00)
[ ] Add a Stewardship record (@ZachBeck, completed: 2021/00/00)
[ ] Complete a SGID.META.AGOLItems record (@ZachBeck, completed: 2021/00/00)
[ ] Complete an AGOLItems_shelved record for any static or shelved item (@ZachBeck, completed: 2021/00/00)

:robot: Automation validation

Assign yourself or someone to check the item by replacing name with their github @name.
Check [x] the box and add the date of verification 2020/01/01 when the task is verified.
~Strike~ out all items that do not apply.

[x] Open SGID via cloudb (@steveoh on 2022/02/21)
[ ] ArcGIS Online via forklift (@stdavis on 2021/00/00)
[ ] Auditor ran successfully (@jacobdadams on 2021/00/00)
[ ] Open Data (@steveoh on 2021/00/00)
[ ] gis.utah.gov data pages (@steveoh on 2021/00/00)
[ ] sgid-index (@steveoh on 2021/00/00)

Notification

[ ] Twitter (@steveoh)

Group Task Assignments

Check [x] the box when you have assigned all the tasks relevant to your group.

[x] Data Team (@gregbunce)
[x] Dev Team (@steveoh)
[ ] Cadastre Team (@rkelson)

@brigsz, @jacobdadams, @bertgranberg, and others... What are the pros and cons from the planning and transportation perspectives of this request?
@ZachBeck I think that was a good recommendation to put the double track line work in the railroads dataset since it does sound like UTA is very interested in their data being single line.

we should have a quick meeting with Summer at UTA to better understand the proposed changes.  what do you say @ZachBeck @jacobdadams @BGranberg - interested in joining?

I would vote for discussing it further in our data meeting (it's on the agenda) and if our decision is something that would give UTA heartburn then talk with Sumer.

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@gregbunce has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@gregbunce has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

@ZachBeck What was the decision from the data meeting on this? I assume that this issue is holding up #153?

I think I'm the hold up. I'm not really thrilled about any of the options but I think replace the existing trax data with the centerline version and move our trax features into railroads is probably the best route. I'll get moving on this the week of the 13th when I'm back in town.

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@gregbunce has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

Everything ok @gbunce?

Ha!  Yup. Sitting on an airplane trying to be productive for a moment using
a phone. Allz good.  I'll just get back to being unproductive.  I think it
will save me time.
On Mon, Sep 20, 2021, 9:59 AM steveoh @.***> wrote:

Everything ok @gbunce https://github.com/gbunce?
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/agrc/porter/issues/152#issuecomment-923059602, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AEA7QTDT3GGZ7JZNUP4JJZDUC5K5DANCNFSM5CKGJP4A
.

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

Any update on this @ZachBeck?

Today is the day

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@ZachBeck has completed 0 out of 1 tasks
:no_entry:

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for tasks - 152

check
status

@ZachBeck has completed 0 out of 1 tasks
:no_entry:

@steveoh has completed 0 out of 4 tasks
:no_entry:

@stdavis has completed 0 out of 1 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

gregbunce has completed 1 out of 1 tasks
:+1:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for TRANSPORTATION.LightRail_UTA

check
status

internal sgid
:+1:

meta table

- item id
:+1:

- item name
:+1:

- geometry type
:+1:

open sgid
:+1:

open data
:+1:

arcgis online
:+1:

stewardship

- Description
:+1:

- Data Source
:+1:

- Website URL
:+1:

- Endpoint
:+1:

- Data Type
:+1:

Is https://opendata.gis.utah.gov/datasets/utah-uta-light-rail-routes/explore?location=40.645640%2C-111.914994%2C-1.00 the open data layer for this? I'm confused by the publish date of September 11, 2017.

I'll bring it up in this weeks data team meeting, it seems like the past couple times we were derailed by naming conventions. Part of me would rather delete the issue as well.

Part of me would rather delete the issue as well.

Why do you want to delete the issue? The issue is letting us know we haven't finished the task yet.

I don't know... the single track vs double track representation seemed like splitting hairs to me. I'll try and get it wrapped up.

i can't remember, has this data been added to Internal?

No. Every time we were close to doing something we started debating what the name should be.

The bot is showing this dataset as existing in internal. Is that not the case?

It's the 2 track version.

Oh ok shoot. I'll update the issue so the bot isn't confused. I used a new name *_Carto just to make it break.

conductor results for TRANSPORTATION.LightRail_Carto

check
status

internal sgid
:no_entry:

meta table

- item id
:no_entry:

- item name
:no_entry:

- geometry type
:no_entry:

stewardship
:no_entry: Did not find TRANSPORTATION.LightRail_Carto in the worksheet

conductor results for tasks - 152

check
status

@gregbunce has completed 1 out of 4 tasks
:no_entry:

@ZachBeck has completed 0 out of 5 tasks
:no_entry:

@stdavis has completed 0 out of 2 tasks
:no_entry:

@steveoh has completed 2 out of 6 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for TRANSPORTATION.LightRail_Carto

check
status

internal sgid
:no_entry:

meta table

- item id
:no_entry:

- item name
:no_entry:

- geometry type
:no_entry:

stewardship
:no_entry: Did not find TRANSPORTATION.LightRail_Carto in the worksheet

conductor results for tasks - 152

check
status

@gregbunce has completed 1 out of 4 tasks
:no_entry:

@ZachBeck has completed 0 out of 5 tasks
:no_entry:

@stdavis has completed 0 out of 2 tasks
:no_entry:

@steveoh has completed 2 out of 6 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for TRANSPORTATION.LightRail_Carto

check
status

internal sgid
:no_entry:

meta table

- item id
:no_entry:

- item name
:no_entry:

- geometry type
:no_entry:

stewardship
:no_entry: Did not find TRANSPORTATION.LightRail_Carto in the worksheet

conductor results for tasks - 152

check
status

@gregbunce has completed 1 out of 4 tasks
:no_entry:

@ZachBeck has completed 0 out of 5 tasks
:no_entry:

@stdavis has completed 0 out of 2 tasks
:no_entry:

@steveoh has completed 2 out of 6 tasks
:no_entry:

@jacobdadams has completed 0 out of 1 tasks
:no_entry:

@rkelson has completed 0 out of 1 tasks
:no_entry:

conductor results for TRANSPORTATION.LightRail_Carto

check
status

internal sgid
:no_entry:

meta table

- item id
:no_entry:

- item name
:no_entry:

- geometry type
:no_entry:

stewardship
:no_entry: Did not find TRANSPORTATION.LightRail_Carto in the worksheet

We should close this if we aren't going to do it. Or mark it as blocked or waiting or something instead of just ignoring all of these reminders.

At this point I vote to close it, it's kind of been a mess from the start. I'd be happy to revisit it if it becomes a problem for UTA later on.


v1.31.1 showing HIGH vulnerability CVE-2023-44487

v1.31.1 is using the net package that has the vulnerability CVE-2023-44487. This requires upgrading Golang and the net package to resolve the CVE.

Thank you for reporting this. You've reported this as HIGH but the CVE is Moderate. It looks like the tool you're using reports the vulnerability as HIGH so I guess that's why you've reported it this way.
Since the operator's primary function does not act as a server I don't think this issue very critical to the operator. We should still look at getting this updated though.


Fix slice parsing for plugins

What does this PR do?
This PR fixes parsing of arrays in nested config structs for plugins.
Motivation
Fixes #10996
More

[x] Added/updated tests
[ ] Added/updated documentation

Additional Notes

Hi @sevensolutions,
Thanks for your contribution after some investigation we found that there is an issue in paerser (cf: https://github.com/traefik/paerser/pull/19)
Once this PR will be merged we will update the dependency in Traefik.
I'm adding bot not merged label for now and will close this PR accordingly.


How to publish multiple messages consecutively?

I have an ESP8266, and I am getting crazy trying to get the following to work... but I am only getting the first message (that of CONFIG_TOPIC0). I have tried adding delays(1000) after the publish, wifiClient.flush()... to no luck. Is this a bug, or am I doing something wrong?
WiFiClient wifiClient;
PubSubClient mqttClient(MQTT_SERVER_IP, MQTT_SERVER_PORT, wifiClient);

void setup()
{
  // Bring up the WiFi connection
  WiFi.mode( WIFI_STA );
  WiFi.begin( WIFI_SSID, WIFI_PASS );
  while (! WiFi.isConnected() ) {
    delay(20);
  }

  DynamicJsonDocument doc(200);
  doc["state_topic"] = COMMON_TOPIC_STATE;

  // send the configuration topics
  if (mqttClient.connect(MQTT_DEVICE))
  {
    String msg;

    doc["device_class"] = "temperature";
    doc["name"] = "Temperature";
    doc["unit_of_measurement"] = "ºC";
    doc["value_template"] = "{{ value_json.temperature}}";

    serializeJson(doc, msg);
    mqttClient.publish(CONFIG_TOPIC0, msg.c_str());

    doc["device_class"] = "humidity";
    doc["name"] = "Humidity";
    doc["unit_of_measurement"] = "%";
    doc["value_template"] = "{{ value_json.humidity}}";

    serializeJson(doc, msg);
    mqttClient.publish(CONFIG_TOPIC1, msg.c_str());

    doc["device_class"] = "pressure";
    doc["name"] = "Pressure";
    doc["unit_of_measurement"] = "mbar";
    doc["value_template"] = "{{ value_json.pressure}}";

    serializeJson(doc, msg);
    mqttClient.publish(CONFIG_TOPIC2, msg.c_str());

    mqttClient.disconnect();
    while( mqttClient.state() != -1 ) {
      delay(20);
    }
  }

  WiFi.forceSleepBegin();
  delay(20);
}

That was it: I had to clear the string before reusing it. 'msg.clear();' before the second and third 'publish' did the trick.


:bug: fix cluster dashboard when there is no openshiftversion

Summary
@hchenxa give feedback. Sometimes the openshiftversion label is null. we should hanlde it.

Related issue(s)
Fixes #

dashboards change won't be test in ut and e2e. the errors are not related with this PR. it will be handled separately.
/override ci/prow/test-e2e
/override ci/prow/test-unit


【Bug】leiden or louvain clustering error

Hello there,
While using Pegasus version 1.7.0, I noticed that the API "pg.neighbors" updates the weight matrix and returns it to "data.obsp['W_rep']". However, the "pg.leiden" API still uses "data.uns['W_rep']". As a result, an error occurs.
pg.neighbors(data_scan, rep=scan_key)
pg.leiden(data_scan, rep=scan_key,resolution=1)
pg.umap(data_scan, rep=scan_key)

2023-02-20 13:15:57,870 - pegasus.tools.nearest_neighbors - INFO - Function 'get_neighbors' finished in 21.59s.
2023-02-20 13:16:00,935 - pegasus.tools.nearest_neighbors - INFO - Function 'calculate_affinity_matrix' finished in 3.06s.
2023-02-20 13:16:04,090 - pegasus.tools.graph_operations - INFO - Function 'construct_graph' finished in 3.14s.
---------------------------------------------------------------------------
BaseException                             Traceback (most recent call last)
Cell In[11], line 2
      1 pg.neighbors(data_scan, rep=scan_key)
----> 2 pg.leiden(data_scan, rep=scan_key,resolution=1)
      3 pg.umap(data_scan, rep=scan_key)

File /opt/conda/envs/pg_1.7.1/lib/python3.9/site-packages/pegasusio/decorators.py:12, in timer.<locals>.inner_decorator.<locals>.wrapper_timer(*args, **kwargs)
      9 @functools.wraps(func)
     10 def wrapper_timer(*args, **kwargs):
     11 	start = time.perf_counter()
---> 12 	result = func(*args, **kwargs)
     13 	end = time.perf_counter()
     14 	message = f"Function '{func.__name__}' finished in {{:.{precision}f}}s.".format(end - start)

File /opt/conda/envs/pg_1.7.1/lib/python3.9/site-packages/pegasus/tools/clustering.py:266, in leiden(data, rep, resolution, n_clust, n_iter, random_state, class_label)
    264 G = construct_graph(W)
    265 if resolution is not None:
--> 266     membership = _run_community_detection("leiden", leidenalg, G, resolution, random_state, n_iter)
    267 else:
    268     assert isinstance(n_clust, int)

File /opt/conda/envs/pg_1.7.1/lib/python3.9/site-packages/pegasus/tools/clustering.py:98, in _run_community_detection(algo, module, G, resolution, random_state, n_iter)
     96     diff = optimiser.optimise_partition(partition)
     97 else:
---> 98     partition = module.find_partition(
     99         G,
    100         partition_type,
    101         seed=random_state,
    102         weights="weight",
    103         resolution_parameter=resolution,
    104         n_iterations=n_iter,
    105     )
    106 return partition.membership

File /opt/conda/envs/pg_1.7.1/lib/python3.9/site-packages/leidenalg/functions.py:81, in find_partition(graph, partition_type, initial_membership, weights, n_iterations, max_comm_size, seed, **kwargs)
     79 if not weights is None:
     80   kwargs['weights'] = weights
---> 81 partition = partition_type(graph,
     82                            initial_membership=initial_membership,
     83                            **kwargs)
     84 optimiser = Optimiser()
     86 optimiser.max_comm_size = max_comm_size

File /opt/conda/envs/pg_1.7.1/lib/python3.9/site-packages/leidenalg/VertexPartition.py:840, in RBConfigurationVertexPartition.__init__(self, graph, initial_membership, weights, resolution_parameter)
    836   else:
    837     # Make sure it is a list
    838     weights = list(weights)
--> 840 self._partition = _c_leiden._new_RBConfigurationVertexPartition(pygraph_t,
    841     initial_membership, weights, resolution_parameter)
    842 self._update_internal_membership()

BaseException: Could not construct partition: Weight vector not the same size as the number of edges.

@yihming I'm struggling with this problem. Could you offer any help?

@Zifeng-L I tried at my side with my data, and they should work properly (even with Scanorama batch correction). And pg.leiden does check obsp rather than uns for the weight matrix (see here).
Have you check if the shape of data_scan.obsp['W_scanorama'] is of (n_cells, n_cells)? From the error message above, it seems that the issue is related to the weight matrix itself.

@Zifeng-L I tried at my side with my data, and they should work properly (even with Scanorama batch correction). And pg.leiden does check obsp rather than uns for the weight matrix (see here).
Have you check if the shape of data_scan.obsp['W_scanorama'] is of (n_cells, n_cells)? From the error message above, it seems that the issue is related to the weight matrix itself.

I checked the shape of data_scan.obsp['W_scanorama'] is of (n_cells, n_cells).

Then I change the version of pegasus to 1.6.0, it works well.
So I just wondered what is the error with version 1.7.1.

What is the version of leidenalg package in your environment?

leidenalg==0.8.10 louvain==0.7.1

In the pg 1.7.1 env, leidenalg==0.9.1 louvain==0.8.0
In the pg 1.6.0 env, leidenalg==0.8.10 louvain==0.7.1

In the pg 1.7.1 env, leidenalg==0.9.1 louvain==0.8.0 In the pg 1.6.0 env, leidenalg==0.8.10 louvain==0.7.1

I tried to downgrade to leidenalg==0.8.10 louvain==0.7.1. It works!


VCLS  CUS0, and CUS1

Hello,
I exported VCLS, CUS0 and CUS1 objects to a zip file with version 1.70. I am tring to import it in another system with version 1.70, but that objects are not listed on the object list (only in the system where I do the export). After doing activation of the whole object list in teh target system, the mentioned objects(VCLS,CUS0,CUS1) were not in TADIR. If I go to SE54 to check the View Cluster, system immediately asks witha  popup to select transport request. After that I saw the VCLS in  TADIR, but CUS0 and CUS1 is still not in TADIR. After that I went back to ABAPGit in target system, refreshed the view and the VCLS appeared. I checked the zip file, and the CUSo,CUS1 and VCLS objects can be found inside.
Thank you
Attila

Hi,
Can you help reproducing the error in a public repository? Are you loading into a transported package or local?

Hi,
I operate with Offline projects behind corporate firewall. I created the Offline project using an existing transportable ABAP package. I have created the same package in the target system (which has a different transport layer assigned), after I created an offline project using the apckage created in the target system, then  I did the import ZIP, and skipped to overwrite the package only.
Due inetllectual properties, I can't make the sources public, or put into a protected repo, but I can provide with the zip file per email.

Hi,
another thing I noticed,when doing the import second time.
Object list in original system:

When asking to overwrite in target system, I saw that the FUGR is 6 times on the list, but teh other objects with same name but of other object type are missing in the overwrite dialog.

If I choose nothing to overwrite, I get teh following dump (rename to HTM):
zabapgit_dump.txt
It might help.

As requested: https://github.com/attilaberencsi/zbc_job_scheduler.git

cool, I'm at customer site most of the week, so I do not have access to my real test systems, so I'll probably try it sometime during the weekend

Issue reproduced,

@attilaberencsi can you try testing #1633 and #1636 ? these should fix VCLS and CUS0
Probably a similar fix is needed for CUS1

I receive the following error message (TK/103) when importing a zip at the moment.

The same error  appears when I try to pull your example repo.

Problem is in corr_insert. Object type LIMU VCLD isn't correct.
https://github.com/larshp/abapGit/blob/3a5b2b73fb48a5e9af4474501252edb5676742e0/src/objects/zcl_abapgit_object_vcls.clas.abap#L73
I think corr_insert of zcl_abapgit_objects_super is only valid for DDIC/DICT?
https://github.com/larshp/abapGit/blob/3a5b2b73fb48a5e9af4474501252edb5676742e0/src/objects/zcl_abapgit_objects_super.clas.abap#L103-L119

@attilaberencsi can you try again with the latest build?

Hi Guys,
thanks for your support. It works great!
Attila


x/build/env: host-windows-amd64-2016 (VM Image: windows-amd64-server-2016-v8)

We have Windows 10 up and running, which I think is preferable to Server 2016 for our purposes.


RFE: Documentation. Document Event Source plugins in a manner similar to the ansible collection index

Please confirm the following

[X] I agree to follow this project's code of conduct.
[X] I have checked the current issues for duplicates.
[X] I understand that ansible-rulebook is open source software provided for free and that I might not receive a timely response.

Feature type
New Feature
Feature Summary
Working with the available event sources is challenging as the available configuration parameters are not published and require scraping the python code to find the possible configuration parameters.
By including a collection index for these modules, similar to the ansible plugins docs, users can create their own rulebooks easier https://docs.ansible.com/ansible/latest/collections/all_plugins.html
Steps to reproduce
N/A
Current results
N/A
Sugested feature result
Additional Documentation page for the ansible.eda collection
Additional information
Willing to help contribute and create these files, but I don't know where to place the docs files or to get the templates from

Indeed we need to improve the docs for source plugins as well as meet the requirements for ansible-modules (and be able to see the docs with ansible-doc) I would say this is more a task for https://github.com/ansible/event-driven-ansible

Cross-posted the issue to event-driven-ansible project https://github.com/ansible/event-driven-ansible/issues/160


Container health-check fails after creating a certificate

Hi,
We ran the following command (within a running container) to generate a certificate for the Puppet board:
puppetserver ca generate --certname $CERTNAME
The issue is that the command saves the certificate to the ${SSLDIR}/certs folder, which causes the healthcheck.sh script to fail because the following line of code
certname=$(cd "${SSLDIR}/certs" && ls *.pem | grep --invert-match ca.pem)
cannot set the certname variable correctly.
The only way to fix the problem was to remove the newly generated .pem certificate from the directory (which is fine anyway, as it seems that the certificate is also copied to the ca/signed directory).
Could you please take a look at that? Is that a bug in the healthcheck.sh script? Or could it be that we have a wrong setting in the puppet.conf file?
Thanks

Thanks for the issue. I‘m not happy myself with this code. Was wondering when it will break. I have several local test to enhance this. But didn’t feel ready yet.

Hi, thanks for the quick reply.
Well, I guess we have indeed broken it. Do you plan to fix it in a future release?

i'm right on it. have some time traveling. PR incomming!

Thanks!


feat: [Step Function] Set tags

What does this PR do?
Enables setting tags for the state machine, including DD tags and custom tags. For example, if the user passes these properties to Datadog:
    const datadogSfn = new DatadogStepFunctions(this, "Datadog", {
      env: "dev",
      service: "my-service",
      version: "1.0.0",
      forwarderArn: process.env.DD_FORWARDER_ARN,
      tags: "custom-tag-1:tag-value-1,custom-tag-2:tag-value-2",
    });
    datadogSfn.addStateMachines([stateMachine]);

Then the state machine will have these tags:

DD_ENV: env
DD_SERVICE: my-service
DD_VERSION: 1.0.0
custom-tag-1: tag-value-1
custom-tag-2: tag-value-2

Motivation
This is one step of instrumenting a step function.

Testing Guidelines
Automated testing
Passed the added test
Manual testing
Deployed the example stacks step-functions-typescript-stack. The tags are set as expected.

Additional Notes
Need a stamp from Cloud Tracing team, who, as the downstream consumer, should know what tags should be set here.

Types of Changes

[ ] Bug fix
[x] New feature
[ ] Breaking change
[ ] Misc (docs, refactoring, dependency upgrade, etc.)

Check all that apply

[x] This PR's description is comprehensive
[ ] This PR contains breaking changes that are documented in the description
[ ] This PR introduces new APIs or parameters that are documented and unlikely to change in the foreseeable future
[ ] This PR impacts documentation, and it has been updated (or a ticket has been logged)
[x] This PR's changes are covered by the automated tests
[ ] This PR collects user input/sensitive content into Datadog

/merge


Is it impossible to turn a sequence of identical instance blocks into a compiled loop?

My apologies if this is a trivial question, but I work with transformers and have a number of situations where I create a sequence of encoder or decoder blocks.  These end up getting initialized by something like
self.blocks = [EncoderBlock(config) for _ in config.num_blocks]

and then called with something like
for block in self.blocks:
    x = block(x)

What is interesting is that the layers are all fundamentally the same function, just with different parameter weights.  It seems that this should be amenable to an hk.scan call to speed up compilation.  However, I don't see a way to make this work that is not particularly ugly/hacky.  Is there an easy implementation that I am missing, or is there no real intention to support this?

Hi @cmunna0052 , hk.experimental.layer_stack provides this functionality:
def block(x):
  return hk.Linear(1)(x)

def f(x):
  stack = hk.experimental.layer_stack(num_layers=10, name='stack')(block)
  x = stack(x)
  return x

f = hk.transform(f)

Perfect, thanks!


How to parse the string NOW()-INTERVAL 1 DAY

Environment
Knex version:
Database: MYSQL 8.0+ ,  KNEX version: 0.21.4
OS:
Bug
While creating an insert query with  this code:
await knex('results').insert(
        {
          game_id:game_id,
          result:faker.random.number({min:10,max:99}),
          date:`(DATE(NOW()) - INTERVAL ${i} DAY)`,
          result_time:knex.fn.now()
          }
        )

The query generated is like this :
insert intoresults (date, game_id, result, result_time) values ('(DATE(NOW()) - INTERVAL 1 DAY)', 1, 66, CURRENT_TIMESTAMP)
The error I receive below is because the date value - 'DATE(NOW()) - INTERVAL 1 DAY)' should NOT BE as a string.
Error:
And I receive the following error.
ER_TRUNCATED_WRONG_VALUE: Incorrect date value: '(DATE(NOW()) - INTERVAL 1 DAY)' for column 'date' at row 1
For the query to work correctly, it should be generated as below:
insert intoresults (date, game_id, result, result_time) values ((DATE(NOW()) - INTERVAL 1 DAY), 1, 66, CURRENT_TIMESTAMP)
(THE DATE FIELD SHOULD BE WITHOUT STRINGS)
HOW TO ACHIEVE THAT IN KNEX.JS?

Yep, knex.raw can be used in most of the places to pass SQL to queries instead of string literals.


Insorts Clone

Close issue #1341
Insorts Clone (NewsMonkey) and Issue number  #1341

Checklist:

[] I have mentioned the issue number in my Pull Request.
[] I have commented my code, particularly in hard-to-understand areas
[] I have created a helpful and easy to understand README.md

@pranjay-poddar @TusharKesarwani  please see my pull request and merge my project


ERF small fix

Thanks for the great code.
https://github.com/DingXiaoH/RepLKNet-pytorch/blob/main/erf/analyze_erf.py#L60
The ((i*2+1)/1024) **2  can be modified to
(i * 2 + 1) / h * (i * 2 + 1) / w
making the code robust.

Updated. Many thanks!


Solo10 Base

Sistema Solo10 base  by   101Games

Submission Checklist
Required

[x] The pull request title clearly contains the name of the sheet I am editing.
[x] The pull request title clearly states the type of change I am submitting (New Sheet/New Feature/Bugfix/etc.).
[x] The pull request makes changes to files in only one sub-folder.
[x] The pull request does not contain changes to any json files in the translations folder (translation.json is permitted)

New Sheet Details

The name of this game is: <   >  (Solo10)

The publisher of this game is: <   > (101 games)

The name of this game system/family is: <   > (Solo10)

[x] I have followed the Character Sheets Standards when building this sheet.

[x] I have authorization from the game's publisher to make this an official sheet on Roll20 with their name attached.
[x] This game is not a traditionally published game, but a copy of the game rules can be purchased/downloaded/found at: <https://www.101games.com.br/loja >
[ ] This sheet is for an unofficial fan game, modification to an existing game, or a homebrew system.

Changes / Description

Character Sheet Info Roll20 Internal Use only.

Hello @jarbascjunior2!
I see you have named the PR Solo10 Base but in the PR's sheet details, the name provided is Solo10. In addition, the link you provided for the rules leads me to the store, so it appears that this sheet will be used for generic Solo 10 games. Is that correct? I just want to be clear on what the name should be and then I'll get that merged and published for you.
I'll keep an eye out for your response!
Kayla

Hi, this is correct for solo10 base  games.
Em qui., 22 de ago. de 2024 às 14:31, Kayla Fischer <
@.***> escreveu:

Hello @jarbascjunior2 https://github.com/jarbascjunior2!
I see you have named the PR Solo10 Base but in the PR's sheet details, the
name provided is Solo10. In addition, the link you provided for the rules
leads me to the store, so it appears that this sheet will be used for
generic Solo 10 games. Is that correct? I just want to be clear on what the
name should be and then I'll get that merged and published for you.
I'll keep an eye out for your response!
Kayla
—
Reply to this email directly, view it on GitHub
https://github.com/Roll20/roll20-character-sheets/pull/13223#issuecomment-2305287939,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BJ3ASDI3WSHT32YRKOCBQYDZSYN5NAVCNFSM6AAAAABM2RMYGSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBVGI4DOOJTHE
.
You are receiving this because you were mentioned.Message ID:
@.***>

thank you, the name  can  be junt  solo 10.
Em qui., 22 de ago. de 2024 às 15:25, Jarbas Carneiro junior <
@.***> escreveu:

Hi, this is correct for solo10 base  games.
Em qui., 22 de ago. de 2024 às 14:31, Kayla Fischer <
@.***> escreveu:

Hello @jarbascjunior2 https://github.com/jarbascjunior2!
I see you have named the PR Solo10 Base but in the PR's sheet details,
the name provided is Solo10. In addition, the link you provided for the
rules leads me to the store, so it appears that this sheet will be used for
generic Solo 10 games. Is that correct? I just want to be clear on what the
name should be and then I'll get that merged and published for you.
I'll keep an eye out for your response!
Kayla
—
Reply to this email directly, view it on GitHub
https://github.com/Roll20/roll20-character-sheets/pull/13223#issuecomment-2305287939,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BJ3ASDI3WSHT32YRKOCBQYDZSYN5NAVCNFSM6AAAAABM2RMYGSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBVGI4DOOJTHE
.
You are receiving this because you were mentioned.Message ID:
@.***>

thank you, the name can be junt solo 10. Em qui., 22 de ago. de 2024 às 15:25, Jarbas Carneiro junior < @.> escreveu:
…
Hi, this is correct for solo10 base games. Em qui., 22 de ago. de 2024 às 14:31, Kayla Fischer < @.> escreveu: > Hello @jarbascjunior2 https://github.com/jarbascjunior2! > > I see you have named the PR Solo10 Base but in the PR's sheet details, > the name provided is Solo10. In addition, the link you provided for the > rules leads me to the store, so it appears that this sheet will be used for > generic Solo 10 games. Is that correct? I just want to be clear on what the > name should be and then I'll get that merged and published for you. > > I'll keep an eye out for your response! > Kayla > > — > Reply to this email directly, view it on GitHub > <#13223 (comment)>, > or unsubscribe > https://github.com/notifications/unsubscribe-auth/BJ3ASDI3WSHT32YRKOCBQYDZSYN5NAVCNFSM6AAAAABM2RMYGSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMBVGI4DOOJTHE > . > You are receiving this because you were mentioned.Message ID: > @.***> >

Perfect, I'll get that merged!

Thank  you  very much.
Em qui., 22 de ago. de 2024 às 15:47, Kayla Fischer <
@.***> escreveu:

Merged #13223
https://github.com/Roll20/roll20-character-sheets/pull/13223 into
master.
—
Reply to this email directly, view it on GitHub
https://github.com/Roll20/roll20-character-sheets/pull/13223#event-13982699275,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BJ3ASDKAYI7PHJRZY7Q6JX3ZSYW57AVCNFSM6AAAAABM2RMYGSVHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJTHE4DENRZHEZDONI
.
You are receiving this because you were mentioned.Message ID:
@.***
com>


Disk indexing coming?

Is disk storage for the indexes planned, or is it fast enough to use that the indexes can be built on every app launch?

Thanks to this PR you can save and load indexes on disk already https://github.com/ZachNagengast/similarity-search-kit/pull/16

There's a few different options such as json or binary https://github.com/ZachNagengast/similarity-search-kit/tree/main/Sources/SimilaritySearchKit/Core/Persistence

Amazing thank you
While I'm here - it looks like this lib also needs upgrading to be able to support the new iOS 17 NLContextualEmbedding, is that correct? https://www.wwdcnotes.com/notes/wwdc23/10042/

Yep, there's a good example of some code using it in this repo https://github.com/apple/ml-stable-diffusion/commit/7f9c58a6c1483a6da1f398cad49eee2f9fa3bee4#diff-fadaa8d2dd21c410a4f9ef64b9fa090799b8a2814bc6851408b3b29cf4f920a4

Thank you, I've seen this one example plus a couple articles in Japanese that discuss the code. However what I can't make sense of is how to go from having the contextual embeddings, to using them in a similarity search.
Do you plan to add this new API to this library? If so I'd just adopt the current embeddings options and offer the iOS 17 feature to capable devices later on. I'd help add it but don't understand how to generalize beyond using it as an input for SD. Thanks

I have a draft of this API that I'm hoping to finish up soon, FYI

FWIW I'm also now waiting for USearch to add text similarity search around end of this month, which is usable from Swift as well as WASM/others. Then I plan to use it with NLContextualEmbedding on iOS/mac, or something else for web deployment via SwiftWASM.

I just pushed #22 as a PR, if you can check it out and let me know how it works for you that would be helpful!

Merged #22 into main which contains this new embedding class.


Android Basics: Introduction to Room and Flow

I'm new to Kotlin and the current version of the Android Studio, but when adding the dependencies, it appears that I had to add a plugin "id 'kotlin-kapt'" as well.

I was a little disappointed that so many of the required imports were explicitly called out, but some were not.  I realize that this is a more advanced tutorial, but I kind of expect a tutorial to work without any tweaking.


axis labels too small for large axes

this example from the docs is fine:
using Makie
scene = Scene(resolution = (500, 500))
aviz = axis(linspace(0, 2, 4), linspace(0, 2, 4))
center!(scene)

but if you make the axis larger the labels get very small, e.g. aviz = axis(linspace(0, 20, 4), linspace(0, 20, 4))

yes i'm working on that! I'll soon introduce units to make those things independant of scale


python311Packages.django-cacheops: re-add six

Description of changes
With https://github.com/NixOS/nixpkgs/commit/cbe45180d16129b1a591d204d0b6f01246c009bc I removed six. six was removed in the current master and not 6.2 (https://github.com/NixOS/nixpkgs/pull/218470).

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 218607 run on x86_64-linux 1

3 packages built:

peering-manager
python310Packages.django-cacheops
python311Packages.django-cacheops


Remove fitbug/symfony-yaml-serializer-encoder-decoder in place of default YAML serializer

Replace fitbug/symfony-yaml-serializer-encoder-decoder seems because to be not maintened anymore and the Symfony Serializer component implements its own YAML encoder/decoder.

Thanks for this PR,
Unfortunetaly i cannot accept it like this, as it's BC :/, since people on 3.1 will not be able to use this lib anymore.
However it's something that i want and i will gladly accept this PR on this repository : https://github.com/janephp/janephp which will hold the next version (4.0) of jane open api.

OK I understand.
I will make  a PR on the janephp/janephp repository because fitbug/symfony-yaml-serializer-encoder-decoder seems to be unmaintened and it's not compatible with Symfony 4.
Will this repository be updated with the changes of janephp/janephp ?


Crash in initialisation method

After updating to the latest release we have a crash in the ObjectiveC initialisation method because self.placeholder is nil.
I tested this patch with succes :
From a4a530e3c1f0fbfdfabd50182b65327fbc6231cb Mon Sep 17 00:00:00 2001
From: Vladimir Vyskocil<EMAIL_ADDRESS>Date: Mon, 7 Oct 2019 16:48:19 +0200
Subject: [PATCH] After updating to the latest release we have a crash in the
 ObjectiveC initialisation method because self.placeholder is nil.

---
 Source-Objc/ACFloatingTextField.m | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/Source-Objc/ACFloatingTextField.m b/Source-Objc/ACFloatingTextField.m
index 038e253..bc72bb7 100755
--- a/Source-Objc/ACFloatingTextField.m
+++ b/Source-Objc/ACFloatingTextField.m
@@ -156,7 +156,8 @@

     [self addErrorPlaceholderLabel];

-    self.attributedPlaceholder = [[NSAttributedString alloc] initWithString:self.placeholder attributes:@{NSForegroundColorAttributeName:self.placeHolderColor}];
+    NSString *placeholder = self.placeholder ? self.placeholder : @"";
+    self.attributedPlaceholder = [[NSAttributedString alloc] initWithString:placeholder attributes:@{NSForegroundColorAttributeName:self.placeHolderColor}];

     /// Placeholder Label Configuration.
     if (![self.text isEqualToString:@""]){
--
2.20.1

getting same issue

Ok thanks I will check this asap.
…
Sent from my iPhone
On 09-Oct-2019, at 8:09 PM, sejalthesiya @.***> wrote: getting same issue — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

Any update sir??

will so it later today EOD thanks for follow up!
Sent from my iPhone

On 10-Oct-2019, at 4:15 PM, sejalthesiya<EMAIL_ADDRESS>wrote:
Ok thanks I will check this asap.
…
Sent from my iPhone
On 09-Oct-2019, at 8:09 PM, sejalthesiya @.***> wrote: getting same issue — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.
Any update sir??
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.

Done PLease check now.


SSL errors when connecting to OpenAI azure endpoint while using library

Confirm this is an issue with the Python library and not an underlying OpenAI API

[X] This is an issue with the Python library

Describe the bug
Hi,
Over the last few weeks I've been configuring a site to site VPN between AWS and Azure so we can use the OpenAI endpoints that Azure now offers through a Privatelink. We're using a sample taken from the docs (with correct values replaced etc)
`import os
import openai
openai.api_type = "azure"
openai.api_base = os.getenv("AZURE_OPENAI_ENDPOINT")
openai.api_key = os.getenv("AZURE_OPENAI_KEY")
openai.api_version = "2023-05-15"
response = openai.ChatCompletion.create(
engine="gpt-35-turbo", # engine = "deployment_name".
messages=[
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Does Azure OpenAI support customer managed keys?"},
{"role": "assistant", "content": "Yes, customer managed keys are supported by Azure OpenAI."},
{"role": "user", "content": "Do other Azure AI services support this too?"}
]
)
print(response)
print(response['choices'][0]['message']['content'])`
I'm unfortunately receiving an SSL error when attempting to connect to the Azure endpoint while on the VPN. The error is...
Max retries exceeded with url: /openai/deployments//chat/completions?api-version=1106-preview (Caused by SSLError(CertificateError("hostname 'myorg.privatelink.openai.azure.com' doesn't match either of '*.cognitiveservices.azure.com', '*.api.cognitive.microsoft.com', '*.dev.cognitive.microsoft.com', '*.openai.azure.com'"))).
I initially thought this might be an issue with the domain I was using so have also attempted myorg.openai.azure.com (the endpoint seen in the azure console) and IP with the same problem. Issues I've seen similar to this online suggest a couple of solutions...

Use certifi to find where the local certificate chain is and add the root cert which you can grab from hitting the endpoint through the browser, this has had no effect when I've tried.
Disable SSL verification (Not really a fix and a bad solution)

I thought it could be something to do with the infrastructure setup but after running a pure SSL test I can receive a handshake from the endpoint, going via the browser also doesn't present the same certificate issue. Is this something other people have experienced or is this a bug with the openAI library/azure implementation?
To Reproduce

Create an Azure endpoint with Privatelink
Connect to a corporate VPN
Run above code sample

Code snippets
None

OS
MacOS
Python version
Python 3.8.18
Library version
latest

You'll likely need to pass a custom httpx client configured for your VPN's SSL setup.
See httpx's SSL docs here: https://www.python-httpx.org/advanced/ssl/


Question...

Hi. Not really a issue (sorry for that), I'm using this very same lib on an other project.... my question is did you manage to get "the search" window? I would love to search something programmatic .
That's it !

Hi,
Sorry but so far I have not found a way to display the search.


JSON alias endpoint not working

This one is easy to test: open this URL https://staltzphone.hermies.club?encoding=json and it should respond with a JSON body.

ouch. This slipped through #117 - the alias forwarding wrongly strips the rest of the url

Fixed on the demo server, updating config here now.

Good! Just one more detail until ssb-room-client consumeAlias works with alice.room.com: #183


fix: update help popup according to user config

Addresses #244
Changes of this PR:

using magit keybindings can be done directly through the setup function with use_magit_keybindings = true

false by default

unbind p in magit keybindings, used to be "push" but P does the same thing and this is more magit-like
help popup now shows correct keybindings by inspecting config.values.use_magit_keybindings
documentation changes

I welcome any changes/comments to this PR.
P.S. for backward compatibility, I still keep the config.use_magit_keybindings() function. I can remove it if you want.

Thank you!

P.S. for backward compatibility, I still keep the config.use_magit_keybindings() function. I can remove it if you want.

Can you remove the function in a BREAKING: .... commit? Thanks!
Everything else looks good.

Thank you!

Can this issue be closed? #244


Separate bind and announce address for gateway

Fixes #981

Codecov Report
Base: 65.73% // Head: 65.71% // Decreases project coverage by -0.01% :warning:

Coverage data is based on head (08ab2c0) compared to base (98e8667).
Patch coverage: 35.71% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##           master     #988      +/-   ##
==========================================
- Coverage   65.73%   65.71%   -0.02%
==========================================
  Files         116      116
  Lines       17295    17301       +6
==========================================
+ Hits        11369    11370       +1
- Misses       5926     5931       +5

Impacted Files
Coverage Δ

gateway/cli/src/main.rs
0.71% <0.00%> (-0.03%)
:arrow_down:

gateway/ln-gateway/src/config.rs
100.00% <ø> (ø)

gateway/ln-gateway/src/lib.rs
34.10% <83.33%> (+1.07%)
:arrow_up:

fedimint-server/src/net/peers.rs
88.82% <0.00%> (-0.30%)
:arrow_down:

fedimint-server/src/net/connect.rs
95.01% <0.00%> (-0.25%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Feature/relative url

Issue: #241

Describe in detail the problem you had and how this PR fixes it
Is there an open issue you can link to?

Problems still exist while using relative url ("resource").
location.pathname + relative_url will fix it.

@kylecarbs - I know this is only a week old, but do you have an estimate for when you'll be able to review this PR?
Thanks!

polite ping

any chance of getting this merged in for the next release?  this is a pretty big issue for how my environment is atm (of which I have limited control)


DateFilter

I'm having some issues with this package, first the default in my DateFilter is not showing, while is showing if I add that to a resource. Second when I select a date is always showing the time as well, always 00:00:00, while inside the resource it only shows the date without the time.

I think you are parsing the date via $value = Carbon::parse($value); which will also include time... This package will only give you Y-m-d formatted date. Let me know if you still have issue on this.


DCOS-39069: use headercell from ui-kit

Testing
Change this line in NodesTableContainer.js
-import NodesTable from "../../../components/NodesTable";
+import NodesTable from "../../../components/NodesTable-new";

After that please take a look at the nodes table and see if the headlines of the table look correctly
Trade-offs

The content spacing is a separate issue (DCOS-39265), therefore it looks a bit off

Dependencies

None

@DanielMSchmidt CI is red with the build issue again 😩 maybe you can try to cut a new release and use that one…

Oh, and I have the same issue on my machine 😭

<EMAIL_ADDRESS>doesn't want to compile. ts-lint errors

@weblancaster Do you have an idea why the ui-kit doesn't compile? 🤔

@weblancaster @DanielMSchmidt I released ui-kit 1.2.4, 1.2.3 imports looked different to the ones from ui-kit master… Can you please try using that one? 🙇

1.2.4 is also broken :( cc @Fabs

Hey Team, I had no time to double check this, but I am 90% confident that it worked. If any of you can spare the time it would be great if you could check that @juliangieseke issue is gone now. If not I will do it myself tomorrow :) Thank you for your help 👍


Support default command

This feature was removed during the big rewrite.
Need to determine what is the best way to describe this in the CommandSpec

No good use case for this. Just provide default commands available for the user to use in their cli app.

:tada: This issue has been resolved in version 5.0.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


BUGFIX: Fix miswire of min max delegations amount

CHANGELOG:

Fixed an issue where the min and max delegations amounts were inverted
Added a test and check to ensure that max delegation amount can never be strictly less than the min
Removed the pruning of legacy contract hash and wash hash key during the migration of contract packages

bors r+


Libxml2 rebuild

{package} {version} {:snowflake:}
Destination channel: {Snowflake | defaults}
Links

{ticket_number}
Upstream repository
Upstream changelog/diff
Relevant dependency PRs:

...

Explanation of changes:

...

An error on win64:
 C:\cygwin64\tmp\xmlXPathInitpg01tazt.c(1): fatal error C1083: Cannot open include file: 'libxml/xpath.h': No such file or directory

@danpetry win64 still fails:
C:\b\abs_9airk1_mmq\croot\lxml_1721946551997\work\src\lxml\includes/etree_defs.h(12): fatal error C1083: Cannot open include file: 'libxml/xmlversion.h': No such file or directory

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_e0q5lk8d8w/clone` failed. (See above for error)
The following problems have been found:
===== ERRORS =====

clone/recipe/meta.yaml:17: uses_setup_py: python setup.py install is deprecated.
===== Final Report: =====
1 Error and 0 Warnings were found

@SC426 I enabled cython on win64 (before the package was built without cython).
However the issue with locating libxml2 persists. I think this PR will solve it

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_180cyk45fm/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:31: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.

===== ERRORS =====

clone/recipe/meta.yaml:17: uses_setup_py: python setup.py install is deprecated.
===== Final Report: =====
1 Error and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_8bfbjeouqk/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:31: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.

===== ERRORS =====

clone/recipe/meta.yaml:17: uses_setup_py: python setup.py install is deprecated.
===== Final Report: =====
1 Error and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_1a7_pkbgu7/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:28: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_8ffh2e2_qp/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_e482kj9cqu/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_373hpquuju/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found

Linter check found the following problems:
ERROR conda.cli.main_run:execute(125): `conda run conda-lint /tmp/abs_8eumc170lz/clone` failed. (See above for error)
The following problems have been found:
===== WARNINGS =====

clone/recipe/meta.yaml:27: host_section_needs_exact_pinnings: Linked libraries host should have exact version pinnings.
===== Final Report: =====
0 Errors and 1 Warning were found


NPE if INLINE mapping references non backing bean field

If a FluentApiInlineBackingBeanMapping mapping references a non backing bean field an NPE is thrown.(Same if annotation is missing)
There should be an error compiler message triggered during validation in this case.

This has been fixed

The validator logic has been rearranged, this error is gone now


Failed to install the stmetrics package

Hello, team of developers,
I'm trying to install the stmetrics package, however python gave me a metadata generation error.
Google Colab:

Planetary Computer:

I would like to know how to install the package.
Thank you for your attention.

Hello,
Today when I was installing the package I faced the same issue. The error is due to the deprecated sklearn package. Instead sklearn , you should use the scikit-learn package. To address this issue, you can follow these steps:
1. Clone the repository:
git clone https://github.com/brazil-data-cube/stmetrics.git
cd stmetrics
2.Edit the dependencies:

Open setup.py in a text editor.
Replace sklearn with scikit-learn in the install_requires list or anywhere else it appears.

For example, if your setup.py looks like this:
install_requires=[     'scipy',     'sklearn',     ... ],
change it to:
install_requires=[     'scipy',     'scikit-learn',     ... ],
3.Install the package:
pip install .