Error in formula.default(object) : invalid formula

Hi,
I am trying the script for longitudinal analysis. However, I am getting the following error : Error in formula.default(object) : invalid formula. I think it might come from when I define the random effects, since I tried the standard analysis with the same dataset and it works perfectly. Are there any special considerations I should know for defining the random effects? I have a factor with 5 levels, 5 individuals and I am comparing 2 seasons (factor with 2 levels). Do you have some advice to fix this error?
Thanks,
Tatiana

Hi Tatiana,
Thanks for using ANCOM!
You are right, this error message probably occurs when defining an improper random effect formula. In order for me to better look into your problem, could you please provide a reproducible example of this error (i.e. your lines of codes and an example dataset)?
Best,
Huang

####### ANCOMMM ######
library(exactRankTests)
library(nlme)
library(dplyr)
library(ggplot2)
library(compositions)
library(readr)
library(tidyverse)
source("ANCOM-2.1/scripts/ancom_v2.1.R")
Data preparation
otu_data = read.csv("otu_data.txt", sep = "\t", row.names = 1, check.names = F)
meta_data = read.csv("meta_data.txt", sep = "\t")
meta_data = meta_data %>% rename(SampleID = Sample.ID)
str(meta_data)
#Convert to factor
meta_data <- data.frame(lapply(meta_data, as.factor))
str(meta_data)
Repeated measure/longitudinal analysis
Step 1: Data preprocessing
feature_table = otu_data; sample_var = "SampleID"; group_var = "season"
out_cut = 0.05; zero_cut = 0.90; lib_cut = 0; neg_lb = TRUE
prepro = feature_table_pre_process(feature_table, meta_data, sample_var, group_var,
out_cut, zero_cut, lib_cut, neg_lb)
feature_table = prepro$feature_table # Preprocessed feature table
meta_data = prepro$meta_data # Preprocessed metadata
struc_zero = prepro$structure_zeros # Structural zero info
Step 2: ANCOM
main_var = "season"; p_adj_method = "BH"; alpha = 0.05
adj_formula = NULL; rand_formula = "~ 1 | individual"; control = list(msMaxIter = 50)
t_start = Sys.time()
res = ANCOM(feature_table, meta_data, struc_zero, main_var, p_adj_method,
alpha, adj_formula, rand_formula, control)
t_end = Sys.time()
t_run = t_end - t_start
ancomm_script.txt
meta_data.txt
otu_data.txt

Hi,
Thanks for sending the sample code and dataset! I realized the problem comes from unnamed argument control, try the following:
res = ANCOM(feature_table, meta_data, struc_zero, main_var, p_adj_method,              alpha, adj_formula, rand_formula, control = control)
I will address this problem for the next version of ANCOM, thanks for catching this!
Best,
Huang

Hi Huang,
Thanks for the help! I made the suggested changes and now it works.
Have a nice day!
Tatiana

Hi Huang,
I have another question. I  was working with Random coefficients/slope model and had the following error:
Error in lme.formula(fixed = tformula, data = data.frame(x, alr_data,  :  nlminb problem, convergence error code = 1 message = iteration limit reached without convergence (10) .
From older issues I noticed that I should increase the number of max iterations for nlme.
Can you tell me how can I do that?
Thanks,
Tatiana

Hi Tatiana,
In dealing with mixed effects models, ANCOM passes arguments to the lme function from nlme package.
When convergence error occurs, usually, you can increase the maximum number of iterations or change the optimizer :
control = lmeControl(maxIter = 100, msMaxIter = 100, opt = "optim")
res = ANCOM(feature_table, meta_data, struc_zero, main_var, p_adj_method,              alpha, adj_formula, rand_formula, control = control)
Also, it is good to check whether it is truly meaningful to include the random effects in your model. You can find a more detailed discussion here.
Hope it helps,
Huang

Hi Huang,
Thanks for all the help.
Tatiana


How to recover from failed Try with function returning other Try?

I have some code like this:
Supplier<Try<Boolean, RuntimeException>> execute = ...

boolean isOk = execute.get();

and i want to try again and call recoverWith if the first execution failed:
boolean isOk = execute.get().recoverWith(ex -> execute.get());

but current signature of recoverWith do not allow to pass functions returning Try:
public Success<T, X> recoverWith(Function<? super X, ? extends Success<T, X>> fn);

can you make it like scala version of Try:
public Success<T, X> recoverWith(Function<? super X, ? extends Try<T, X>> fn);

or is there a better way to recover with function returning Try?

No you are right, this is an oversight / bug. Will fix in 1.0.5

We should have fix with this in it released tomorrow, Success shouldn't be directly exposed in the API like that and is too restrictive as an input / return type for that method.
You can also use the visit method
execute.get()
       .visit(Try::success,this::myMethod);

public Try<T,Throwable> myMethod(Throwable exception)

There are overloaded versions that accept either a Function or a Supplier for the failure case
execute.get()
       .visit(Try::success,this::myMethod);

public Try<T,Throwable> myMethod()

This is released in 1.0.5.
The to method could also be used here. It exists to allow users to fluent inject custom operators, and although I haven't run it to check - I think you could just write
execute.get()
       .to(t->execute.get());

You can us the to method to  fluently inject custom operators e.g.
execute.get()
       .to(myCustomOp(a->a*2));


Provide reasonable processing of mistakes in transitional table

When user makes some mistakes in transitional table, he should not see balls hovering in the air and cat which goes beyond the screen

Make basket line "endless" to avoid such situations.

Implemented at  79d4cf9


Update to bdk-swift 0.4.0

No rush on getting this merged. I can still point people to this PR as an example for what to do to upgrade to latest bdk-swift 0.4.0.
See here for changes in bdk-swift 0.4.0:  https://github.com/bitcoindevkit/bdk-swift/pull/24

Also this new version of bdk-swift support full (experimental) tap root wallet support, including using miniscript in the script spends 🥕 🥕 🥕 !

thank you, will merge without looking for now but I do want to return to this project. will hit you up on discord to discuss


vulkaninfo: Fix validation errors

Required checking for surface support of a given physical device as well as adding the correct Image usage for transient images.
Fixes #689

CI Vulkan-Tools build queued with queue ID 17049.

CI Vulkan-Tools build # 802 running.

CI Vulkan-Tools build # 802 passed.

Something to note, this PR makes it so that lavapipe no longer 'supports surface operations', since it returns false on the presentation support query.
This is definitely more correct behavior, but I have to wonder how lavapipe renders to the screen if it doesn't support swapchain operations? It does return valid data when querying the specific surface capabilities, present modes, & formats.


Enhancement -> Client version in connect string

Hi,
in the older rocket chat client versions have been sending their versions to the server. So it was possible to inform users about old clients.
x.x.x.x - - [30/Aug/2021:10:58:18 +0200] "..... "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Rocket.Chat/2.17.7 Chrome/78.0.3904.130 Electron/7.1.10 Safari/537.36"
Rocket.Chat/2.17.7
This is an older 2.17.7 client.
Modern clients are not showing that any more.
x.x.x.x - - [30/Aug/2021:11:01:01 +0200] "....." "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.164 Electron/13.2.2 Safari/537.36"
This is from 3.4.0.
Would it be possible to add this to the connect string again.
Best regards
Christoph

Nice to have this, if it not broke integrations like Jitsi.


Container eats all the RAM

I already wrote everything about it here: SinusBot Forum

Already tracked in the forums, so we can close this issue here.


有exe程序更新的配置吗

Clear and concise description of the problem
有exe程序更新的配置吗
Suggested solution
有exe程序更新的配置吗
Alternative
No response
Additional context
No response
Validations

[X] Follow the Code of Conduct.
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that requests the same feature to avoid creating a duplicate.

通过过electron-builder打包，可以搭配electron-updater实现升级，具体查阅electron-builder文档


Adding non SOFA circular mic SRIRs

Hi,
Would it be possible within this framework to use SRIRs recorded from a regular 2D mic array (not in SOFA format)?
Kind regards,
Gilles

Hi! It will be possible. You just need to add your dataset to the prepare_rirs.py script and after that the API will be able to use it.

I'll close this issue since this is doable with the current implementation. Let us know if we can help you bringing your dataset into prepare_rirs.py


Change Portuguese to Brazilian Portuguese

The README describes that Recognizers-Text supports the Portuguese language, however as far as I know it supports Brazilian Portuguese which is different.

@iMicknl, actually it should cover all variants of Portuguese. So I'll close this  PR, ok?

@tellarin if that's the case, cool! Thank for confirming.


[R] Implement new function open_dataset_csv with signature more closely matching read_csv_arrow

In order to make the transition between using the different CSV reading functions as smoothly as possible we could introduce a version of open_dataset specifically for reading CSVs with a signature more closely matching that of read_csv_arrow - this would just pass the arguments through to open_dataset (in the ellipses), but would make it simpler to have a docs page showing these options explicitly and thus be clearer for users.
Reporter: Nicola Crane / @thisisnic
Note: This issue was originally created as ARROW-18358. Please see the migration documentation for further details.

Issue resolved by pull request 33614
https://github.com/apache/arrow/pull/33614


Add check for double sided materials in ModelExperimental

Some of the sample model from glTF-Sample-Models weren't rendering properly in ModelExperimental. These models used double-sided materials, which MaterialStageFS did not account for.
This now results in the correct rendering of the following models:

TwoSidedPlane
NormalTangentMirrorTest
NormalTangentTest
TextureSettingsTest

See the comment on the roadmap issue for screenshots of the old ModelExperimental result vs. the expected result in Model (which matches glTF-Sample-Viewer).

Thanks for the pull request @j9liu!

:heavy_check_mark: Signed CLA found.

Reviewers, don't forget to make sure that:

[ ] Cesium Viewer works.
[ ] Works in 2D/CV.

@ptrgags yes, the brightness bug is unrelated. I updated the change log to accommodate your suggestion


grpc: honour CPU constraints in Kubernetes

Once all vCPUs have been connected, cpuset cgroup MUST BE updated,
to achieve that, each cpuset cgroup parent of the container
MUST BE updated with the actual range of vCPUs.
fixes #239
Signed-off-by: Julio Montes<EMAIL_ADDRESS>

see failure in tests:
./grpc_test.go:171:2: undefined: sysfsDockerCpusetPath

@jodh-intel @egernst  please take a look

lgtm


Create "Get Entity Response Lite Endpoint"

For the Entity detail tab labels.

I think we just need to rewrite entitiesGet to accept entitiyIds: string[] and returning IResponseEntity[]

added entityIds string[] optional param


Minimal viable test harness for the stdlib

This is quite simple and needs to be tested with some less trivial examples (scripts, contracts, etc).
Filtering to run only a subset of tests works out of the box (with forc test | cargo test).
So, forc test runs all 6 tests, forc test foo runs 2 tests, and forc test floo only runs a single test as expected.
The basic approach:

an initial high-level tests/ directory (forc project)
inside tests/tests/:

a single harness.rs
multiple forc projects.

Each forc project has its tests directory removed and a mod.rs added, which contains the tests.
The main tests directory's harness.rs collects all the modules (for now they have to be added manually!)
So, the structure:

and harness.rs:
// Manually add tests to run here.
mod foo;
mod bar;
mod baz;

Example report:

This makes sense to me. Is Cargo.toml is needed within every test case? I think the top-level one is sufficient.
I think @digorithm should take a look as well -- does this make sense with the SDK's current design? It looks good to me.

@sezna

Is Cargo.toml is needed within every test case? I think the top-level one is sufficient.

Yeah, I forgot to remove these. Not needed... in the current tests in the sway repo I always delete this manifest when adding a new test.
The one thing here that I don't love is the need to add modules to harness.rs manually. That said, it's fair minimal overhead and I can live with it.

Hm, okay, well once the Cargo.toml thing is confirmed/denied, I think this is fine. Adding modules to the harness seems reasonable to me.
If we want to get fancy, we can auto-generate harness.rs with a build.rs script, which runs code before the build begins. Up do you if you want to do that now or not.

Cargo.toml:
Seems to be fine removing the individual toml files from the test cases. I'm getting the same results when running tests.
I think if a test case really needs a different version of a dependency then its local Cargo.toml can be preserved; otherwise, it can just be deleted when initializing the test project.
build.rs:
I will open an issue for that.


How to send a dimmer telegram ?

Hey there,
@Holger-Will
Currently I can only see that you can send a button value of 1 or 0 to either switch the actor off or on. How about a dimmer?
This worked fine one the old library where you were able to send a value like "50" to set the brightness to 50%.
Greetings

This was in the old library and worked perfectly: https://github.com/enocean-js/node-enocean-dimmer

yes that is still possible. you can use a5-38-08 for this.
 radio = RadioERP1.from({ payload: [0x00, 0x00, 0x00, 0x08] })
      radio.encode( {
        "COM": 2,
        "EDIM": brightness,
        "RMP": 1,
        "STR": 0,
        "SW": 1,
        "EDIM R": 0
    }, { eep: 'a5-38-08', data: 2 })

where brightness is a value between 0 and 100

if you are using nede-red use a function node wried to the output node:
var telda = {
    "data": {
        "COM": 2,
        "EDIM": msg.payload,
        "RMP": 1,
        "STR": 0,
        "SW": 1,
        "EDIM R": 0
    },
    "meta": {
        "eep": "a5-38-08",
        "channel": 6,
        "data": 2
    }
}

return {payload: telda};

now you can send the brightness value to the function node in a msg.payload

the helper objects i had in the old implementation are still missing, yes. but it was much harder to encode telegram then... now it is much simpler. writing a wrapper object for the dimmer should be quite simple...

That worked just fine. Maybe a dedicated node would be cool anyway. thank you!


Update News card RSS feed

Time Tracking: MA-113
Update News card feed to point to https://ucsdnews.ucsd.edu/rss/topstories
This is done when:

[x] The feed has been reviewed and determined to be of an appropriate format
[x] News feed updated in QA
[ ] News feed updated in PROD

Verified in QA and ready to deploy to PROD
Branch: master
Tag: v2.0.0
Lambda: https://us-west-2.console.aws.amazon.com/lambda/home?region=us-west-2#/functions/fetchAllStoriesFeed?tab=code (PROD)
Breaking Change: No
@a6wu Sending your way - ready to deploy.

@c3bryant Deployed to prod.


DO NOT MERGE! Fast Forward stable to f8d42b6124b44712615b89b5919c689536dadcb1.

This PR will be merged automatically once checks are successful.

Codecov Report

:exclamation: No coverage uploaded for pull request base (stable@7571cdf). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             stable     #204   +/-   ##
=========================================
  Coverage          ?   31.31%
=========================================
  Files             ?       19
  Lines             ?     1782
  Branches          ?        0
=========================================
  Hits              ?      558
  Misses            ?     1172
  Partials          ?       52

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7571cdf...12dfbd7. Read the comment docs.

Jenkins job manager/proxy-pr passed


TP support for GPTBigCode

GPTBigCode was missing tp support using distributed_strategy, this PR addresses adding that suppor. This also fixes a bug where we didn’t have a path to copy the weights when they are not specified in TPModule as something to be sharded

@JRosenkranz Thank you. This PR is super useful to us.
@nairbv When will it be merged since it was approved three weeks ago?

Thank you very much


Add more LIDL CCT only devices (fix #618)

Should fix https://github.com/zigpy/zha-device-handlers/issues/618
Perhaps @gijsje and @docgalaxyblock can test this by downloading the "lidl" folder from here: https://github.com/TheJulianJES/zha-device-handlers/tree/lidl_cct/zhaquirks/lidl and moving it to their zha-quirks. (Instructions here for HassOS/Supervised: https://github.com/zigpy/zha-device-handlers#testing-quirks-in-development-in-docker-based-install)

Pull Request Test Coverage Report for Build 451121873

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 81.347%

Totals

Change from base Build 449331853:
0.0%

Covered Lines:
3079

Relevant Lines:
3785

💛  - Coveralls

👍 60x60 Panel works now as expected


Picture turns all black when starting the Server (Quest)

Hi,
As soon as I start the server my screen on the oculus seems to freeze (I can still move but i only have the "Connect to the Server" picture in the front of me and otherwise only black instead of the other 3 "Connect to the Server" messages).
SteamVR is working fine (it tracks the movement without a problem or latency) besides that not a single button seems to work.
I already tried to configure the Steam Roomscale but it won't work because i can't press the trigger button.
Somebody got a idea?
I get no crash message at all.
I connected my Quest via 5ghz Wifi and i opened the requested ports within my firewall (I deactivated it - no change)

i have the same issue plz help PolyGraphene!!!!!!!!!!!!!

Might try the steps I posted here, I had issues initially and these steps fixed it for me: https://github.com/polygraphene/ALVR/issues/338#issuecomment-496766455

I already reinstalled the driver with the bat file.
I don't seem to get as far for even the buttons to work.
I have an AMD r390 gpu. Could this cause the problems? Even the button one?

Some here with gtx960.
When connected Quest, driver.log says "sendto error: 10035".
I tried to reinstall, but it could not be resolved.
(streaming with Riftcat/Vridge was successful)

I found the problem.
it seems that ALVR has problems displaying resolutions higher than 1080p on some AMD cards.
I have a 2K Monitor. If I set the resolution to 75% in the Server settings it works.


Title: Random Joke Generator

Is your feature request related to a problem? Please describe.
Making Random Joke Generator Using API
Describe the solution you'd like.
Use  API to generator joke!
Describe alternatives you've considered.
Made with use of HTML, CSS, JS.
Add any other context or screenshots about the feature request here.
No response

Hey I would like to work on this issue

It is already there on the website.


Upload Multiply files

Hellow All. I have a question.Can I upload multiple files IList? I search workaround but I didn't find anything

Try this
https://gist.github.com/theCuriousOne/39b79e40e3e7194b7bdb66cc910ee1b4
(just made it, haven't tested everything)

waiting for too

Going to close this in favor of duplicate report #1029


How to build from sources on Windows

❓ Question
How shall I edit the WORKSPACE file in order to build tag 0.1.0 from sources on Windows?
What you have already tried

I successfully did the build from sources process for Jetson Xavier AGX, see:
https://github.com/NVIDIA/TRTorch/issues/222

Based on the material that I was already had from the Jetson process I tried to do the same for my Windows by editing the WORKSPACE based on my Windows setup.
I changed all required new_local_repository arguments of the cuda, torch, cudnn and tensorrt based on my Windows installations

Activate the following command:
bazel build //:libtrtorch

The following errors report was generated:
INFO: Repository rules_python instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule git_repository defined at:
C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git.bzl:195:18: in
ERROR: An error occurred during the fetch of repository 'rules_python':
Traceback (most recent call last):
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git.bzl", line 177
_clone_or_update(ctx)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git.bzl", line 36, in _clone_or_update
git_repo(ctx, directory)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 91, in git_repo
_update(ctx, git_repo)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 103, in _update
fetch(ctx, git_repo)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 129, in fetch
_git_maybe_shallow(ctx, <5 more arguments>)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 171, in _git_maybe_shallow
_error(ctx.name, <2 more arguments>)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 181, in _error
fail(<1 more arguments>)
error running 'git fetch origin refs/heads/:refs/remotes/origin/ refs/tags/:refs/tags/' while working with @rules_python:
BUG: run-command.c:519: disabling cancellation: Invalid argument
ERROR: no such package '@rules_python//python': Traceback (most recent call last):
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git.bzl", line 177
_clone_or_update(ctx)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git.bzl", line 36, in _clone_or_update
git_repo(ctx, directory)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 91, in git_repo
_update(ctx, git_repo)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 103, in _update
fetch(ctx, git_repo)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 129, in fetch
_git_maybe_shallow(ctx, <5 more arguments>)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 171, in _git_maybe_shallow
_error(ctx.name, <2 more arguments>)
File "C:/users/General/_bazel_General/zs4npqzu/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 181, in _error
fail(<1 more arguments>)
error running 'git fetch origin refs/heads/:refs/remotes/origin/ refs/tags/:refs/tags/' while working with @rules_python:
BUG: run-command.c:519: disabling cancellation: Invalid argument
INFO: Elapsed time: 1.097s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 packages loaded)
Environment

Build information about the TRTorch compiler can be found by turning on debug messages

PyTorch Version (e.g., 1.0): 1.6
CPU Architecture: Intel(R) Core(TM) i7-6700HQ CPU @ 2.60GHz, 2592 Mhz, 4 Core(s), 8 Logical Processor(s)
OS (e.g., Linux): Windows
How you installed PyTorch (conda, pip, libtorch, source): pip3
Build command you used (if compiling from source):
Are you using local sources or building from archives:
Python version: 3.6.8
CUDA version: 11.0
GPU models and configuration: Quadro M2000M
Any other relevant information: TensorRT 7.2.1, CuDNN 8.0.1

Additional context
I have a good experience with TensorRT development on my Windows setup so I know that from NVIDIA libraries setup point of view everything should be OK

Windows support is unofficial and pretty flaky right now. I think this particular error is because git repositories in bazel dont work great on windows. The quick work around would be to remove rules python and the repositories that use it (the python tests) from workspace

Thank you very much @narendasan ,
I edited the WORKSPACE file as you recommended and the Python problems described above were disappeared.
I also edited the following:

\third_party\cudnn\local\BUILD:
Was:
":windows": "bin/cudnn64_7.dll", #Need to configure specific version for windows
Is:
":windows": "bin/cudnn64_8.dll", #Need to configure specific version for windows

\third_party\tensorrt\local\BUILD:
As described in PR https://github.com/NVIDIA/TRTorch/pull/190

TRTorch-0.1.0.bazelrc:
Was:
build --cxxopt="-fdiagnostics-color=always"
build --cxxopt='-std=c++14'
Is:
build --cxxopt='/diagnostics:caret'
build --cxxopt='/std:c++14'

TRTorch-0.1.0\WORKSPACE:

Mask all Python rules

Mask all http_archive

UnMask all new_local_repository

Map cudnn and tensorrt to my local installations directories
new_local_repository(
name = "cudnn",
path = "C:/Program Files/NVIDIA GPU Computing Toolkit/CUDA/v11.0",
build_file = "@//third_party/cudnn/local:BUILD"
)

new_local_repository(
name = "tensorrt",
path = "c:/TensorRT-<IP_ADDRESS>",
build_file = "@//third_party/tensorrt/local:BUILD"
)
Now compilation is working well but new Linking error is raised (Bold below):
INFO: Analyzed target //:libtrtorch (36 packages loaded, 2125 targets configured).
INFO: Found 1 target...
INFO: From Compiling core/util/trt_util.cpp:
C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\VC\Tools\MSVC\14.24.28314\include\numeric(35,26): warning C4244: '=': conversion from '_Ty' to '_Ty', possible loss of data
with
[
_Ty=int64_t
]
and
[
_Ty=int
]
_Val = _Reduce_op(_Val, _UFirst);
^
core/util/trt_util.cpp(63): note: see reference to function template instantiation '_Ty std::accumulate<const int32_t,int,std::multiplies<int64_t>>(const _InIt,const _InIt,_Ty,_Fn)' being compiled
with
[
_Ty=int,
_InIt=const int32_t *,
_Fn=std::multiplies<int64_t>
]
return std::accumulate(d.d, d.d + d.nbDims, 1, std::multiplies<int64_t>());
INFO: From Compiling core/conversion/evaluators/aten.cpp:
core/conversion/evaluators/aten.cpp(38,1): warning C4805: '==': unsafe mix of type 'int64_t' and type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(38,1): warning C4805: '==': unsafe mix of type 'double' and type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(38,1): warning C4805: '==': unsafe mix of type 'bool' and type 'int64_t' in operation
);
^
core/conversion/evaluators/aten.cpp(38,1): warning C4805: '==': unsafe mix of type 'bool' and type 'double' in operation
);
^
core/conversion/evaluators/aten.cpp(51,1): warning C4805: '!=': unsafe mix of type 'int64_t' and type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(51,1): warning C4805: '!=': unsafe mix of type 'double' and type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(51,1): warning C4805: '!=': unsafe mix of type 'bool' and type 'int64_t' in operation
);
^
core/conversion/evaluators/aten.cpp(51,1): warning C4805: '!=': unsafe mix of type 'bool' and type 'double' in operation
);
^
core/conversion/evaluators/aten.cpp(64,1): warning C4804: '<': unsafe use of type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(77,1): warning C4804: '>': unsafe use of type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(90,1): warning C4804: '<=': unsafe use of type 'bool' in operation
);
^
core/conversion/evaluators/aten.cpp(103,1): warning C4804: '>=': unsafe use of type 'bool' in operation
);
^
INFO: From Compiling core/conversion/converters/impl/shuffle.cpp:
C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\VC\Tools\MSVC\14.24.28314\include\xutility(3330,22): warning C4244: '=': conversion from '__int64' to '_Ty', possible loss of data
with
[
_Ty=int32_t
]
_Dest = _First;
^
C:\Program Files (x86)\Microsoft Visual Studio\2019\Professional\VC\Tools\MSVC\14.24.28314\include\xutility(3367): note: see reference to function template instantiation '_OutIt std::_Copy_unchecked<__int64,_Ty>(_InIt,_InIt,_OutIt)' being compiled
with
[
_OutIt=int32_t ,
_Ty=int32_t,
_InIt=__int64 *
]
_Seek_wrapped(_Dest, _Copy_unchecked(_UFirst, _ULast, _UDest));
core/conversion/converters/impl/shuffle.cpp(86): note: see reference to function template instantiation '_OutIt std::copy<std::_Vector_iterator<std::_Vector_val<std::_Simple_types<_Ty>>>,int32_t>(_InIt,_InIt,_OutIt)' being compiled
with
[
_OutIt=int32_t *,
_Ty=int64_t,
_InIt=std::_Vector_iterator<std::_Vector_val<std::_Simple_types<int64_t>>>
]
std::copy(new_order.begin(), new_order.end(), permute.order);
C:\users\User_bazel_User\zs4npqzu\execroot\TRTorch\bazel-out\x64_windows-fastbuild\bin\external\libtorch_virtual_includes\c10_cuda\c10/core/MemoryFormat.h(56): note: see reference to class template instantiation 'c10::ArrayRef<int64_t>' being compiled
inline std::vector<int64_t> get_channels_last_strides_2d(IntArrayRef sizes) {
INFO: From Compiling core/conversion/converters/impl/plugins/interpolate_plugin.cpp:
cl : Command line warning D9002 : ignoring unknown option '-pthread'
ERROR: C:/users/User/downloads/trtorch-0.1.0/cpp/api/lib/BUILD:13:1: Linking of rule '//cpp/api/lib:trtorch.dll' failed (Exit 1120)
LINK : warning LNK4044: unrecognized option '/lpthread'; ignored
LINK : warning LNK4044: unrecognized option '/Wl,-rpath,lib/'; ignored
Creating library bazel-out/x64_windows-fastbuild/bin/cpp/api/lib/trtorch.dll.if.lib and object bazel-out/x64_windows-fastbuild/bin/cpp/api/lib/trtorch.dll.if.exp
plugins.lo.lib(interpolate_plugin.obj) : error LNK2019: unresolved external symbol getPluginRegistry referenced in function "public: __cdecl nvinfer1::PluginRegistrar::PluginRegistrar(void)" (??0?$PluginRegistrar@VInterpolatePluginCreator@plugins@impl@converters@conversion@core@trtorch@@@nvinfer1@@QEAA@XZ)
runtime.lo.lib(TRTEngine.obj) : error LNK2019: unresolved external symbol createInferRuntime_INTERNAL referenced in function "class nvinfer1::IRuntime * __cdecl nvinfer1::anonymous namespace'::createInferRuntime(class nvinfer1::ILogger &)" (?createInferRuntime@?A0x4cf47092@nvinfer1@@YAPEAVIRuntime@2@AEAVILogger@2@@Z) conversionctx.lib(ConversionCtx.obj) : error LNK2019: unresolved external symbol createInferBuilder_INTERNAL referenced in function "class nvinfer1::IBuilder * __cdecl nvinfer1::anonymous namespace'::createInferBuilder(class nvinfer1::ILogger &)" (?createInferBuilder@?A0xa232b0d4@nvinfer1@@YAPEAVIBuilder@2@AEAVILogger@2@@Z)
bazel-out\x64_windows-fastbuild\bin\cpp\api\lib\trtorch.dll : fatal error LNK1120: 3 unresolved externals
Target //:libtrtorch failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 77.200s, Critical Path: 21.14s
INFO: 86 processes: 86 local.
FAILED: Build did NOT complete successfully
Please advise.

It seems like it is missing TensorRT symbols in the linking. Do you know if you are using the TRT DLLs or trying to statically link?

Hello @narendasan,
How can I know if the build process looking for the TensoRT DLLs or Libs?
What I did is to change the file \third_party\tensorrt\local\BUILD according to the PR https://github.com/NVIDIA/TRTorch/pull/190 as following:
Was:
cc_import(
name = "nvinfer_lib",
shared_library = select({
":aarch64_linux": "lib/aarch64-linux-gnu/libnvinfer.so",
":windows": "lib/nvinfer.dll",
"//conditions:default": "lib/x86_64-linux-gnu/libnvinfer.so",
}),
static_library = select({
":aarch64_linux": "lib/aarch64-linux-gnu/libnvinfer_static.a",
":windows": "lib/nvinfer.lib",
"//conditions:default": "lib/x86_64-linux-gnu/libnvinfer_static.a"
}),
visibility = ["//visibility:private"],
)
Is:
cc_import(
name = "nvinfer_static_lib",
static_library = select({
":aarch64_linux": "lib/aarch64-linux-gnu/libnvinfer_static.a",
":windows": "lib/nvinfer.lib",
"//conditions:default": "lib/x86_64-linux-gnu/libnvinfer_static.a",
}),
visibility = ["//visibility:private"],
)
cc_import(
name = "nvinfer_lib",
shared_library = select({
":aarch64_linux": "lib/aarch64-linux-gnu/libnvinfer.so",
":windows": "lib/nvinfer.dll",
"//conditions:default": "lib/x86_64-linux-gnu/libnvinfer.so",
}),
visibility = ["//visibility:private"],
)
And also changed the WORKSPACE file as following:
Was:
new_local_repository(
name = "tensorrt",
path = "/usr/",
build_file = "@//third_party/tensorrt/local:BUILD"
)
Is:
new_local_repository(
name = "tensorrt",
path = "c:/TensorRT-<IP_ADDRESS>",
build_file = "@//third_party/tensorrt/local:BUILD"
)
Which c:/TensorRT-<IP_ADDRESS> is the path that include all TensorRT libraries as they are downloaded from NVIDIA site as is without any change by me which means that it include the lib and include directories.
TensorRT bin directory contains the DLLs and libs files.
Did I do something wrong?
Shall I edit these files differently?
Shall I edit also any other BUILD file?
Thanks,

This should be fine to make bazel use the DLLs. Im not sure what is going on, its complaining about missing symbols in TensorRT's libraries

Hi,
Can you check please and approve that my changes are correct?
Maybe I edited wrongly or maybe missed something?
Maybe it was a wrong decision to take the latest <IP_ADDRESS> version?
I think I'm very close to successfully create a TRTorch version for Windows, it isn't make sense that if it works well for Linux x64 it cannot work also well for Windows x64.....
Please advise,
Thanks,

Hello,
Can I provide you the entire package that I prepared?
Maybe you will be able to use it and successfully complete the build process on your machine and then understand what is missing in my machine?
Thanks,

Something to try is to see if using master helps, we recently separated out static and dynamic deps. It should ensure that you are using DLLs on windows. Might make it more clear what is happening

Something to try is to see if using master helps, we recently separated out static and dynamic deps. It should ensure that you are using DLLs on windows. Might make it more clear what is happening

Hello @narendasan,
Thanks for your response.
I downloaded the master version yesterday.
Based on the knowledge I achieved while working with my Jetson Xavier AGX and getting started guide instructions https://nvidia.github.io/TRTorch/tutorials/installation.html, I edited all required files such as WORKSPACE.
(Based on my understanding....)
My setup now is:
Windows x64,
TRTorch - master,
CUDA 11.0,
CuDNN 8.0,
TensorRT <IP_ADDRESS>
PyTorch 1.7.1
Torchvision 0.8.2
(Both of them successfully installed via:
pip3 install torch===1.7.1+cu110 torchvision===0.8.2+cu110 torchaudio===0.7.2 -f https://download.pytorch.org/whl/torch_stable.html)
Activate this command:
bazel build //:libtrtorch -c opt
Now I'm getting a compilation error (didn't get to linker phase as described in previous comments above)
_INFO: Analyzed target //:libtrtorch (36 packages loaded, 2133 targets configured).
INFO: Found 1 target...
INFO: Deleting stale sandbox base C:/users/XXX/bazel_XXX/vctgn25s/sandbox
ERROR: C:/aag/hpc/services/dleware/source/applications/trtorchtester/data/build/windows/trtorch-master/core/lowering/BUILD:10:1: C++ compilation of rule '//core/lowering:lowering' failed (Exit 2)
core/lowering/lowering.cpp(11,10): fatal error C1083: Cannot open include file: 'torch/csrc/jit/passes/remove_mutation.h': No such file or directory
#include "torch/csrc/jit/passes/remove_mutation.h"
^
Target //:libtrtorch failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 21.234s, Critical Path: 14.59s
INFO: 8 processes: 8 local.
FAILED: Build did NOT complete successfully
I checked and found the reported missing file in my torch installation directory so I know that the problem root cause is maybe a wrong configuration where my torch is installed.
In order to notify TRTorch where my torch is installed I made the following changes inside WORKSPACE file:
Was:
new_local_repository(
name = "libtorch",
path = "/usr/local/lib/python3.6/dist-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
new_local_repository
(    name = "libtorch_pre_cxx11_abi",
path = "/usr/local/lib/python3.6/dist-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
Is:
new_local_repository(
name = "libtorch",
path = "C:/Users/XXX/Tensorflow23/Lib/site-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
new_local_repository(
name = "libtorch_pre_cxx11_abi",
path = "C:/Users/XXX/Tensorflow23/Lib/site-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
Is it OK?
Shall I change something else?
Shall I change another file also?
Thanks,

Hello @narendasan,
Thanks for your response.
I downloaded the master version yesterday.
Based on the knowledge I achieved while working with my Jetson Xavier AGX and getting started guide instructions https://nvidia.github.io/TRTorch/tutorials/installation.html, I edited all required files such as WORKSPACE.
(Based on my understanding....)
My setup now is:
Windows x64,
TRTorch - master,
CUDA 11.0,
CuDNN 8.0,
TensorRT <IP_ADDRESS>
PyTorch 1.7.1
Torchvision 0.8.2
(Both of them successfully installed via:
pip3 install torch===1.7.1+cu110 torchvision===0.8.2+cu110 torchaudio===0.7.2 -f https://download.pytorch.org/whl/torch_stable.html)
Activate this command:
bazel build //:libtrtorch -c opt
Now I'm getting a compilation error (didn't get to linker phase as described in previous comments above)
_INFO: Analyzed target //:libtrtorch (36 packages loaded, 2133 targets configured).
INFO: Found 1 target...
INFO: Deleting stale sandbox base C:/users/XXX/bazel_XXX/vctgn25s/sandbox
ERROR: C:/aag/hpc/services/dleware/source/applications/trtorchtester/data/build/windows/trtorch-master/core/lowering/BUILD:10:1: C++ compilation of rule '//core/lowering:lowering' failed (Exit 2)
core/lowering/lowering.cpp(11,10): fatal error C1083: Cannot open include file: 'torch/csrc/jit/passes/remove_mutation.h': No such file or directory
#include "torch/csrc/jit/passes/remove_mutation.h"
^
Target //:libtrtorch failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 21.234s, Critical Path: 14.59s
INFO: 8 processes: 8 local.
FAILED: Build did NOT complete successfully
I checked and found the reported missing file in my torch installation directory so I know that the problem root cause is maybe a wrong configuration where my torch is installed.
In order to notify TRTorch where my torch is installed I made the following changes inside WORKSPACE file:
Was:
new_local_repository(
name = "libtorch",
path = "/usr/local/lib/python3.6/dist-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
new_local_repository
(    name = "libtorch_pre_cxx11_abi",
path = "/usr/local/lib/python3.6/dist-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
Is:
new_local_repository(
name = "libtorch",
path = "C:/Users/XXX/Tensorflow23/Lib/site-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
new_local_repository(
name = "libtorch_pre_cxx11_abi",
path = "C:/Users/XXX/Tensorflow23/Lib/site-packages/torch",
build_file = "third_party/libtorch/BUILD"
)
Is it OK?
Shall I change something else?
Shall I change another file also?
Thanks,

Did you find a solution to this problem?

Unfortunately no,
Actually for now I left this issue with hope that when I will need it again it will already solved.
I prefer to find out that there will be a pre built binaries for Windows platform as it provided for x64 Linux.
Or to find that anyone solved the build from sources path for Windows and learn from its process.
Good luck

Wondering if you've resolved this yet? I am having the same issue, trying to use Torch-TensorRT on Windows and having trouble building it myself.

I am going to close this issue because we have a community maintained cmake build system to build the libraries. Open a new issue if it is still a problem.


How can I build a iOS Examples project?

There is a Mac platform Examples projects guides in the official documents, but I want to build a examples projection in iOS. Could you tell me how to build it? Thank you very much! @bkaradzic

workaround for xcode build issue:
#1440 (comment)

Thank you very much!

@attilaz now I can compile anyone example target in Xcode projects, but I meet another problem that the simulator can't run so that I can't see the example effect. Need Help! Thanks!

@attilaz now I can compile success with anyone example target in Xcode projects, but I meet another problem that the simulator can't run so that I can't see the example effect. Need Help! Thanks!

I find solution: https://stackoverflow.com/questions/7800229/xcode-can-build-a-project-but-cant-run-it-on-simulator，check scheme > edit scheme > and choose the executable item.


Error POSTing Samples and Datasets

POST to entity-api/entities/sample
{ "sample_category":"block",  "lab_tissue_sample_id": "Bill-Test-777", "protocol_url": "https://dx.doi.org/10.17504/protocols.io.bf4cjqsw", "description": "testing sample", "group_uuid":"57192604-18e0-11ed-b79b-972795fc9504"}

or POST to entity-api/entities/dataset
{"data_types":["CODEX"], "group_uuid":"57192604-18e0-11ed-b79b-972795fc9504", "contains_human_genetic_sequences": false}

both result in:
[2022-08-28 20:58:41,848] ERROR in app: Exception on /entities/sample [POST]
Traceback (most recent call last):
  File "/Users/bill/Library/Python/3.8/lib/python/site-packages/flask/app.py", line 2073, in wsgi_app
    response = self.full_dispatch_request()
  File "/Users/bill/Library/Python/3.8/lib/python/site-packages/flask/app.py", line 1519, in full_dispatch_request
    rv = self.handle_user_exception(e)
  File "/Users/bill/Library/Python/3.8/lib/python/site-packages/flask/app.py", line 1517, in full_dispatch_request
    rv = self.dispatch_request()
  File "/Users/bill/Library/Python/3.8/lib/python/site-packages/flask/app.py", line 1503, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args)
  File "/Users/bill/projects/sennet/entity-api/src/app.py", line 885, in create_entity
    was_generated_by = json_data_dict['was_generated_by']
KeyError: 'was_generated_by'

Updated Sample creation JSON:
{     "was_generated_by": [         "0579c1d32ca1ecc698f9b7676af3b484"     ],     "sample_category": "block",     "lab_tissue_sample_id": "Bill-Test-777",     "protocol_url": "https://dx.doi.org/10.17504/protocols.io.bf4cjqsw",     "description": "testing sample" }

Updated Dataset creation JSON:
{     "data_types": [         "CODEX"     ],     "contains_human_genetic_sequences": false,     "was_generated_by": ["104141326f068a2881a1ccc25ec96be5"] }


Upgrade Vale to v2.17.0

This upgrades Vale to the latest version (the one that's likely to be available through your package manager) and fixes a bug that's blocking https://github.com/buildkite/docs/pull/1521.

Ugh, v2.16.1 introduces… something that breaks the escaping for erb? Investigating.
https://github.com/errata-ai/vale/compare/v2.16.0...v2.16.1

I wonder if one can go about configuring dependabot for this kind of extremely manual dependency? 🤔

The options here aren't great, as far as I can tell. The only thing that looks likely: if the Buildkite docker plugin can refer to a Dockerfile instead of pulling a named image, then you could use FROM jdkato/vale:v2.17.0 in something like vale.Dockerfile. Dependabot could then upgrade Vale via the via Dockerfile.
Otherwise, I think we're out of luck, since there's no package ecosystem that Vale directly reports into (that's golang for you).

@ddbeck looks like https://github.com/buildkite-plugins/docker-compose-buildkite-plugin would do the trick.


CVDate equatable?

[x] I have verified there are no duplicate active or recent bugs, questions, or requests
[ ] I have verified that I am using the latest version of CVCalendar.
[x] I have given my issue a non-generic title.

Expected Behavior
Two CVDate objects should be equal to each other if the year, month and day are all the same.
Current Behavior
Two CVDate objects seem to be equal to each other as they share the same memory access.
Possible Solution
Since CVDate subclasses the NSObject, overriding func isEqual should solve this problem.
override func isEqual(object: AnyObject?) -> Bool {
    if let date = object as? CVDate {
        return self.year == date.year &&  self.month == date.month &&  self.day == date.day
    }
    return false
}

I'm not sure if it is possible to implement Equatable protocol as subclassing NSObject. If possible, this should solve the problem.
func == (lhs: CVDate, rhs: CVDate) -> Bool{
    return lhs.year == rhs.year &&  lhs.month == rhs.month &&  lhs.day == rhs.day
}

If you want to keep the NSObject equatability, a new comparing function should work as well
func equalsTo(date: CVDate) -> Bool{
    return self.year == date.year &&  self.month == date.month &&  self.day == date.day
}

Steps to Reproduce (for bugs)
let date_1 = CVDate(date: NSDate())
let convertedDate_1 = date_1.convertedDate()!
let date_2 = CVDate(date: convertedDate_1)

print(date_1 == date_2) // This returns false as I except to be true

Context
I was using an array var markerDates: [CVDate] of CVDate to save the data of dotMarkers and passing the array through different viewControllers. I implemented the function as below
func dotMarker(shouldShowOnDayView dayView: DayView) -> Bool {
    return markerDates.contains(dayView.date)
}

It didn't work until I fixed it by custom predicate
func dotMarker(shouldShowOnDayView dayView: DayView) -> Bool {
    return markerDates.contains({
        return $0.year == dayView.date.year &&  $0.month == dayView.date.month &&  $0.day == dayView.date.day
    })
}

Your Environment

Version used : 1.3.1
Device used : iPhone 6
Physical device : y

@popodidi Thanks for reporting, I'll look into that.

@popodidi so far this issue is still happening. I was implementing a similar functionality and had the same problem. If you use Date instead of CVDate then it should work. Something like this:
func dotMarker(shouldShowOnDayView dayView: DayView) -> Bool {
    return markerDates.contains(dayView.date.convertedDate()!)
}


ErrorException in MappingFactory.php line 91:

Argument 1 passed to NilPortugues\Api\Mapping\MappingFactory::fromArray() must be of the type array, string given, called in E:\xampp\htdocs\local-domain\market-service\vendor\nilportugues\laravel5-json-api\src\NilPortugues\Laravel5\JsonApi\Mapper\Mapper.php on line 24 and defined.
Also tried to edit the file from the source. It seemed that the files is not loaded.

Did you manage to make it work @patayko ?


Option so "match whole word" becomes effectively "match whole name" (exact match)

I've been bitten way too much by this when batch replacing...
Most (or all) of the time I use match whole word to find exact match, but unfortunately it matches more, e.g. Searching for background would match background-color.
I think the option could be use "match whole name" instead of match whole word" ?

I think you should use a regular expression for this use-case. Perhaps something like background(?=[:\s])

I know about regex, but since this is the behavior I want all the time, and that this is a more expected behavior (in my mind anyway), I'd prefer not having to think about entering a regex every time. There's noting that stops me in my flow like having to think about regex! :|


Copy (with attribution!) the DEA Sandbox notebook on STAC use

We should bring over the fantastic DEA Sandbox STAC Usage notebook that Robbi created
Aim:
Enhance understanding of the DE Africa STAC API
Study area:
Notebook example exists: https://docs.dea.ga.gov.au/notebooks/Frequently_used_code/Downloading_data_with_STAC.html
Scope:

Copy the notebook
Adapt it to our environment
Enable people to understand how to use the STAC API!

Input data:

n/a

Expected outcomes and outputs:

Enhanced understanding of the capabilities of the STAC API

Additional information:

This notebook is now in Frequently_used_code folder

Thank you. The S3 to HTML and Qgis stream will help a lot of users.

Sorry to be picky, but do you think we can add at the top a short text that explains the difference for the user, and is potentially limited hardware/connection, between downloading and streaming?
The paragraph could land in the "context" paragraph:
"Due to the increasing size of satellite datasets, downloading data directly to your own local disk can be time-consuming and slow. Sometimes, it is better to stream data directly from the cloud without downloading it first. This can be particularly powerful for data that is stored in the Cloud Optimised GeoTIFF (COG) format which is optimised for efficiently streaming small chunks of an image at a time."
The reason I am asking is that for the announcement in the Helpdesk I would like to take as a process to copy and paste the first two paragraphs of the notebook.
Cheers,
Cedric


"Next" button when creating a project does nothing

Howdy, Interesting project!
I went to try it out but it seems the "next" button when creating a project doesn't do anything?

The logs don't show any request or errors:

Ragbuilder is deployed with your official container image (ashwinzyx/ragbuilder:latest - sha256:42bbaafed11135574edd1f340f5079aa9d10b87d05e48d93576cab4a6c5d8f5a), I did notice when pulling the image it was built for ARM rather than AMD64:
 ! ragbuilder The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v4) and no specific platform was requested         0.0s

@sammcj , We have updated the docker image to support AMD64. Could you try pulling the docker image again and run

Thanks the architecture warning is now gone 👍
The next button still does nothing though - in the browser network logs I see:
22:16:21.580 Loading failed for the <script> with source “https://cdnjs.cloudflare.com/ajax/libs/mdb-ui-kit/7.3.2/mdb.min.js”. ragbuilder.my.internal.domain:899:82
22:16:21.580 Blocked loading mixed active content "http://ragbuilder.my.internal.domain/static/main.js"
ragbuilder.my.internal.domain
22:16:21.583
GET
http://ragbuilder.my.internal.domain/static/main.js
Mixed Block

22:16:21.583 Loading failed for the <script> with source “http://ragbuilder.my.internal.domain/static/main.js”. ragbuilder.my.internal.domain:900:56
22:16:21.599
GET
https://ragbuilder.my.internal.domain/favicon.ico
[HTTP/2 404  5ms]

Is there an undocumented environment variable to set the allowed origins / tell the app that it's behind HTTPS? (traefik in my case)

Hey @sammcj , Thanks for your patience! I think I know why this is happening, and have a fix. Currently testing it out, shall get back to you in a day or so.

Hey @sammcj, this PR should fix your issue hopefully. @ashwinzyx will confirm once the docker build is done, and then you can test it and confirm back.

@sammcj , Could you pull the latest image and give it a try

Oh that’s good news! I’ll try to give it a go again tomorrow - sorry this week has been nothing short of insane at work 😅

Tried the latest version, the next button still doesn't do anything at all:

I don't see any requests occuring when it's clicked either, although I did notice it's trying to load some JS via a CDN despite being deployed locally:


Jobs keep re-processing without ever starting

I don't know if I've done something wrong but it worked before I changed from sql to mongo.
What exactly happens is that job gets queued and starts processing and starts processing and starts processing and so on. So in the history there can be tens of processing states but it seems to never finish or fail. I put a bunch of WriteLines to find how are the processes executed and where they end and it never showed a single WriteLine. So I guess the jobs never even start. I am running on ASP.NET Core 1.1.
Also when deleting that job, it stays in the queue.
edit:// Did a quick switch to sql and everything works as expected. Jobs didn't stay in queue and got processed properly.

I'm experiencing a similar issue. The jobs stays in Enqueued state and never get executed. When I switch to SqlServer, it works correctly.

Hi @adsamcik and @maouida,
Thank you for your feedback, I have created a small .netcore app and cannot reproduce what your are seeing.
Could I get you to try it out?
(Even though Github says it allows .zip, I was unsuccessful in uploading this, so I put it on my onedrive)
https://1drv.ms/u/s!AqZWS5rQI9zmsGe6A5S9fmNrjKeB
Also could you add some more debug info?
Thanks
Jonas

@gottscj I don't have mongodb locally so I couldn't test yours. but I have created new asp.net core 1.1 project from scratch and included at the end of configure
JobStorage.Current = new MongoStorage("mongodb://localhost", "mymongotest");             using (var server = new BackgroundJobServer()) {                 for (var i = 0; i < 10; i++) {                     BackgroundJob.Enqueue(() => Console.WriteLine($"Fire-and-forget ({i})"));                 }                 Console.ReadKey(true);             }
It waited for a minute or two but nothing was happening. Update: I tested yours code too in the end and it didn't work either. Both projects were tested on Ubuntu 16.04 so that might be the problem.
Collection: hangfire.jobQueue

{ "_id" : 1, "JobId" : 1, "Queue" : "default", "FetchedAt" : null }

Collection: hangfire.set

{
"_id" : ObjectId("58457110ae20fd66382cdc09"),
"JobId" : 1,
"Name" : "Processing",
"Reason" : null,
"CreatedAt" : ISODate("2016-12-05T13:52:16.233Z"),
"Data" : "{"StartedAt":"2016-12-05T13:52:16.2262210Z","ServerId":"65c6187b-4da8-4699-a668-53f35443f4ee","WorkerId":"0696750e-5253-4e46-a7d0-10a9f1711e69"}"
}
{
"_id" : ObjectId("58457111ae20fd66382cdc0a"),
"JobId" : 1,
"Name" : "Processing",
"Reason" : null,
"CreatedAt" : ISODate("2016-12-05T13:52:17.234Z"),
"Data" : "{"StartedAt":"2016-12-05T13:52:17.2284720Z","ServerId":"65c6187b-4da8-4699-a668-53f35443f4ee","WorkerId":"fc4c2850-9518-444b-aa96-2a01aa8ae289"}"
}
{
"_id" : ObjectId("58457114ae20fd66382cdc0b"),
"JobId" : 1,
"Name" : "Processing",
"Reason" : null,
"CreatedAt" : ISODate("2016-12-05T13:52:20.200Z"),
"Data" : "{"StartedAt":"2016-12-05T13:52:20.1949060Z","ServerId":"65c6187b-4da8-4699-a668-53f35443f4ee","WorkerId":"007bec67-1b6f-4869-be17-4092a4b33584"}"
}

Collection: hangfire.job

{
"_id" : 1,
"StateId" : ObjectId("58457114ae20fd66382cdc0b"),
"StateName" : "Processing",
"InvocationData" : "{"Type":"System.Console, System.Console, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a","Method":"WriteLine","ParameterTypes":"[\"System.String, System.Private.CoreLib, Version=<IP_ADDRESS>, Culture=neutral, PublicKeyToken=7cec85d7bea7798e\"]","Arguments":"[\"\\\"Fire-and-forget (0)\\\"\"]"}",
"Arguments" : "["\"Fire-and-forget (0)\""]",
"CreatedAt" : ISODate("2016-12-05T13:50:50.087Z"),
"ExpireAt" : null
}

@adsamcik, runnig on Ubuntu might explain the problem :)
I do not have much Ubuntu experience, but I am in the process of spinning a virtual Ubuntu up and try it out - to see if I can reproduce what you are seeing.
In the meantime, it would be great with any info you can provide us. Stack traces, debug info etc.
I will get back to you, once I have my Ubuntu running successfully.

@MarLoe the program you posted doesn't generate any console output and I don't really have time at this time of semester to dig deeper :) Running it on ubuntu is simple, just follow the dotnet tutorial, paste the source file in there and run it like on windows if you use console. You should be ready in couple of minutes.

@adsamcik, I finally have an Ubuntu up and running with .NET Core. And I also see the problem you are experiencing. I have also identified the problem. But it a matter of platform unsupported APIs :(
I am looking into alternatives, but there is no quick fix to the problem. I will get back once I have some news.

@MarLoe At least the issue was identified :)

@adsamcik, I have made a branch "netcore_unix_support". If you have the time, please download this and try it out. I have included a .NETCore sample project (the one previously attached to this thread), that would allow you to test it easily.
I have only tested this branch on Ubuntu, so I will need to test it on Windows before making a pull request to master.
Enjoy,
Martin

@adsamcik & @maouida, made a pull request #53 that should fix your problem. A new NuGet release of hangfire.Mongo will be released once #53 is merged into master.

Had a busy week. Tested it right now and it seems to work fine. Found few bugs (or differences from how sql works) but nothing too function breaking. Thanks for the quick patch :)

@adsamcik, you're welcome!
Please let us know of your findings between this and the sql implementation. You could create a new issue named e.g. Hangfire.Mongo vs Hangfire.Sql and start listing your findings there.


Lack of marketing and a face people recognize as Dash representative

Hi,
As a fan of Dash i think there is a lack of marketing when it comes to social media.
Beside Bitcoin, other major projects lite ETH(Vitalik), Litecoin(Charlie), Cardano(Charles), BCH(Roger Ver), EOS(Dan) ....all have a public figure who is the face outside and people look up to.
I have myself been around 2017 (2013 really but not to serious) + i'm in many groups and follow twitter, YouTube etc
When it comes to Dash i dont really see as much community engagement and someone who really represent Dash in the public.
Like a great example is Charles and now his team of project managers who make videos on the progress of things.
Also the community engagement is just huge. I want that for Dash.
To start with we need a face outwards. Someone who can daily/weekly make tweets, videos, engage with influencers to make Dash relevant in the public eye.
Right now Crypto is not as much fundamentals as it is about hype and excitement about new features / DeFi / NFT etc. Once we are on top 10 then maybe that can carry us but at this point with hundreds of coins/projects specially in DeFi no one really cares about great OG projects. Sad but that is the truth. Same with price. If we were to jump to 1k maybe we would be in the news but its moment 22, we need more people to be interested and buy before price can rise.
I know there are allot of things in the pipe like the platform which can be used for so much. But does anyone know about it?
Seriously doubt it. Why dont we get on YouTube with other influencers and talk about it? Tweet about all things to come continuously. Partnering with other projects to bring them onboard with their tokens and NFT. I know we are in testnet but that dont stop Cardano to do partnership (like what they done with Singularity). Bringing new to the public is a great way to show the project is alive and growing. To me it feels like we do stuff in the basement and hope people will come. NO that wont happen. Its not always the case that the best technology wins. Its about attracting users and devs.
So with all this i would really like Dash to have

One public figures who will manage the social media with continuous update about what is happening, partnership and such
Team/PO/PM keeping weekly/bi-weekly updates with what has been done and what will be done the coming week(s)
Allot more engagement from our CEO much like how Charles talks about the mission and vision and bigger picture stuff.
Engage the community with competition, best dapp, best article, best graphic etc etc

The common theme is to be more visible and get the name Dash more out there. Just as Amanda said in one of her video, everyone knows "Coca cola" without any subtext. But if you just say Dash most say what is that. We need to change that.
ps. I think Amanda would be a great ambassador for the community person, not sure this is something she is interested in but it would be awesome if she wanted to tackle that role.

First DCG marketing proposal after a long time: announcement.

We have two (passing) marketing proposals in this cycle:
https://www.dashcentral.org/p/official-dash-newsroom-pr--communication
https://www.dashcentral.org/p/DCG-Marketing-EndFeb-EndApril

Yes great progress i must say. I see way way more information out there and more activity in the social media. Maybe this topic can be on-hold for now.....

There's still no "face people recognize as Dash representative" putting themselves out there on videos, interviews and other media. We don't know if or who DCG has hired their person either, nor do we know if that person is supposed to be the "face" of the network. A bit too early to put this on hold IMO.

There's still no "face people recognize as Dash representative" putting themselves out there on videos, interviews and other media. We don't know if or who DCG has hired their person either, nor do we know if that person is supposed to be the "face" of the network. A bit too early to put this on hold IMO.

According to Ryan's AMA yesterday, the head of marketing they are hiring is not intended to be a "public face"

(Closed accidentally by misclick)

There's still no "face people recognize as Dash representative" putting themselves out there on videos, interviews and other media. We don't know if or who DCG has hired their person either, nor do we know if that person is supposed to be the "face" of the network. A bit too early to put this on hold IMO.

According to Ryan's AMA yesterday, the head of marketing they are hiring is not intended to be a "public face"

That is strange. Who else would be that person? Its not like Dash can throw around money like crazy. Should be part of the job description i think

That is strange. Who else would be that person? Its not like Dash can throw around money like crazy. Should be part of the job description i think

That's not how it's usually done. Can you name a company who's head of marketing is known by the public or is the face of the company to the public? Of course we are a different type of "company," we could be different, but I don't think that was the plan of DCG for this role.
Joel used to be more Dash-centric on his videos but I like the way he's going with a slightly broader scope (but still "digital cash"-focused). I see Mark as the most public-facing person of Dash but he runs Dash channels instead of his own channels (good, we need those channels). I do miss Mark as the Stay Dashy hype-man ("The Dashening is a-happening!") in the Three Amigos podcasts, but even then it wasn't outward-facing.

There's definitely a concerted effort by Ryan to do more Twitter outreach, AMAs, etc, lately. No doubt and it's good to see.
What we also need is the person to be doing what Ryan is doing but with a set monthly schedule of 3-4 external engagements, trying to join exclusive insider groups like Satoshi Roundtable like Evan used to be in (that's a tall task now but start somewhere), and basically become a thought leader in the space. No one is going to come in and become a Roger Ver or Charles Hoskinson in a month or even a year, but those two succeeded in building a following for their respective projects with relentless and persistent media presence. They wouldn't take 2-3 months break in between when they first got started. We should demand this IMO. There's no amount of treasury money that can substitute for a person who would do this task in the network. ABJ is not the person for this as she doesn't stick to something for too long as we all know.

That's not how it's usually done.

+1 on this. Marketing is the process of bringing a product to market, it involves research and ensuring the product is a good fit for the market, as well as drumming up demand. I think most people on this thread are thinking about PR or communications roles, which are something different.

There's definitely a concerted effort by Ryan to do more Twitter outreach, AMAs, etc, lately. No doubt and it's good to see.
What we also need is the person to be doing what Ryan is doing but with a set monthly schedule of 3-4 external engagements, trying to join exclusive insider groups like Satoshi Roundtable like Evan used to be in (that's a tall task now but start somewhere), and basically become a thought leader in the space. No one is going to come in and become a Roger Ver or Charles Hoskinson in a month or even a year, but those two succeeded in building a following for their respective projects did it with relentless and persistent media presence. They wouldn't take 2-3 months break in between when they first got started. We should demand this IMO. There's no amount of treasury money that can substitute for a person who would do this task in the network. ABJ is not the person for this as she doesn't stick to something for too long as we all know.

This is exactly what i'm asking too.
And no we are not mixing the two @strophy . All we are saying is that the budget is limited and we need to have some requirement on the role. I still think the head of Marketing has to be a public figure much like Roger Ver / Charles and communicate outwards about what we are doing as @hilawe  suggested (maybe 3.4 times a month) etc....
One day we might be able to reduce this and focus more on other areas but right now i think we are on a tipping point to move down in ranking if we dont bring in more people/users and show what is happening behind the scenes. Working in the dark is a no go in crypto.
We dont even have a good overview like this: https://cardano.ideascale.com/a/ideas/top/campaign-filter/byids/campaigns/25797/stage/unspecified?sortBy=cumulative.votes&direction=down
We have tons of things to improve i think.

"Marketing is focused on promoting and selling a specific product, whereas PR is focused on maintaining a positive reputation for a company as a whole." I got you @strophy and I appreciate the need to be precise. And yes if I was to go into industry standards and definitions, communications would underlie both marketing and PR.
The head of PR's job is made much more difficult when he/she is also the one that has to promote and sell the product for the network as well as do PR because it's not being done anywhere else. Promotion of the overall vision and product(s) of the network is painfully missing.
Instead of being upset about this vicious cycle of unhappiness, we should really look at having a network-accountable CMO role outside of DCG. Both MNOs and DCG can be relieved of the tension that exists currently over this. Eventually, this CMO role can also be under the Trust Protectors (I personally prefer it stays independent of it but people disagree). MNOs will be happy that their vote will count in terms of proposal performance and DCG will be happy because they can focus on the technology and dev side. The CMO will be the bridge for all parties in the network and more importantly independent of constraints.
Thoughts?

I personally feel a disconnect between the devs / the management and community.
Like what is being worked on even? week to week?

What is the new PR person doing? been some time and i have not heard much about it (not 100% active due to my own work so maybe i missed it but i dont see much more buzz)
Are we doing any collaboration with anyone?
The stablecoin was very hot and then it died! Why? no one seems to be able to explain things like that to me.
There is a big disconnect. And i think the DCG needs to start showing more presence and built confidence with the community. People generally like to help but they wont step-up if they dont even know what the heck is going on so in this case i think the team needs to step it up and start showing themselves.
Even if this means more time is spent on communication rather then development i think its worth it. And It dont need to be the devs but maybe someone working close with them like the productowner/projectmanager or whoever.
I'm a project manager myself and i know the importance of communication and keeping people involved and engaged...


Builtins::Lookup interface

Parse mangled names once, lookup in unordered_map, return FunctionInfo
Moved demangler from ReplaceOpenCLBuiltinPass.cpp
Added enum for all OpenCL 2.0 builtin functions
Added enum for all cl_khr_sub_groups
Implemented sub_group_broadcast
Added --spirv-version=1.x for features that require later SPIRV version (ie. sub_groups)
Links to https://github.com/google/clspv/issues/510

I know this is a big change but hopefully easier to maintain and extend builtin support.
Next steps are:

replace remaining mangled name lookups
full sub_group support
OpenCL 2.0 feature support
And of course more tests

And e.g. step 3 add subgroup builtins.

Thanks @dneto0 , makes sense. I will split it up.

superceded by PR #518


bug: Fonts Brokren in Next 15

Provide environment information
"initVersion": "7.38.1"
System:
OS: Linux 6.11 Manjaro Linux
CPU: (4) x64 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz
Memory: 2.14 GB / 7.47 GB
Container: Yes
Shell: 5.9 - /usr/bin/zsh
Binaries:
Node: 22.2.0 - ~/.nvm/versions/node/v22.2.0/bin/node
Yarn: 1.22.22 - /usr/bin/yarn
npm: 10.7.0 - ~/.nvm/versions/node/v22.2.0/bin/npm
pnpm: 9.8.0 - ~/.local/share/pnpm/pnpm
bun: 1.1.17 - ~/.bun/bin/bun
Describe the bug
Fonts installation is Broken in Next js15.
I just create the app, and ran pnpm dev, first I got an error with turbopack saying see next dev for more information, but nothing on console so I just removed the turbo flag form dev command.
After that I am not able to get the fonts thing working.
Failed to compile

node_modules/.pnpm/geist@1.3.1_next@15.0.4_react-dom@18.3.1_react<EMAIL_ADDRESS>An error occurred in `next/font`.

Error: Cannot find module '....../whatevermyapp/node_modules/.pnpm/sucrase<EMAIL_ADDRESS>
I then tried google and local fonts with next/font/google and next/font/local, and nothing worked.
Reproduction repo
null
To reproduce
pnpm create t3-app@latest some-app
Additional information

@IzaanAnwar If you need a quick fix you can try downgrading: "@jridgewell/gen-mapping": "0.3.5", manually. Also, make sure to remove node_modules and lock file(s).

So I tried to create a Normal nextjs app and it seems this error is there too.
Might be specific to my system. But still keeping the issue open, so that if others encounter the same, maybe someone can help

Seems it was an issue only for my machine


Is version 1.x for the browser and version 2.x for node?

tcomb can be used in the browser if you use something like browserify / webpack, since it uses process.env.NODE_ENV tests in order to strip the asserts in production

Ah, that explains a lot. Might I clarify that in the README?

Sure, thanks


Resources are marked as both Ignore and no change

Describe the noise
Resources are marked as both Ignore and no change
* Microsoft.AlertsManagement/actionRules/test1 [2019-05-05-preview]
  * Microsoft.AlertsManagement/actionRules/test2 [2019-05-05-preview]
  * Microsoft.AlertsManagement/actionRules/test3 [2019-05-05-preview]
  * Microsoft.AlertsManagement/actionRules/test5 [2019-05-05-preview]
  * Microsoft.AlertsManagement/actionRules/test6 [2019-05-05-preview]
  * Microsoft.AlertsManagement/actionRules/test7 [2019-05-05-preview]
  * Microsoft.AlertsManagement/actionRules/test8 [2019-05-05-preview]
  * Microsoft.Insights/actiongroups/test [2019-06-01]
  * Microsoft.Insights/activityLogAlerts/Advisor Recommendations [2017-04-01]
  * Microsoft.Insights/activityLogAlerts/Resource Health 1 [2017-04-01]
  * Microsoft.Insights/activityLogAlerts/Resource Health 2 [2017-04-01]
  * Microsoft.Insights/activityLogAlerts/Resource Health 3 [2017-04-01]
  * Microsoft.Insights/activityLogAlerts/Resource Health 4 [2017-04-01]
  * Microsoft.Insights/activityLogAlerts/Service Health [2017-04-01]
  * Microsoft.OperationalInsights/workspaces/lz-monitoring-core-acceptance-stan3 [2017-03-15-preview]
  * Microsoft.OperationsManagement/solutions/AgentHealthAssessment(lz-monitoring-core-acceptance-stan3) [2015-11-01
-preview]
  * Microsoft.OperationsManagement/solutions/AzureActivity(lz-monitoring-core-acceptance-stan3) [2015-11-01-preview]
  = Microsoft.AlertsManagement/actionRules/test1 [2019-05-05-preview]
  = Microsoft.AlertsManagement/actionRules/test2 [2019-05-05-preview]
  = Microsoft.AlertsManagement/actionRules/test3 [2019-05-05-preview]
  = Microsoft.AlertsManagement/actionRules/test5 [2019-05-05-preview]
  = Microsoft.AlertsManagement/actionRules/test6 [2019-05-05-preview]
  = Microsoft.AlertsManagement/actionRules/test7 [2019-05-05-preview]
  = Microsoft.AlertsManagement/actionRules/test8 [2019-05-05-preview]
  = Microsoft.Insights/activityLogAlerts/Advisor Recommendations [2017-04-01]
  = Microsoft.Insights/activityLogAlerts/Resource Health 1 [2017-04-01]
  = Microsoft.Insights/activityLogAlerts/Resource Health 2 [2017-04-01]
  = Microsoft.Insights/activityLogAlerts/Resource Health 3 [2017-04-01]
  = Microsoft.Insights/activityLogAlerts/Resource Health 4 [2017-04-01]
  = Microsoft.Insights/activityLogAlerts/Service Health [2017-04-01]

More information provided by e-mail.
Resource type (i.e. Microsoft.Storage/storageAccounts)
apiVersion (i.e. 2019-04-01)
Client (PowerShell, Azure CLI, or API)
Relevant ARM Template code (we only need the resource object for the above resourceType and apiVersion, but if it's easier you can include the entire template
Expected response (i.e. "I expected no noise since the template has not been modified since the resources were deployed)
Current (noisy) response (either include a screenshot of the what-if output, or copy/paste the text)
Additional context
Add any other context about the problem here.

We have a fix for this which should be deployed within 1-2 weeks.

The fix has been committed to an internal repo and is awaiting deployment.

The fix has been deployed to all public regions and I have verified that it works with my own template that reproduced the problem before.
@slavizh, can you try it out with your own template and confirm that it's fixed?

Closing the issue. Please reopen if you still see the problem.

I can confirm it is fixed as well.


Fix errors in convert_output

What is the feature?
*make various changes to convert_output
How have you implemented the solution?
*multiple ways
Does the PR impact any other area of the project, maybe another repo?
*yes, the module_name column will now be a permanent component of the converted data frame

@sbreitbart-NOAA I also just added into this branch documentation for the package that removed the global variables warning in devtools::check() !


refactor(tensorrt_yolox)!: add autoware prefix to tensorrt_yolox

PR Type

Refactor

Related Links

As of https://github.com/autowarefoundation/autoware.universe/pull/7992, tensorrt_yolox needs autoware prefix.

Parent issue:

https://github.com/autowarefoundation/autoware/issues/4569

Description

This PR adds autoware prefix to tensorrt_yolox.
Review Procedure

Remarks

This PR must be merge after the above PR has been merged.
Pre-Review Checklist for the PR Author
PR Author should check the checkboxes below when creating the PR.

[ ] Assign PR to reviewer

Checklist for the PR Reviewer
Reviewers should check the checkboxes below before approval.

[ ] Commits are properly organized and messages are according to the guideline
[ ] (Optional) Unit tests have been written for new behavior
[ ] PR title describes the changes

Post-Review Checklist for the PR Author
PR Author should check the checkboxes below before merging.

[ ] All open points are addressed and tracked via issues or tickets

CI Checks

Build and test for PR: Required to pass before the merge.

Close because this PR was moved into https://github.com/tier4/edge_auto_jetson_launch/pull/13.


Add build_scan team and update platform definitions

Also, alphabetize team info.

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

I've triggered a build for you.


New VL breast dataset for integration into the PPP

The Validation Lab is ready to share Breast Cancer data with us for integration into PPP.
The dataset adds a number of additional data points to the colorectal one (currently in PPP)-such as three different contrast assays - and presents a challenge related to how to assess the hit and how to visualise this assessment. Moreover, we may need to  consider adding two new gold standard datasets to the widget: Project Score v2 and Dep Map.

[x] The action item for the team is now to investigate the dataset and present a couple of options to the VL on how we could integrate/visualise all the data dimensions into the PPP.

@DSuveges please feel free to add to or edit this initial ticket.

Based on the discussion, I believe the ingestion bit should not be a problem. At this point the blocker is having a solidified idea on what the data should look like. More specifically:

What is the delivered message from VL.
How this message can be generalised over all present and future VL deliveries to ensure sustainability and across VL experiments.

Once these questions are answered, the developement of a data model should not be too complicted, however we need to keep in mind the load on backend and frontend, and make sure this load is sustainable, and there would be no required furter investment with new VL data in the future.

For internal records, I am sharing here the link to a widget mock-up we have discussed last week.
The data team is now working on parsing the data into the agreed schema, and myself/FE will pick the task from there moving forward.

This is the new VL evidence schema:
{
    "targetFromSourceId": "ADSL",
    "diseaseFromSourceMappedId": "EFO_0000305",
    "diseaseFromSource": "breast carcinoma",
    "resourceScore": 1.0,
    "assays": [
        {
            "shortName": "CellTiter-Glo",
            "description": "Homogeneous method of determining the number of viable cells in culture based on quantitation of the ATP present, an indicator of metabolically active cells",
            "studyOverview": "Cas9-expressing cell lines were transfected with gene-specific gRNAs in 384-well arrayed format. After 7 days in culture, endpoint viability was measured by CellTitreGlo."
            "isHit": true
        },
        {
            "shortName": "Cell Confluence",
            "description": "",
            "studyOverview": ""
            "isHit": true
        },
        {
            "shortName": "Cell Toxicity",
            "description": "",
            "studyOverview": ""
            "isHit": true
        }
    ]
    "assessment": "Multiple evidence of dependency. Evidence of toxicity",
    "diseaseCellLines": [
        {
            "name": "MCF7",
            "id": "SIDM00148",
            "tissue": "Breast",
            "tissueId": "UBERON_0000310"
        }
    ],
    "biomarkerList": [
        {
            "name": "MSS",
            "description": "Microsatellite stable"
        }
    ],
    "primaryProjectId": "OTAR015",
    "isPrimaryProjectHit": true,
    "projectId": "OTAR2059",
    "projectDescription": "CRISPR Cas9 Target ID",
    "datasourceId": "ot_crispr_validation",
    "datatypeId": "ot_validation_lab",
    "releaseDate": "2024-04-30",
    "releaseVersion": "OTAR3059-893478954"
}

@mbdebian - we now have a schema for the new VL lab dataset (see above), as mentioned yesterday. Tagging you and also @prashantuniyal02 to this so that the tasks can continue downstream (PIS+ETL steps).

@mbdebian, I'll soon will provide list of fields that will no longer be in the schema, so they can be removed from the evidence data model.

Hi @mbdebian I have a draft evidence set here:
gs://ot-team/dsuveges/vl.json.gz/part-00000-e2c940e4-6ecb-4386-bfb2-f4df1991443f-c000.json

This is based on a mock data from validation lab, but we are expecting to get a full dataset soon.
The following columns can be removed from the evidence data model:

validationHypotheses. With all its nested fields.
expectedConfidence

Thank you @DSuveges !

There has been some marginal update. This is (hopefully) the final form of the schema:
{
  "datasourceId": "ot_crispr_validation",
  "datatypeId": "ot_validation_lab",
  "studyOverview": "Cas9-expressing cell lines were transfected with gene-specific gRNAs in 384-well arrayed format. Cell confluence and toxicity were monitored by live-cell imaging and endpoint viability (day 8-13 depending on cell line) was measured by CellTitre Glo",
  "projectId": "OTAR2059",
  "releaseDate": "2024-04-30",
  "releaseVersion": "OTAR2059-44690",
  "targetFromSourceId": "ADSL",
  "diseaseFromSourceMappedId": "EFO_0000305",
  "diseaseFromSource": "breast carcinoma",
  "resourceScore": 1.0,
  "assessment": "No evidence of dependency",
  "assays": [
    {
      "shortName": "CellTiter-Glo",
      "description": "Homogeneous method of quantifying the presence of ATP, an indicator of metabolically active cells, and using this as a proxy to determine the number of viable cells.",
      "isHit": false
    }
  ],
  "diseaseCellLines": [
    {
      "name": "HCT116",
      "tissueId": "UBERON_0000310"
    }
  ],
  "biomarkerList": [
    {
      "name": "MSI",
      "description": "Microsatellite instable"
    },
    {
      "name": "CRIS-D",
      "description": "WNT activation, IGF2 gene overexpression and amplification."
    },
    {
      "name": "KRAS-mut",
      "description": "KRAS mutation status: mutant"
    },
    {
      "name": "TP53-wt",
      "description": "TP53 mutation status: wild type"
    },
    {
      "name": "APC-wt",
      "description": "APC mutation status: wild type"
    }
  ],
  "primaryProjectHit": false,
  "primaryProjectId": "OTAR015"
}

Data file is here: gs://ot-team/dsuveges/new_validation_lab.json.gz

@mbdebian let us know if it's all clear from your side!

@mbdebian - we now have a schema for the new VL lab dataset (see above), as mentioned yesterday. Tagging you and also @prashantuniyal02 to this so that the tasks can continue downstream (PIS+ETL steps).

I just checked with PIS, and no update is required in there.
Next step is the ETL

Hi @mbdebian I have a draft evidence set here:
gs://ot-team/dsuveges/vl.json.gz/part-00000-e2c940e4-6ecb-4386-bfb2-f4df1991443f-c000.json

This is based on a mock data from validation lab, but we are expecting to get a full dataset soon.
The following columns can be removed from the evidence data model:

validationHypotheses. With all its nested fields.
expectedConfidence

Regarding data model, I've checked that PIS does not perform any additional operations on the evidence beyond data collection, I can imagine that ETL and API components will require updates

I've just compared the schemas:
Old Validation Lab data model
root
 |-- biomarkerList: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- description: string (nullable = true)
 |    |    |-- name: string (nullable = true)
 |-- confidence: string (nullable = true)
 |-- contrast: string (nullable = true)
 |-- datasourceId: string (nullable = true)
 |-- datatypeId: string (nullable = true)
 |-- diseaseCellLines: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- id: string (nullable = true)
 |    |    |-- name: string (nullable = true)
 |    |    |-- tissue: string (nullable = true)
 |    |    |-- tissueId: string (nullable = true)
 |-- diseaseFromSource: string (nullable = true)
 |-- diseaseFromSourceMappedId: string (nullable = true)
 |-- expectedConfidence: string (nullable = true)
 |-- projectDescription: string (nullable = true)
 |-- projectId: string (nullable = true)
 |-- releaseDate: string (nullable = true)
 |-- releaseVersion: string (nullable = true)
 |-- resourceScore: double (nullable = true)
 |-- statisticalTestTail: string (nullable = true)
 |-- studyOverview: string (nullable = true)
 |-- targetFromSourceId: string (nullable = true)
 |-- validationHypotheses: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- description: string (nullable = true)
 |    |    |-- name: string (nullable = true)
 |    |    |-- status: string (nullable = true)

New Validation Lab data model
root
 |-- assays: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- description: string (nullable = true)
 |    |    |-- isHit: boolean (nullable = true)
 |    |    |-- shortName: string (nullable = true)
 |-- assessment: string (nullable = true)
 |-- biomarkerList: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- description: string (nullable = true)
 |    |    |-- name: string (nullable = true)
 |-- datasourceId: string (nullable = true)
 |-- datatypeId: string (nullable = true)
 |-- diseaseCellLines: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- id: string (nullable = true)
 |    |    |-- name: string (nullable = true)
 |    |    |-- tissue: string (nullable = true)
 |    |    |-- tissueId: string (nullable = true)
 |-- diseaseFromSource: string (nullable = true)
 |-- diseaseFromSourceMappedId: string (nullable = true)
 |-- primaryProjectHit: boolean (nullable = true)
 |-- primaryProjectId: string (nullable = true)
 |-- projectId: string (nullable = true)
 |-- releaseDate: string (nullable = true)
 |-- releaseVersion: string (nullable = true)
 |-- resourceScore: double (nullable = true)
 |-- studyOverview: string (nullable = true)
 |-- targetFromSourceId: string (nullable = true)

Data Models Delta
New attributes
root
 |-- assays: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- description: string (nullable = true)
 |    |    |-- isHit: boolean (nullable = true)
 |    |    |-- shortName: string (nullable = true)
 |-- assessment: string (nullable = true)
 |-- primaryProjectHit: boolean (nullable = true)
 |-- primaryProjectId: string (nullable = true)

REMOVED attributes
root
 |-- confidence: string (nullable = true)
 |-- contrast: string (nullable = true)
 |-- expectedConfidence: string (nullable = true)
 |-- projectDescription: string (nullable = true)
 |-- projectId: string (nullable = true)
 |-- statisticalTestTail: string (nullable = true)
 |-- validationHypotheses: array (nullable = true)
 |    |-- element: struct (containsNull = true)
 |    |    |-- description: string (nullable = true)
 |    |    |-- name: string (nullable = true)
 |    |    |-- status: string (nullable = true)

Hi @mbdebian I have a draft evidence set here:
gs://ot-team/dsuveges/vl.json.gz/part-00000-e2c940e4-6ecb-4386-bfb2-f4df1991443f-c000.json

This is based on a mock data from validation lab, but we are expecting to get a full dataset soon.
The following columns can be removed from the evidence data model:

validationHypotheses. With all its nested fields.
expectedConfidence

These columns are not being addressed in the ETL, the API will be search for these

The ETL is ok with the new given validation lab sample dataset at gs://ot-team/dsuveges/new_validation_lab.json.gz
These checks have been completed in the ETL branch issue_3298, which will stay open in order to check the pipeline with the real dataset.
The next checkpoints in the data journey are Opensearch and Open Targets GraphQL API

@prashantuniyal02 , BE works on this have been completed, and no problems beyond the API have been reported, would it be possible to flag this issue as completed?

Released in PPP


Validate config

In SecureChannel and Session handling, large part of the required parameters depends on each Config, which is to be created and passed by users.
It causes crash if the parameters in each Config are not properly set. Thus the parameters should be validated when opening SecureChannel/Creating Session and we should notify users of the invalid parameters.

Fixed in d2a679449ed59dec14db6a17fbdd1cc89c226207


[3.x] Backport  "[Editor] Add EditorPlugin::scene_saved signal"

3.x backport of 97b469c46d8a3225cc26b22952e408451192794e
I have also attempted to better-clarify the documentation in regards to the behaviour as testing revealed (at least on 3.x); this is why the co-authored-by tag was attached to the commit.
The main usecase I foresee in 3.x, particularly with GLES2, is for automating the generation of various kinds of impostors, atlases, and generally performance-enhancing proxies.

This looks great!
One question occurred .. if I understand it correctly, would it be worth clarifying in the classref that the signals are sent before the save (if they do indeed get sent then, I'm not super familiar with the signal machinery :grin: )?
Sometimes it is better to be vague, but a plugin writer might assume that a signal was occurring after the save had taken place (depending on what they were going to use it to do).
This isn't a condition BTW, just wondering whether it would be worth including this or not.
@AThousandShips

The original description is somewhat poorly worded, but for consistency it should be the same both on upstream and in the 3.x port.

"Consistency" is not a reason to not make improvements to PRs when backporting.

Ok am happy to leave it to you guys judgement, as both yourself and thousand ships have seen this. :+1:


Set Sensordata to 0 (Zero) instead of "Unknown"

Is your feature request related to a problem? Please describe.
If a sensor has no data yet it is reported as "unknown" in HA. I.e. the daily statisics (sensor data and its attributes) is reported "unknown" until I took the first ride.
Describe the solution you'd like
Fpr the statics it would be great, if there would be reported a 0-value the graphs would look much nicer ("Zero-Bars" instead of nothing)

Even if this sounds understandable at first glance, I'm honestly not in favor of it.
We don't have the API under control and everything we know has come about through trial and error and guesswork.
So we can never be sure of the current values. A None value (unknown) is therefore more honest than a 0 value and does not distort the statistics if you want to carry out further aggregations based on the data collected.
As an emergency solution, you could help yourself with a template sensor if it bothers you a lot.

We should always follow the HA architecture. (The HA way if you would). Though I understand your probkem, and somewhat agree with you, there isn't a good way to handle this in the right way other the following HA design rules.


Adding a basic book page

Parts of #15

Current coverage is 68.10%

Merging #16 into master will decrease coverage by -3.24% as of 5660b73

@@            master    #16   diff @@
=====================================
  Files           13     14     +1
  Stmts          171    185    +14
  Branches         8      8
  Methods          0      0
=====================================
+ Hit            122    126     +4
+ Partial          5      4     -1
- Missed          44     55    +11

Review entire Coverage Diff as of 5660b73

Powered by Codecov. Updated on successful CI builds.


Updated MySQL driver

Updated the MySQL-driver from com.mysql.jdbc.Driver to com.mysql.cj.jdbc.Driver
Oh, and cleaned up a bit of the excess spaces

Unsure if this has anything to do with CF stopping, but when I went through my config-file I updated it, and refreshed the MySQL driver while at it. The old one seems to be deprecated.
Loading class com.mysql.jdbc.Driver'. This is deprecated. The new driver class is com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.

Thanks!