Support renamed Kubernetes configuration in Airflow 2.5.0

Checks

[X] I have checked for existing issues.
[X] This report is about the User-Community Airflow Helm Chart.

Motivation
Airflow config section kubernetes renamed to kubernetes_executor in 2.5.0:
https://airflow.apache.org/docs/apache-airflow/stable/release_notes.html#airflow-config-section-kubernetes-renamed-to-kubernetes-executor-26873
This is causing warnings for now and might not work for later versions.
Implementation
Introducing an if statement to pick the correct env variable names based on Airflow version in this section:
https://github.com/airflow-helm/charts/blob/2268f2416a580cbd3db2050160a29226913473ca/charts/airflow/templates/config/secret-config-envs.yaml#L182
Example (with introduced airflow.version value):
  {{- if semverCompare "<2.5" .Values.airflow.version }}
    {{- if not .Values.airflow.config.AIRFLOW__KUBERNETES__NAMESPACE }}
  AIRFLOW__KUBERNETES__NAMESPACE: {{ .Release.Namespace | toString | b64enc | quote }}
    {{- end }}
  {{- else -}}
    {{- if not .Values.airflow.config.AIRFLOW__KUBERNETES_EXECUTOR__NAMESPACE }}
  AIRFLOW__KUBERNETES_EXECUTOR__NAMESPACE: {{ .Release.Namespace | toString | b64enc | quote }}
    {{- end }}
  {{- end }}

Are you willing & able to help?

[X] I am able to submit a PR!
[ ] I can help test the feature!

@emartgu I want to avoid the need to explicitly set an airflow.version value, we can probably do something similar to what we did for logging.worker_log_server_port replacing celery.worker_log_server_port in airflow 2.2.0, and just include both configs.
This should suppress the warning logs, and future-proof us in case they remove the old one.


STOC 2020 Post

How about adding a comment of the form "Please let us know if we missed any differential privacy papers (in the comments below or by email)"?


Add embedded language support for markdown in @docs and @moduledocs

Right now I am extracting the text into a markdown file, edit and copy back.
It would be very nice to get syntax highlighting for @doc and @moduledoc parts. Since these are markdown the readability might increase.
Instead of this:

one might see:

@Terbium-135 This should be fixed on main. Please pull the latest main and try it out when you get the chance. Thanks!

@Blond11516 I tried that in ElixirLS v0.15 and had to revert as markdown rules would leak out of context and break highlighting of everything following. See https://github.com/elixir-lsp/vscode-elixir-ls/issues/315#issuecomment-1602086184

I tried it as well and facing:

I changed package.json and set:
  "engines": {
    "vscode": "^1.79.0-insider"
  },

I see no leakage so far. But only had a quick glance.

and

I am not using ElixirLS.

Sadly I discovered a file which leaks markdown - perhaps something can be done to better (start and) terminate the heredoc area?

taken from this part:

The 2nd next """ ends markdown and switches back to elixir:

So from what I've seen the issue of leakage is caused by the additional indentation that @doc and friends add at the beginning of the markdown. This causes vscode to misinterpret the markdown as soon as it detects some sort of indented element (non-fenced code block, element within a list, etc.)
For example, as soon as the heredoc contains a list, vscode interprets everything coming after it as a list element, because the markdown is indented as such:

This then appears to cause the next closing heredoc to be missed for whatever reason.
A custom markdown grammar might indeed be able to fix this, but that's obviously not a very desirable solution. I'll dig a bit into TextMate to see if there's any way to have it ignore this identation but I wouldn't bet on that being the case. Ideally I'd like to see how other extensions handle this; it would need to be a grammar that injects a whitespace-sensitive language (markdown, python, etc.) with some implicit indentation but I don't have any ideas off the top of my head. I'm all ears if anyone knows of something like this 🤷
I've pushed a small reproduction repository with examples of list and nested module failures.

I've reverted the changes from main and pushed them back in a new branch.

Thank you for all your work and investigation so far!

I think a while pattern should do the trick, see https://github.com/elixir-lsp/vscode-elixir-ls/issues/315#issuecomment-2551931723.
Confirmed working (with ElixirLS) for the examples from https://github.com/Blond11516/markdown-leakage-repro


support for fp16 in naive comm

This PR adds the support for fp16 in naive comm.
Related to https://github.com/chainer/chainer/issues/6330
ToDo:

[x] support for fp16 in allreduce
[x] support for fp16 in bcast

Jenkins, test this please.

Jenkins CI test (for commit 7d39fe3f5c2fd2e766d0b2db8526c300112997ff, target branch master) failed with status FAILURE.
(For contributors, please wait until the reviewer confirms the details of the error.)

👀

Jenkins, test this please.

Jenkins CI test (for commit 7d39fe3f5c2fd2e766d0b2db8526c300112997ff, target branch master) succeeded!

Jenkins CI test (for commit 7d39fe3f5c2fd2e766d0b2db8526c300112997ff, target branch master) failed with status FAILURE.
(For contributors, please wait until the reviewer confirms the details of the error.)


Problem compiling the library on Ubuntu 22.04

Thanks a lot for open sourcing this library @cvanaret !
I initially tried to compile it on Ubuntu 22.04, and I failed.
First of all, I installed AMPL/ASL and HSL/MA57 . I tried to install BQPD, but I could not find where to download it (I need to drop a mail as described in https://www.mcs.anl.gov/~leyffer/solvers.html or there is a more direct option?)
Configuration problems
Then, I tried to configure the project, and it was failing with error:
CMake Error at CMakeLists.txt:120 (message):
  Required library gomp was not found.  Use ccmake to configure its path.

this was fixed by passing the gomp location to cmake:
cmake -Dgomp=/usr/lib/x86_64-linux-gnu/libgomp.so.1 ..

Also for amplsolver and ma57 I specified the location manually.
Compilation Problems
After that, the configuration was successful and I could start the compilation.
Infinity.hpp error
The first compilation that I got is:
[ 21%] Building CXX object CMakeFiles/uno.dir/uno/ingredients/globalization_strategy/Filter.cpp.o
In file included from /home/straversaro/unoaptws/clean/uno/uno/ingredients/globalization_strategy/Filter.hpp:10,
                 from /home/straversaro/unoaptws/clean/uno/uno/ingredients/globalization_strategy/Filter.cpp:
:
/home/straversaro/unoaptws/clean/uno/uno/tools/Infinity.hpp:7:25: error: ‘numeric_limits’ is not a member of
std’
    7 | const double INF = std::numeric_limits<double>::infinity();
      |                         ^~~~~~~~~~~~~~
/home/straversaro/unoaptws/clean/uno/uno/tools/Infinity.hpp:7:40: error: expected primary-expression before ‘double’
    7 | const double INF = std::numeric_limits<double>::infinity();
      |                                        ^~~~~~
make[2]: *** [CMakeFiles/uno.dir/build.make:188: CMakeFiles/uno.dir/uno/ingredients/globalization_strategy/Filter.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:85: CMakeFiles/uno.dir/all] Error 2
make: *** [Makefile:91: all] Error 2

that was fixed by modifying the uno/uno/tools/Infinity.hpp as in:
diff --git a/uno/tools/Infinity.hpp b/uno/tools/Infinity.hpp
index 1ada183..8ae84da 100644
--- a/uno/tools/Infinity.hpp
+++ b/uno/tools/Infinity.hpp
@@ -4,6 +4,9 @@
 #ifndef UNO_INFINITY_H
 #define UNO_INFINITY_H

+#include <cmath>
+#include <limits>
+
 const double INF = std::numeric_limits<double>::infinity();

 inline bool is_finite(double value) {

Direction.hpp Compilation Error
After that, I had:
[ 31%] Building CXX object CMakeFiles/uno.dir/uno/ingredients/subproblem/Direction.cpp.o
In file included from /home/straversaro/unoaptws/clean/uno/uno/ingredients/subproblem/Direction.cpp:4:
/home/straversaro/unoaptws/clean/uno/uno/ingredients/subproblem/Direction.hpp:57:16: error: ‘ostream’ in namespace ‘std’ does not name a type
   57 |    friend std::ostream& operator<<(std::ostream& stream, const Direction& step);
      |                ^~~~~~~
In file included from /home/straversaro/unoaptws/clean/uno/uno/ingredients/subproblem/Direction.cpp:4:
/home/straversaro/unoaptws/clean/uno/uno/ingredients/subproblem/Direction.hpp:11:1: note: ‘std::ostream’ is defined in header ‘<ostream>’; did you forget to ‘#include <ostream>’?
   10 | #include "tools/Infinity.hpp"
  +++ |+#include <ostream>
   11 |

that was fixed by:
diff --git a/uno/ingredients/subproblem/Direction.hpp b/uno/ingredients/subproblem/Direction.hpp
index 337e7ce..5c66cb3 100644
--- a/uno/ingredients/subproblem/Direction.hpp
+++ b/uno/ingredients/subproblem/Direction.hpp
@@ -8,6 +8,7 @@
 #include <optional>
 #include "optimization/Multipliers.hpp"
 #include "tools/Infinity.hpp"
+#include <ostream>

 enum class Status {
    OPTIMAL = 0,

LPSolverFactory.hpp Compilation Problem
The final error (that I was not able to solve is on LPSolverFactory.hpp ):
[ 26%] Building CXX object CMakeFiles/uno.dir/uno/ingredients/subproblem/HessianModel.cpp.o
In file included from /home/straversaro/unoaptws/clean/uno/uno/ingredients/subproblem/LPSubproblem.cpp:5:
/home/straversaro/unoaptws/clean/uno/uno/solvers/QP/LPSolverFactory.hpp:16:27: error: ‘BQPDSolver’ was not declared in this scope; did you mean ‘LPSolver’?
   16 |    static std::unique_ptr<BQPDSolver> create(size_t number_variables, size_t number_constraints, const std::string& LP_solver_name,
      |                           ^~~~~~~~~~
      |                           LPSolver
/home/straversaro/unoaptws/clean/uno/uno/solvers/QP/LPSolverFactory.hpp:16:37: error: template argument 1 is invalid
   16 |    static std::unique_ptr<BQPDSolver> create(size_t number_variables, size_t number_constraints, const std::string& LP_solver_name,
      |                                     ^
/home/straversaro/unoaptws/clean/uno/uno/solvers/QP/LPSolverFactory.hpp:16:37: error: template argument 2 is invalid
In file included from /home/straversaro/unoaptws/clean/uno/uno/ingredients/subproblem/LPSubproblem.cpp:5:
/home/straversaro/unoaptws/clean/uno/uno/solvers/QP/LPSolverFactory.hpp: In static member function ‘static int LPSolverFactory::create(size_t, size_t, const string&, const Options&)’:
/home/straversaro/unoaptws/clean/uno/uno/solvers/QP/LPSolverFactory.hpp:24:4: warning: no return statement in function returning non-void [-Wreturn-type]

At a first glance, it seems like BQPD is not an optional dependency, as suggested by the README?

Hi @traversaro ,
Thank you for your feedback! I fixed the (stupidly) missing #includes in my latest commit. I also fixed LPSolverFactory.hpp, so you should be able to compile the code without BQPD (it is optional in the Makefile).
I'm afraid some paths must be set manually with command arguments (as you did) or using ccmake.
To get BQPD and the corresponding license, ask Sven Leyffer (leyffer@anl.gov).
Please keep me posted :)
Charlie

Thanks, now the project compiles fine. The only remaining problem is that (at least on Ubuntu 22.04) for making sure that     find_package(GTest CONFIG REQUIRED) is successful you need to install libgtest-dev, not googletest.

Perfect!
It looks like libgtest-dev is required from Ubuntu 20.04 onward.
The latest README gives you basic instructions for solving an AMPL model with different combinations of ingredients.
Best,
Charlie


Certifi <2024.7.4 is vulnerable, but required by this package

The requirements.txt file contains certifi==2024.2.2, which is vulnerable. See the Github security advisory

Updated all requirements for the package to latest: https://github.com/cboin1996/requests-html/pull/17


MIC access for python container app in YIA Voice Kit

I am using Google Voice Kit on a Raspberry PI 3. I created a docker image of my python app. When i run my app inside a container, i get this error when trying to record from the mic:
FileNotFoundError: [Errno 2] No such file or directory: 'arecord'
Here is the actual line that throws the exception in recording.py:
self._arecord = subprocess.Popen(self._cmd, stdout=subprocess.PIPE)
This line is called from recordSound method in recording.py file:
def recordSound(duration = 1, sr = AUDIO_SAMPLE_RATE_HZ):
    recorder = Recorder(sample_rate_hz = sr)
    dumper = assembleArray(duration)
    with recorder, dumper:
        recorder.add_processor(dumper)
        while not dumper.is_done():
            time.sleep(0.1)        # This is the line that throws the above exception

    byt_buffer_lst = dumper.byte_buffer
    byte_buffer = b''.join(byt_buffer_lst)
    dat = np.frombuffer(byte_buffer, np.int16)
    ## return sample rate in tuple to mimic wavfile read
    return((sr, dat))

Any idea how this driver issue could be fixed inside a docker container?
Is it related to configuring ALSA loopback? i am looking for direction to share my mic inside my container app since i think this is the main issue.

I think you might have messed something up when making your docker container.
arecord is a default alsa utility that is present on any raspbian by default along with aplay and alsamixer. It is used (you guessed it) for recording audio. If you dont have it - it means it is missing from your container.

We don't support running the tool inside docker, so we're going to close this issue.
If you do need to run inside docker, you'll need to install alsa-utils inside the container and allow the container to access the sound devices on the host. Some relevant info here: https://github.com/danielchalef/jasper-docker


Add release automation

Expected Behavior
We should have automation that will build and push:

Images for our controllers to a registry (GCR?)
Yaml for deploying to a known place (GCS?)

Actual Behavior
Currently the only way to setup the Pipeline is to run ko as described in the DEVELOPMENT guide
Additional Info
See release script for knative/serving, invoked by prow.

Done in #241
cc @adrcunha

Now that the release script exists, we just need a Prow cron job to create nightlies.

Can I assign this one to you @ImJasonH ? :D

Hey @adrcunha , anything left to do here? If not, where can we see the releases?

Nightly releases were re-enabled on 12/5. You can track them here:
https://testgrid.knative.dev/knative-build-pipeline#release
Nightly releases are published to:
gs://knative-nightly/build-pipeline/latest/release.yaml
and
gs://knative-nightly/build-pipeline/previous//release.yaml
Images are published to
gcr.io/knative-nightly/github.com/knative/build-pipeline/...
And are tagged latest and vYYYYMMDD-commithash as appropriate.


Redeclared function

the function assignDeviceGeofence is redeclared you may wanna fix this.

Thank you for bringing this up, Shall make the changes this weekend, there is more improvements I need to add as well.


Hot reloading not working in reduceer

Hot reloading is not working when I change this
[COUNTER_INCREMENT]    : (state, action) => state + action.payload,
to this
[COUNTER_INCREMENT]    : (state, action) => state + action.payload + 2,
reducer still increments state by action.payload.

// Reducer hot module replacement,
// thanks to:
// https://github.com/RyanCCollins/scalable-react-boilerplate/blob/master/app/src/store.js#L78
if (module.hot) {
  module.hot.accept('rootReducer', () => {
    const nextRootReducer = require('rootReducer').default;
    store.replaceReducer(nextRootReducer);
  });
}


feat: full-context search

Hi, I'm incredibly new to svelte (only from tinkering with this project, and this is my first PR) and also not too familiar with github (this is my first ever PR). That said, I think I've done this properly, and the changes I've made are relatively minor.
This PR is to update the chat search functionality in the sidebar so that it searches the content of conversations, in addition to the titles.

LGTM, Thanks!


python311Packages.zha-quirks: 0.0.104 -> 0.0.105

Diff: https://github.com/zigpy/zha-device-handlers/compare/refs/tags/0.0.104...0.0.105
Changelog: https://github.com/zigpy/zha-device-handlers/releases/tag/0.0.105
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.11 Release Notes (or backporting 23.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 260509 run on x86_64-linux 1

11 packages built:

home-assistant-component-tests.hassio
home-assistant-component-tests.homeassistant_green
home-assistant-component-tests.homeassistant_hardware
home-assistant-component-tests.homeassistant_sky_connect
home-assistant-component-tests.homeassistant_yellow
home-assistant-component-tests.otbr
home-assistant-component-tests.zha
python310Packages.zha-quirks
python310Packages.zha-quirks.dist
python311Packages.zha-quirks
python311Packages.zha-quirks.dist


odeint(f) fails when f has a custom jvp

@mattjj @jessebett @duvenaud

Closing for now since it turns it's not necessary. Essentially it turns out the custom jvp wasn't really needed for a numerically stability, it was sufficient just to replace the forward implementation with the numerically stable one.


Schema -> Schema doesn't preserve all descriptions

See #521

Good job me for not adding a test case.

I just fixed a description issue, and all descriptions in our descriptions.schema test case are carried over, so I'll call this closed.


make docs discoverable

I can't find a link to the rendered docs in this repo or in test-infra/prow
whenever these are ready for consumption, we should add links
github allows configuring a link on the repo itself which would make sense here, I'd also suggest that we customize the README in this repo with more details and place a prominent link to this repo and the rendered docs in test-infra/prow/README.md

Indeed!
/close


[QA] - CLI - Add Blocked Reasons

The Partition key column name is not properly visible

Helper text should be visible on the Cookie summary page.

Report download button is not working.

cc: @ayushnirwal

The Partition key column name is not properly visible. Need to resize the column then the name is visible. width is very less due to that the column name is not readable. Even if there is no data in the column the column name should be properly visible.

On the Cookie Summary page, there should be "i"(helper text) should be visible similar to extension summary page.

On click on Download report button, the error is visible

Helper text should be visible on the Cookie summary page.

Report download button is not working.

Both of the items mentioned above are now fixed in the PR #435

The Partition key column name is not properly visible

This item will be fixed by PR #401

Hi @ayushnirwal, In the output.csv file the Partition key column is not visible.

Also, the blocked reason is visible in the affected cookies as well. So Partition key column should be available in affected cookies table as well?

Verified the above fixes and those seems fixed and working fine.
cc: @ayushnirwal

Addressed and released as a part of v0.5


116 kruskal's algo

Fixed issue no #116
👨💻 Changes proposed

✔ Check List (Check all the applicable boxes)

[x] My code follows the code style of this project.
[x] This PR does not contain plagiarized content.
[x] The title of my pull request is a short description of the requested changes.

📄 Note to reviewers

Added code for Kruskal's Algorithm in C++, Kindly review the PR @Kumar-laxmi
📷 Screenshots

@Piyush-onGIT Kindly do the required changes within a week or else this PR will be closed


Prevent clone protocol button flash on page load

Previously, the saved active button would flash up on page load because of the inherent delay involved in JS execution which is required for this localStorage setting. Prevent these flashes by disabling transitions on page load on the buttons and run the script that activates the button right after.
It's not an ideal solution (which would require server-side storage of user settings like this) but I'd say better than before.

Ready for review, it's not a pretty fix but it works pretty well and there is no real way around a inline script in this case unfortunately.


AttributeError: attribute 'default' of 'typing.TypeVar' objects is not writable

What happened?
I am using AutoEIS, which uses impedance.py, which calls altair - the following error happens:

> Traceback (most recent call last):
>   File "/home/bketter/csteis_working/11012024_NA2SO40pt1_FESO40pt001_NpH4_no6/autoeis_runscript_11012024_NA2SO40pt1_FESO40pt001_NpH4_no6.py", line 7, in <module>
>     import autoeis as ae
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/autoeis/__init__.py", line 6, in <module>
>     from .utils import Settings as _Settings
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/autoeis/utils.py", line 46, in <module>
>     from impedance.models.circuits import CustomCircuit
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/impedance/models/circuits/__init__.py", line 2, in <module>
>     from .circuits import *  # noqa: F401, F403
>     ^^^^^^^^^^^^^^^^^^^^^^^
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/impedance/models/circuits/circuits.py", line 3, in <module>
>     from impedance.visualization import plot_altair, plot_bode, plot_nyquist
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/impedance/visualization.py", line 1, in <module>
>     import altair as alt
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/__init__.py", line 650, in <module>
>     from altair.vegalite import *
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/vegalite/__init__.py", line 2, in <module>
>     from .v5 import *
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/vegalite/v5/__init__.py", line 2, in <module>
>     from altair.expr.core import datum
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/expr/__init__.py", line 7, in <module>
>     from altair.expr.core import ConstExpression, FunctionExpression
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/expr/core.py", line 6, in <module>
>     from altair.utils import SchemaBase
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/utils/__init__.py", line 14, in <module>
>     from .plugin_registry import PluginRegistry
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/altair/utils/plugin_registry.py", line 13, in <module>
>     T = TypeVar("T")
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/typing_extensions.py", line 1418, in __new__
>     _set_default(typevar, default)
>     ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^
>   File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/typing_extensions.py", line 1375, in _set_default
>     type_param.__default__ = None
>     ^^^^^^^^^^^^^^^^^^^^^^
> AttributeError: attribute '__default__' of 'typing.TypeVar' objects is not writable/

What would you like to happen instead?
I would like altair to import successfully. I am not capable of understanding the issue or articulating it further, but I'm sure this would be very simple for the developers to understand. Pardon the lack of information.
Which version of Altair are you using?
5.4.1

downgrading to 5.3.0 made the issue go away

Hi @benjamin5988, what version of Python are you using? There is known incompatibility with Python 3.13. We'll be doing an altair 5.5.0 release that will support Python 3.13 soon.

@jonmmease I linked this one in a bit of a rush yesterday after noticing 3.13 in the error output:

  File "/home/bketter/csteis_working/11012024_NA2SO40pt1_FESO40pt001_NpH4_no6/autoeis_runscript_11012024_NA2SO40pt1_FESO40pt001_NpH4_no6.py", line 7, in <module>
    import autoeis as ae
  File "/home/bketter/.conda/envs/csteis_4/lib/python3.13/site-packages/autoeis/__init__.py", line 6, in <module>
```                                            ^^^^^^^^^^

Closing, following https://github.com/vega/altair/pull/3699
@benjamin5988 please update to https://github.com/vega/altair/releases/tag/v5.5.0

Closing, following https://github.com/vega/altair/pull/3699
@benjamin5988 please update to https://github.com/vega/altair/releases/tag/v5.5.0


[BUG] Identifier _id is converted to id by ANTLR parser

What is the bug?
For some reason, underscore in a query is ignored by ANTLR parser. Take the query in our doc for example, _id becomes id after parsing. This caused no fallback happen and failure in v2 engine since metadata field is not supported yet.
How can one reproduce the bug?
PUT sql-test/_doc/1
{
  "name": "John",
  "age": 10
}

POST _plugins/_sql
{
  "query" : """
    SELECT * FROM sql-test WHERE _id = 1
  """
}

org.opensearch.sql.exception.SemanticCheckException: can't resolve Symbol(namespace=FIELD_NAME, name=id) in type env
	at org.opensearch.sql.analysis.TypeEnvironment.resolve(TypeEnvironment.java:57) ~[core-<IP_ADDRESS>-SNAPSHOT.jar:?]
	at org.opensearch.sql.analysis.ExpressionAnalyzer.visitIdentifier(ExpressionAnalyzer.java:323) ~[core-<IP_ADDRESS>-SNAPSHOT.jar:?]
	at org.opensearch.sql.analysis.ExpressionAnalyzer.visitQualifiedName(ExpressionAnalyzer.java:297) ~[core-<IP_ADDRESS>-SNAPSHOT.jar:?]
	at org.opensearch.sql.analysis.ExpressionAnalyzer.visitQualifiedName(ExpressionAnalyzer.java:73) ~[core-<IP_ADDRESS>-SNAPSHOT.jar:?]
	at org.opensearch.sql.ast.expression.QualifiedName.accept(QualifiedName.java:111) ~[core-<IP_ADDRESS>-SNAPSHOT.jar:?]
	at org.opensearch.sql.analysis.ExpressionAnalyzer.analyze(ExpressionAnalyzer.java:90) ~[core-<IP_ADDRESS>-SNAPSHOT.jar:?]

What is the expected behavior?
User can use _id without issue for backward compatibility.
What is your host/environment?

Version 2.4.0

Do you have any additional context?
Not clear when is this broken. It is missed because all 5 IT on it are ignored. Because it's used in our documentation, we'd better fix it or the doc soon.

I think these might be related issues:
https://github.com/opensearch-project/sql/issues/639
https://github.com/opensearch-project/sql/issues/783
https://github.com/opensearch-project/sql/issues/339

@MitchellGale-BitQuill Thanks for the info! It's strange that the example query has been used in documentation since 1.0. However, I tested it and found same problem with 1.0 docker. Need to confirm and see if we need to fix in code or in doc.

We would need to extend the parser like: Bit-Quill#142 Not sure if that's the direction we want to take this since this doesn't apply to other storage types

yes, because of the backward compatibility, I think we need to support it. Otherwise users have to always back quote although it is more ANSI SQL standard. For other storages, I think it's fine and please see "hidden" columns in Presto Hive connector: https://prestodb.io/docs/current/connector/hive.html#extra-hidden-columns. Analyzer is supposed to throw exception if _id is used with S3 table because S3 storage doesn't return such column in getFieldTypes interface. The only drawback is it's semantic error rather than syntax error because we allow it in ANTLR grammar.

Good to know.  We'll push that PR forward since it solves a few bugs.
If, moving forward, we want a different solution for other storage engines, we can refactor later.

@dai-chen this can be closed as part of https://github.com/opensearch-project/sql/pull/1456
We now consider any field with _ so long as the field isn't reserved by OpenSearch.
Certain reserved fields are now supported (_id, _index, _score, _sort, _maxscore).


[SANDBOX PROJECT ONBOARDING] Bank-Vaults

Welcome to CNCF Project Onboarding!
This is an issue created to help onboard your project into the CNCF after the TOC has voted to accept your project into the Sandbox.
We would like your project to complete onboarding within one month of acceptance.
Please track your progress by using "Quote reply" to create your own copy of this checklist in an issue, so that you can update the status as you finish items.
Review and understand

[ ] The Technical Leadership Principles that outlines the expected behavior for any maintainer in a leadership role.
[ ] The project proposal process and requirements.
[ ] The services available for your project at the CNCF.
[ ] The CNCF IP Policy.
[ ] The trademark guidelines.
[ ] The license allowlist.
[ ] The online program guidelines.
[ ] Optional: Book time with CNCF staff for any onboarding questions.

Contribute and transfer

[x] Move your project to its own separate neutral GitHub organization. This will make it transferable to the CNCF's GitHub Enterprise account. If it's already in a GHE account, you will need to remove it from that first.
[x] Accept the invite to join the CNCF GitHub Enterprise account. We'll then add thelinuxfoundation as an organization owner to ensure neutral hosting of your project.
[x] Migrate your Slack channels (if any) to the Kubernetes or CNCF Slack workspace. CNCF staff can help.
[ ] Submit a pull request to add your project as a Sandbox project to the Cloud Native Landscape by updating landscape.yml following these instructions.
[ ] Transfer your domain to the CNCF. The "LF Stakeholder email" is<EMAIL_ADDRESS>[ ] Transfer any trademark and logo assets to the Linux Foundation.
[x] Submit a pull request with your artwork.
[ ] Transfer website analytics to<EMAIL_ADDRESS>CNCF staff can help.

Update and document

[x] Ensure that DCO (preferred) or CLA are enabled for all GitHub repositories of the project.
[x] Ensure that that the CNCF Code of Conduct (or your adopted version of it) are explicitly referenced at the project's README on GitHub.
[ ] Ensure LF footer is on your website and guidelines are followed (if your project doesn't have a dedicated website, please adopt those guidelines for the README file).
[ ] Create a maintainer list and add it to the aggregated CNCF maintainer list via pull request.
[ ] Provide emails for the maintainers to get access to the maintainers mailing list and Service Desk. Email them to<EMAIL_ADDRESS>[ ] Start working on written, open governance.
[x] Start on an OpenSSF Best Practices Badge.

CNCF staff tasks

[x] Add the project to DevStats.
[x] Add the project to LFX Insights. This is done by adding a read-only app to your GitHub organization once it's in CNCF GHE.
[ ] Add a license scanning tool, like FOSSA or Snyk.
[ ] Send a welcome email to confirm maintainer list access.

Progress update:

✅ PR-submitted for cncf/landscape. (https://github.com/cncf/landscape/pull/4102)
✅ No analytics on the website as of now.
✅ Website updated with LF Footer. (https://github.com/bank-vaults/bank-vaults.dev/pull/236)
✅ PR submitted for adding maintainers list to cncf/foundation repo. (https://github.com/cncf/foundation/pull/877)
✅ Written open-governance was added in https://github.com/bank-vaults/.github/pull/16


Can you use Typescript with CodeQL actions?

Can you use Typescript with CodeQL actions? If so can you provide a code snippet (yaml)?

https://github.com/github/codeql-action#usage shows an example workflow file. You can also go to your repository and click "set up code scanning" and it'll generate a workflow file for you.
To analyse typescript set the languages input to javascript as CodeQL analyses both javascript and typescript together.
I hope this answers your question so I'll close this issue. If not then feel free to reopen the issue.

https://github.com/github/codeql-action#usage shows an example workflow file. You can also go to your repository and click "set up code scanning" and it'll generate a workflow file for you.
To analyse typescript set the languages input to javascript as CodeQL analyses both javascript and typescript together.
I hope this answers your question so I'll close this issue. If not then feel free to reopen the issue.


Feedback

Feedback Content:
how its work?
i cant this run !
help
https://cors.conchbrain.club/?https://tc-005.agetcdn.com/1ab5d45273a9183bebb58eb74d5722d8ea6384f350caf008f08cf018f1f0566d0cb82a2a799830d1af97cd3f4b6a9a81ef3aed2fb783292b1abcf1b8560a1d1aa308008b88420298522a9f761e5aa1024fbe74e5aa853cfc933cd1219327d1232e91847a185021b184c027f97ae732b3708ee6beb80ba5db6628ced43f1196fe/7acdefb801d5ba8d961289d3a1662543/ep.12.1677598129.m3u8

Because the server will not be streaming requests, it cannot handle requests with long response bodies.

"it cannot handle requests with long response bodies."
What should I do?)

You can embed videos directly in your website using the video tag, which is not limited by the CORS policy.

can see this code? example

no


FastGQL first version roadmap

Hello, fastGQL users, this is a basic roadmap to complete before releasing first version of fastgql.

[ ] Support Full CRUD

[x] select support
[x] insert support #21
[x] delete support #22
[ ] update support

[ ] Support Aggregate functions (max, sum, min, count)
[ ] Generation tests
[ ] SQL builder tests #17
[ ] Cursor Pagination support
[ ] Better docs (how to guides, adding custom scalars, custom operators, etc')
[ ] Define better relation directives
[ ] Code cleanup and documentation

if you have any suggestions or feature requests, you can add to this thread or open feature request issues depending on complexity/importance will add it to the roadmap

@roneli Thanks, do you have any plan to have generator with some kind of popular orm such as https://gorm.io/?
When we use an orm, all the relation (has one, has many, belong to...) are configured already. It is quite redundant to declare them again in the graphql schema

Thanks, do you have any plan to have generator with some kind of popular orm such as https://gorm.io/? When we use an orm, all the relation (has one, has many, belong to...) are configured already. It is quite redundant to declare them again in the graphql schema

@namnm Yeah, I agree that it would be pretty handy. GORM is a useful tool not only because of its association support but also auto migration and much more.
Unfortunately, fastGQL is currently based on the pgx, which as far as I know is incompatible with the generic sql.DB interface used in GORM. I would consider switching to it as it is supported in most orms/db oriented libs.

@roneli Thanks, do you have any plan to have generator with some kind of popular orm such as https://gorm.io/? When we use an orm, all the relation (has one, has many, belong to...) are configured already. It is quite redundant to declare them again in the graphql schema

In general, GORM won't work well here, its inefficient as its query building and can't support injecting count aggregates, relational filters etc' easily, I am sure it can be done, but it will require a lot of work and some workarounds.
The core idea of the fastGQL is to be a lightweight extension of gqlgen and allowing the user to supplement his gqlgen but also do this own thing + SDL approach which allows more control than DB schema approach.

Thanks, guess we may need to create a fork from your repo to work with gorm.

Thanks, guess we may need to create a fork from your repo to work with gorm.

@namnm Not really. I can work over the weekend on moving to the generic sql.DB interface and propose my solution to @roneli. Then he will decide what to do with it.
If he accepts it, you would have opportunity to add GORM to your project like so. I will also try to make filter, sort and pagination queries reusable with different query executors. This feature would make fastGQL more extendable and allow to use this excellent tool not only with GORM but all sort of db oriented libs.

If i understand correctly i don't need dataloader with this, right?

If i understand correctly i don't need dataloader with this, right?

No you don't, it transforms the whole GraphQL query to an equiv SQL query. So all requested data is returned in one execution, and it just auto resolves from there. Obviously you can add more logical gqlgen stuff on top of it if you desire.


Remove redirect of test:mocha:multireport to test:mocha, which are no longer necessary

After #16913, the separate *:report script for mocha test is no longer necessary. clean those up.
Also, disable test:mocha script in devtools-view and devtools-browser-extension as they are broken (and wasn't ran in the CI previously because they don't have test:mocha:multireport script.

ADO work items tracking fixing the tests and associated scripts in devtools-view and devtools-browser-extension: ADO#5413 and ADO#5414.


Feature/voucher sets

Code ported from contribution by @mvantellingen
Adds support for managing large amounts of vouchers grouped in sets.

Please rebase remote branch and resolve conflicts.

rebased and pushed

Now it needs to re-generate migrations due to the conflict.

regenerated migrations

Looks good in general, just needs at least some documentation of voucher set purpose and usage. Would you add it?

Oscar seems to lack such documentation generally - at least I couldn't find much, but I've added some explainations in the model and rst file for vouchers.

Thanks. It looks good now.


Fix invalid list vol tag

The bool flag returns by ListVolumesForPod is not for error, it means found.
We did not see this bug in local test because there's always a volume (secret vol for serviceAccount), but when tested on pkt when serviceAccount is disabled, it will fail.

Cool. LGTM


Introduce TypeScript-based map config (resolves #324)

Resolves #324.
I have left the old map.json in place, so as to avoid making a breaking change. We should remove map.json in the next major release of @veupathdb/web-components.

sigh I suppose removing it would incur a major version update.

I'll open an issue for removing map.json during the next major version update. (Whenever that ends up being.)


Open Task Scheduler

Is there a simple, consistent way to open the Task Scheduler itself from C# or VB.Net, no matter what OS you're on? I thought this would work on any system, but it doesn't on Windows 7, although it works on XP:
For Each oTask As TaskScheduler.Task In ts.RootFolder.Tasks
bTasksFound = True
   Process.Start("explorer.exe " & jnFunctions.jnGetDirectoryPathPart(oTask.Path))
'Just run once
  Exit For
Next
Start, Run commands available:
Windows 7: "task"
XP: "control schedtasks"
Vista: "taskschd.msc"
Any ideas for something consistent?
Thanks!
Originally posted: 2011-01-19T16:45:03

I am not 100% confident, but I believe the following code should work on all versions XP and later:
Process.Start("control.exe", "schedtasks");
Originally posted: 2011-01-19T21:19:11

Just a follow-up to this, there appears to not be one command that works on all machines (which is quite dumb of Microsoft). Stuff like this baffles me. There's no reason to not have an API for this.
That said, I simply created Select Case code based on the OS, and I call different commands for different OS. As a backup, I have an INI setting that can be configured if none of my built-in logic works.
Thanks.
Originally posted: 2011-01-24T13:15:14

If you will post that code, I will include it in the library in the TaskService class as a static method.
Originally posted: 2011-01-24T15:08:59


No Dark mode

The website doesn't have a dark mode. I'd be more than happy to implement it and open a PR. Let me know if that's alright :)

sure @virejdasani. you can create a PR for it

@ankitsaxena21, done, https://github.com/ankitsaxena21/Food-Ordering-App/pull/21


Add minimal unit tests

Right now there are just a couple of actual tests in the test/ folder, and they leave huge portions of the code untouched.
Eventually, we will need a suite of unit tests and comprehensive integration tests that reasonably convince us that a new change won't break anything. We'll also want to integrate with CircleCI and github so that we can evaluate pull requests from the web (but that will come later).
I'll try to update this issue with our progress as time goes on, but a good start would be unit tests for:

each hyperpartition for each classification method
each database.py create/query/update function
hyperpartition enumeration
hyperpartition selection/parameter tuning
metric computation in metrics.py
data loading and encoding with a variety of quirky data types
serialization/deserialization of models/metrics objects

Hey guys, I want to Help with the unit tests. Which one is the easiest class to start??

Hey @takabayashi, thanks for your interest in helping. The metrics are pretty self contained and could be a good place to start. The database functionality is straightforward if you can get the mocking done properly. And the utilities have a variety of isolated functions that could be tested.

Ok great I will try to build the environment, any problem I'II post here...thanks!


Moment with DD/MM/YYYY format is unusable

Environment

Tech
Version

material-ui-pickers
1.0.0-rc.2

material-ui
1.0.0-beta.37

React
16.2.0

Browser
N/A

Platform
N/A

Steps to reproduce
Just use a plain DatePicker with date format DD/MM/YYYY and allowing keyboard input. Setup material-ui-pickers with moment.
https://codesandbox.io/s/23qqkp07wp
Expected behavior
When typing in a field, I expect the field content to be what I typed.
E.g.: if I'm going to type 01/01/2018, and I start typing 0, I expect the field content to display 0.
Actual behavior
After having typed 1, the field updates to 01/03/2018.
Live example
https://codesandbox.io/s/23qqkp07wp
Root cause
By default, moment() will parse pretty much anything, including the "1" string. Fortunately, you can ask moment to be strict in its parsing. To solve the issue, I monkey patched parse:
MomentUtils.parse = function(value, formatString) {
  // This is to make sure we don't interpret strings such as "1"
  return moment(value, formatString, true)
}

Actual solution
I'm not sure if that would be the proper solution for the library though... I'm wondering if strict moment parsing should be the default. I'm opening this ticket to start a discussion.

Not working
https://codesandbox.io/s/3q90q3orj6
Just type '1'

PR


Go to definition fails on windows

whenever I try to go to the definition of a word using gd  I run into an error
; localhost:51602 (...gged\conjure/lua/conjure/client/clojure/nrepl/action.lua:337: Cursor position outside buffer): .nrepl-port

I have been facing this issue on windows I'm on conjure v4.45.0
when I enable conjure debugging this is the output I get
; def (word): first
; debug: send
{:id "167e1659-9cd2-4782-8b2e-518f31c9101a"
 :ns "snitch.core-test"
 :op "info"
 :session "16937673-286d-4ffa-a360-d9a77ec5bece"
 :symbol "first"}
; debug: receive
{:added "1.0"
 :arglists-str "[coll]"
 :column 1
 :doc "Returns the first item in the collection. Calls seq on its
    argument. If coll is nil, returns nil."
 :file "jar:file:/C:/Users/abhin/.m2/repository/org/clojure/clojure/1.10.3/clojure-1.10.3.jar!/clojure/core.clj"
 :id "167e1659-9cd2-4782-8b2e-518f31c9101a"
 :line 49
 :name "first"
 :ns "clojure.core"
 :resource "clojure/core.clj"
 :see-also ["clojure.core/rest"
            "clojure.core/next"
            "clojure.core/nth"
            "clojure.core/second"
            "clojure.core/take"
            "clojure.core/ffirst"
            "clojure.core/butlast"]
 :session "16937673-286d-4ffa-a360-d9a77ec5bece"
 :static "true"
 :status ["done"]}
; --------------------------------------------------------------------------------
; localhost:50264 (...gged\conjure/lua/conjure/client/clojure/nrepl/action.lua:337: Cursor position outside buffer): .nrepl-port

This looks like the issue as I suspected: :file "jar:file:/C:/Users/abhin/.m2/repository/org/clojure/clojure/1.10.3/clojure-1.10.3.jar!/clojure/core.clj"
The path may need a different prefix and I'm not sure if we need different slashes for Windows in this case too. This works for me (different Clojure version but still):
nvim zipfile:///home/olical/.m2/repository/org/clojure/clojure/1.11.1/clojure-1.11.1.jar::/clojure/core.clj

Which of these work for you, if any? (also notice how it should be clojure/core.clj, not /clojure/core.clj)
# Correct path with no prefix slash.
nvim zipfile://C:/Users/abhin/.m2/repository/org/clojure/clojure/1.10.3/clojure-1.10.3.jar::clojure/core.clj

# Not sure if windows requires double backslashes like this or just one?
nvim zipfile://C:\\Users\\abhin\\.m2\\repository\\org\\clojure\\clojure\\1.10.3\\clojure-1.10.3.jar::clojure\\core.clj
nvim zipfile://C:\Users\abhin\.m2\repository\org\clojure\clojure\1.10.3\clojure-1.10.3.jar::clojure\core.clj

Also if you're using AstroNvim I just realised that it disables the zip plugin required to read .jar files by default, I overrode this and shorted the disabled plugins list with this:
 :lazy {:defaults {:lazy false}
        :dev {:path "~/repos/Olical"}
        :performance {:rtp {:disabled_plugins ["tohtml" "netrwPlugin"]}}}

Also you should get some output when running :let zipPlugin_ext if you have the required zip plugin loaded. If not, maybe something is disabling it because it's a builtin feature.

hey, sorry for the late reply. I tried the following
nvim zipfile://C:\\Users\\abhin\\.m2\\repository\\org\\clojure\\clojure\\1.10.3\\clojure-1.10.3.jar::clojure\\core.clj
nvim zipfile://C:\Users\abhin\.m2\repository\org\clojure\clojure\1.10.3\clojure-1.10.3.jar::clojure\core.clj
nvim zipfile:\\C:\Users\abhin\.m2\repository\org\clojure\clojure\1.11.0\clojure-1.11.0.jar::\clojure\core.clj
nvim zipfile://C:\Users\abhin\.m2\repository\org\clojure\clojure\1.11.0\clojure-1.11.0.jar::\clojure\core.clj

and they didn't work for me.
go to definition doesn't work within the same repository as well. AFAIK windows paths either require \ backslashes or double forward slashes //

If someone can give me a zipfile path that works on their windows machine I can make sure Conjure uses that, I don't have access to Windows right now though and don't know how to run nvim on it anyway. Like aren't there two very different ways Windows users could be using Neovim on windows?
As I understand it there's:

WSL (which is just a Linux VM being passed through)
The cmd prompt thing (which is full on windows with backslashes everywhere)
Gitbash prompts etc where they sort of mimic unix-y stuff on windows.

I'm not sure how the paths should look on each or if the protocol slashes should be :// on EVERY platform no matter what 🤔
If someone can give me a good path I can integrate that, I just don't know what it should be right now.


Hot fix - ml_ops.sh not using passed parameter tolerance, always using /etc/duxbay.conf

Aims to close https://github.com/Open-Network-Insight/open-network-insight/issues/72
Changed ml_ops to validate if variable $3 is empty and if not, assign the value to variable TOL.
if [ $3 != '' ]; then TOL=$3 ; fi export TOL

I would change the validation to :
[ [ -n "$3" ]; then TOL=$3 ; fi export TOL

@EverLoSa I made a change to implement your suggestion.

this one has been tested I take it, as part of your dns feedback tests?

@NathanSegerlind Yes, I actually merged this branch into intelml_feedback to test.


Tests failing on macOS

Hi! Thanks for the wonderful package, but I have a problem on macOS. I tried to perform export to svg example and faced the error No such file or directory.
Then I ran your tests and faced the same error
running 24 tests
test attributes::tests::test ... ok
test parser::test::edge_test ... ok
test parser::test::attr_test ... ok
test parser::test::comments_test ... ok
test parser::test::attr_stmts_test ... ok
test parser::test::edge_stmt_test ... ok
test parser::test::attr_list_test ... ok
test parser::test::node_test ... ok
test parser::test::node_id_test ... ok
test printer::tests::attr_test ... ok
test parser::test::vertex_test ... ok
test printer::tests::edge_test ... ok
test parser::test::stmt_test ... ok
test printer::tests::graph_attr_test ... ok
test parser::test::id_test ... ok
test printer::tests::graph_test ... ok
test printer::tests::node_id_test ... ok
test printer::tests::node_test ... ok
test parser::test::graph_test ... ok
test printer::tests::subgraph_test ... ok
test parser::test::graph_html_test ... ok
test tests::parse_test ... ok
test tests::exec_test ... FAILED
test tests::print_test ... ok

failures:

---- tests::exec_test stdout ----
thread 'tests::exec_test' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 2, kind: NotFound, message: "No such file or directory" }', src/lib.rs:194:12
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

failures:
    tests::exec_test

test result: FAILED. 23 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.02s

I tried running it with sudo and it didn't help.

Thanks. I will take a look shortly. I have not faced the issue since I have been working on a Windows environment but apparently it means I will need to test it on the different envs.

Sorry it was my fault - I didn't notice I need to have graphviz binary installed. That was the root of the problem. I am closing this issue.

Ah.Right. But that is a good point. I will add a note about that  into readme.

I was in the readme - last line)

btw, I think you need to add tested version. Because for the lates version of graphviz dot - graphviz version 6.0.1 (20220911.1526) your tests are failing:
running 24 tests
test attributes::tests::test ... ok
test parser::test::edge_test ... ok
test parser::test::node_id_test ... ok
test parser::test::comments_test ... ok
test parser::test::attr_test ... ok
test parser::test::attr_list_test ... ok
test parser::test::attr_stmts_test ... ok
test parser::test::edge_stmt_test ... ok
test parser::test::graph_test ... ok
test parser::test::node_test ... ok
test parser::test::vertex_test ... ok
test printer::tests::attr_test ... ok
test parser::test::id_test ... ok
test parser::test::stmt_test ... ok
test printer::tests::edge_test ... ok
test printer::tests::graph_attr_test ... ok
test printer::tests::node_id_test ... ok
test printer::tests::node_test ... ok
test printer::tests::graph_test ... ok
test printer::tests::subgraph_test ... ok
test parser::test::graph_html_test ... ok
test tests::parse_test ... ok
test tests::print_test ... ok
test tests::exec_test ... FAILED

failures:

---- tests::exec_test stdout ----
thread 'tests::exec_test' panicked at 'assertion failed: `(left == right)`
  left: `"<?xml version=\"1.0\" encoding=\"UTF-8\" standalone=\"no\"?>\n<!DOCTYPE svg PUBLIC \"-//W3C//DTD SVG 1.1//EN\"\n \"http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd\">\n<!-- Generated by graphviz version 2.49.3 (20211023.0002)\n -->\n<!--  Generated by graphviz version 6.0.1 (20220911.1526)\n -->\n<!--  I need to rewrite this test. Thanks.


Run npm audit fix to resolve package vulnerabilities

The Problem
npm audit reports 3 moderate security vulnerabilities, 2 in semver and 1 in word-wrap:
$> npm audit
# npm audit report

semver  6.0.0 - 6.3.0 || 7.0.0 - 7.5.1
Severity: moderate
semver vulnerable to Regular Expression Denial of Service - https://github.com/advisories/GHSA-c2qf-rxjj-qqgw
semver vulnerable to Regular Expression Denial of Service - https://github.com/advisories/GHSA-c2qf-rxjj-qqgw
fix available via `npm audit fix`
node_modules/eslint-plugin-import/node_modules/semver
node_modules/eslint-plugin-jsx-a11y/node_modules/semver
node_modules/eslint-plugin-react/node_modules/semver
node_modules/semver

word-wrap  *
Severity: moderate
word-wrap vulnerable to Regular Expression Denial of Service - https://github.com/advisories/GHSA-j8xg-fqg3-53r7
fix available via `npm audit fix`
node_modules/word-wrap
  optionator  0.8.3 - 0.9.1
  Depends on vulnerable versions of word-wrap
  node_modules/optionator

3 moderate severity vulnerabilities

To address all issues, run:
  npm audit fix

Solution
After running npm audit fix, there are no more security vulnerabilities reported by npm audit:
$> npm audit fix
// ...
$> npm audit
found 0 vulnerabilities

lgtm ;^)


Add support for multiple lifecycle rules

what

Add the ability to set multiple lifecycle rules on the bucket.

why

There are cases where multiple lifecycle rules are desired, which can be made different by tag and/or prefix.

/test all

/test all

/test all


pulseaudio: Add support for package configuration files.

In a fashion like udev's support, this patch allows configurations from packages
to be merged in to directories for PulseAudio to read from. Currently supported
directories are the alsa-mixer mdoule's profile-sets and paths.
This is accomplished by patching PulseAudio to read directories from environment
variables globally defined by NixOS rather from the data path in the Nix store.
Modules that support it (such as the alsa module) can still be configured at
runtime to use specific paths, this just changes the default paths.
The environment variables are only used if they're defined, as such the previous
behaviour can be reverted to if the variables are unset or NixOS isn't running.

I'm curious, when do those files needed? Any example of a package which can be added to environment?

An example package is https://github.com/xobs/pulseaudio-novena which is the main reason I've done this

So months later I've come back to this finally since the current patch is broken beyond belief outside my ARM machine.
Wrapping the pulseaudio binaries causes some grief, but ultimately isn't doable because some packages use 'cfg.pulseaudio.package' to run pulseaudio binaries, which wouldn't be the wrapped version. Instead I've dropped the environment variables patch and now just get pulseaudio to look in /share/pulse/alsa-mixer for the alsa-mixer data which is generated the same, this is done by editing the configure.ac file to change the defines.
The only other way to do this would be to get pulseaudio's alsa-mixer module to support taking an paths-dir argument. Indeed, some of the code looks to be set up for such a situation. Doing this would mean it'd go in the default.pa file generated. This would be the ideal situation, but it doesn't solve the issue for other modules.
I'll put up a patch in a week or so when I can test it out on my ARM machine where it actually needs to work.

27 days later I've pushed the newer cleaned up version, which works on my ARM machine. It's much simpler and does the job.

@Jookia It looks like this has gone under the radar for way too long… are you still interested in moving this forward?

On Sun, Dec 02, 2018 at 02:19:12AM -0800, Léo Gaspard wrote:

@Jookia It looks like this has gone under the radar for way too long… are you still interested in moving this forward?

Not any more, I don't use NixOS. If I have any other issues/PRs here
those should probably be closed too.

OK thank you! sorry for not having moved that forward when you were still willing to push it forward, and hope someone else will come upon this if they want the same thing :)


A.02.10.supported.languages

This issue has been extracted from the issue list on:https://ies-svn.jrc.ec.europa.eu/issues/2685
Comment
XPATH expression is missing
Proposed Change
Add XPATH reference

See #31 suggesting A.1.4 should become a summary test case
Add XPATH as per the schema defined in TG Annex A

Implemented in #31


Fix for a nil pointer exception

Pull Request Test Coverage Report for Build<PHONE_NUMBER>0
Details

0 of 1 (0.0%)  changed or added relevant line in 1 file are covered.
2 unchanged lines in 1 file lost coverage.
Overall coverage decreased (-0.09%) to 58.812%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

cmd/nic-configuration-daemon/main.go
0
1
0.0%

Files with Coverage Reduction
New Missed Lines
%

internal/controller/nicdevice_controller.go
2
77.14%

Totals

Change from base Build<PHONE_NUMBER>3:
-0.09%

Covered Lines:
1792

Relevant Lines:
3047

💛  - Coveralls


WIP: Add deprecation information for GetTypeInfo() and TypeInfo

We should probably also make the tool smart enough to not display this warning if the System.Type provided by the platform doesn't expose reflection APIs.
We can do this by either support a condition for deprecation that is based on whether other APIs exist (e.g. Type.GetMembers()) or by marking this issue as only relevant for specific target frameworks.

[ ] Ensure warning only triggers when replacement API is present
[x] Agree with @dotnet/fxdc that we're OK with deprecating these APIs
[x] Add tests

@dotnet-bot test this please


Hefty size

As mentioned here https://github.com/socketio/socket.io-client-cpp/issues/38 building a static library of this framework for iOS is about 60 MB when optimized. That's just too much !
The swift library in comparison:

has no dependency to other frameworks
consists of just 13 files (~ 100 KB)

This makes this framework quite less attractive than the swift library.
I chose this library over swift because of compatibility issues.

Static lib is usually much more fat than it actually takes in final app. Would you build your app to see how much the application size growth?

That's a very valid point! My app clocks in on just about 6 MB which is highly acceptable!


Surefire plugin fails on Unit test

ERROR] Please refer to /src/target/surefire-reports for the individual test results.
[ERROR] Please refer to dump files (if any exist) [date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.
[ERROR] The forked VM terminated without properly saying goodbye. VM crash or System.exit called?
[ERROR] Command was /bin/sh -c cd /src && /usr/lib/jvm/java-1.8-openjdk/jre/bin/java -jar /src/target/surefire/surefirebooter5672739373693424591.jar /src/target/surefire 2018-07-31T20-03-37_730-jvmRun1 surefire3913374855006871093tmp surefire_0373265438879250493tmp
[ERROR] Error occurred in starting fork, check output in log
[ERROR] Process Exit Code: 1

used wrong project


KissCartoon.sh

DO NOT REMOVE OR SKIP THE ISSUE TEMPLATE

[X] I understand that I will be blocked if I intentionally remove or skip any mandatory* field

Checklist

[X] I'm reporting a new site support request
[X] I've verified that I have updated yt-dlp to nightly or master (update instructions)
[X] I've checked that all provided URLs are playable in a browser with the same IP and same login details
[X] I've checked that none of provided URLs violate any copyrights or contain any DRM to the best of my knowledge
[X] I've searched known issues and the bugtracker for similar issues including closed ones. DO NOT post duplicates
[X] I've read the guidelines for opening an issue
[X] I've read about sharing account credentials and am willing to share it if required

Region
United States
Example URLs

Single Video: https://kisscartoon.sh/Cartoon/SpongeBob-SquarePants-Season-03.66421/Episode-008-Idiot-Box?id=47035

Provide a description that is worded well enough to be understood
https://kisscartoon.sh/Cartoon/SpongeBob-SquarePants-Season-03.66421/Episode-008-Idiot-Box?id=47035
Provide verbose output that clearly demonstrates the problem

[X] Run your yt-dlp command with -vU flag added (yt-dlp -vU <your command line>)
[X] If using API, add 'verbose': True to YoutubeDL params instead
[X] Copy the WHOLE output (starting with [debug] Command-line config) and insert it below

Complete Verbose Output
'https://kisscartoon.sh/Cartoon/SpongeBob-SquarePants-Season-03.66421/Episode-008-Idiot-Box?id=47035']

https://github.com/yt-dlp/yt-dlp/blob/master/CONTRIBUTING.md#is-the-website-primarily-used-for-piracy


Added symbol to identify fluent schema objects

As titled.
Thanks to this symbol, other libraries that accept validation objects, can directly accept fluent schema objects and call .valueOf internally.
This vastly improves the user experience and hides one of the most common mistakes that devs make with this library.
const S = require('fluent-schema')

const schema = S.object()
  .prop('foo', S.string())
  .prop('bar', S.number())

console.log(schema[Symbol.for('fluent-schema-object')]) // true

Once this pr is merged and released, I'll open a pr to Fastify to support this new feature.

Nice, I will look into ASAP

Thank you @delvedor!
This approach is nicer in order to understand if the object is a FluntSchema. Could be used here as well: https://github.com/fastify/fluent-schema/blob/0cb9d8999d8bbe502047857feca91014a8253ccc/src/utils.js#L2-L2
Apert that I'm fine to merge it, just let me know if you can change isFluentSchema as well.

Good point @aboutlo, done!


Trusted connection using pyodbc docker and kerberos not working

I try to connect to Windows hosted SqlServer using Windows Authentication from a docker.
My docker is based on Microsoft/mssql-docker/oss-drivers/pyodbc/
After configuring Kerberos and get a ticket with my Windows account:
kinit<EMAIL_ADDRESS>I can connect to the realm using my Windows account:
realm join <IP_ADDRESS> -U<EMAIL_ADDRESS>-v
But when I try to execute sql request using isql or pyodbc i have a timeout:
root@WIN-EC79CE70LCL:/etc# isql MSSQLTest -v
[S1T00][unixODBC][Microsoft][ODBC Driver 17 for SQL Server]Login timeout expired
[08001][unixODBC][Microsoft][ODBC Driver 17 for SQL Server]TCP Provider: Error code 0x2AF9
[08001][unixODBC][Microsoft][ODBC Driver 17 for SQL Server]A network-related or instance-specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instance name is correct and if SQL Server is configured to allow remote connections. For more information see SQL Server Books Online.
[ISQL]ERROR: Could not SQLConnect
odbc.ini:
[MSSQLTest]
Driver = ODBC Driver 17 for SQL Server
Server = SERVER.LOCAL,1443
Kerberos = Yes
Trusted_Connection=Yes
odbcinst.ini:
[ODBC Driver 17 for SQL Server]
Description=Microsoft ODBC Driver 17 for SQL Server
Driver=/opt/microsoft/msodbcsql/lib64/libmsodbcsql-17.0.so.1.1
UsageCount=1
Is my config wrong? Do I miss something? Or it is even possible to do what I want to do?

This isnt something we test or support right now.  We are looking into some AD/Kerberos authentication support in the future though.

Let's track this as an enhancement at #165


CI: OpenDAL v0.44.2-rc.1 pypi test publish failed

* `invalid-publisher`: valid token, but no corresponding publisher (All lookup strategies exhausted)

This generally indicates a trusted publisher configuration error, but could
also indicate an internal error on GitHub or PyPI's part.

We need to update the pypi setting

Fixed. Please try again.


Done column sort order should be reversed.

What
Reverse the order of the stories in the done column so that most recent is at the top.
Why
At standup we have started glancing/skimming the recently done as a last chance to flag anything interesting like "maybe this should be a knowledgeshare thing" before it is lost into the ether of done.
This is harder to do if the interesting new items are burried off the bottom of the page.
It's done when
Most recently done it at the top.

resolved by #40


Add PauseManager to API

Adds a component called PauseManager to the SDK. The intended use case is a multithreaded application that wishes to pause the SDK and wait for it to quiesce.
This is compatible with the current API: if nothing calls the PauseManager::PauseActivity() method, the only effect is to add a compare_and_exchange_weak call and test to some API methods, and everything works as it does today.
Once PauseActivity() is called, future (for the usual sequential-consistency definition of "future") calls to protected methods will return immediately. Past (again, by the sequential-consistency definition) calls are allowed to complete and return normally.
The PauseManger QuiesceWait and QuiesceWaitFor methods will block the calling thread until all in-flight API calls complete.

I am a bit concerned about adding the new class. Since it'd also require adding extra projections for all languages.
Why don't we introduce the following logic instead:

static LogManager::OnSuspending - this is also gonna address this ask: #271 , i.e. getting into safe suspendable state.
static LogManager::OnResuming - this brings the SDK back into functional state.
instance LogManagerImpl::Suspend
instance LogManagerImpl::Resume
plus, a way to register two lambda functions - platform-specific / PAL layer OS-specific routes, that would trigger the OnSuspending and OnResuming callbacks, that by-default may call into Suspend and Resume methods respectively. Maybe in PAL ... This is somewhat similar to what WinRT / Universal code has been doing for the Power Manager callbacks: https://github.com/microsoft/cpp_client_telemetry/blob/7e26c3964ad19186eff2be1026eabf7e65090fff/lib/pal/universal/WindowsRuntimeDeviceInformationImpl.cpp#L99

i.e. hiding PauseManager from user eyes / API surface almost entirely, only allowing the customers customize default per-platform behaviors by supplying custom OnSuspending and OnResuming. On Android and iOS this would have to be bound to corresponding lifecycle events in Java and Obj-C respectively.


Not working in Cordova 5.1.1<EMAIL_ADDRESS>

I just created a new project and added the plugin:
cordova create project actionBarTest && cd actionBarTest
cordova platform add android
cordova plugin add https://github.com/polychrom/cordova-android-actionbar.git
Cordova-android has changed now that it has a pluggable webview. Needed to change line 48 to:
final Activity ctx = cordova.getActivity();

and comment out line 692:
removeFilename(webView.getOriginalUrl())

I also added the requisite calls in the MainActivity.java:
@Override
    public void onCreate(Bundle savedInstanceState)
    {
      requestWindowFeature(Window.FEATURE_ACTION_BAR);
        super.onCreate(savedInstanceState);
        // Set by <content src="index.html" /> in config.xml
        loadUrl(launchUrl);
      getActionBar();
    }

However when I attempt to interact with the plugin, I am getting null when the code tries to get the actionbar:
final ActionBar bar = ctx.getActionBar();

Any ideas please?

Further investigation reveals that:
Log.d(LOG_TAG, "Window has action bar feature: " + getWindow().hasFeature(Window.FEATURE_ACTION_BAR));

reports that it does, but after:
super.onCreate(savedInstanceState);
super.init();

it does not. Unfortunately if you call java getActionBar()  before the onCreate() and init() calls you get an exception.

Ah nuts - the answer lies in line 107 of CordovaActivity.java:
        if(!preferences.getBoolean("ShowTitle", false))
        {
            getWindow().requestFeature(Window.FEATURE_NO_TITLE);
        }

If you don't have the pref <preference name="ShowTitle" value="true"/> in config.xml then Cordova switches the ActionBar right back off again :)

Note: you'll also need to change the Theme from @android:style/Theme.Black.NoTitleBar to @android:style/Theme.Black in your manifest.

I can't make it work too. I've done exactly the same as you all described here.
I've noticed the onMessage is never called unless I declare the plugin to be loaded at startup:
<feature name="ActionBar">
    <param name="android-package" value="com.polychrom.cordova.ActionBarPlugin" />
    <param name="onload" value="true" />
</feature>

But it crashes Cordova entirely.


improvementChange the hash field of the backend

Proposed changes
Issue Number: close #xxx
Problem summary
Describe your changes.
ip of backend may change
use id as a hash field
Checklist(Required)

[ ] Does it affect the original behavior
[ ] Has unit tests been added
[ ] Has document been added or modified
[ ] Does it need to update dependencies
[ ] Is this PR support rollback (If NO, please explain WHY)

Further comments
If this is a relatively large or complex change, kick off the discussion at<EMAIL_ADDRESS>by explaining why you chose the solution you did and what alternatives you considered, etc...

run buildall

TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 34.35 seconds
stream load tsv:          480 seconds loaded<PHONE_NUMBER>9 Bytes, about 148 MB/s
stream load json:         39 seconds loaded<PHONE_NUMBER> Bytes, about 57 MB/s
stream load orc:          74 seconds loaded<PHONE_NUMBER> Bytes, about 14 MB/s
stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
https://doris-community-test-1308700295.cos.ap-hongkong.myqcloud.com/tmp/20230307073930_clickbench_pr_109924.html

run feut

run feut

run p0

run buildall

LGTM

run p0


Allow use of "vN.NN.N" releases in DRAKE_COMMIT

This change is

Wow, I haven't even thought of lstrip.  I like it.
However, I think the WORKSPACE comments near "Or choose a specific revision of Drake to use." should explain the how-to-use-a-release-number option to users.

@jamiesnape Please double-check that this PR has only the expected failures, and then merge it.  Thanks!


Game over updates for multiplayer

Partially addresses https://github.com/microsoft/pxt-arcade/issues/513. One more change coming after this in a separate PR to modify the multiplayer extension.
This change adds new blocks for configuring game over, and adds support for multiplayer scoring.
New blocks

use effect: Set the effect that occurs when the game is over.
use sound: Set the music that occurs when the game is over.
use message: Set the message that displays when the game is over.
use scoring: Set the method of judging the best score for the game.
Modified blocks & block behaviors
game over: Deprecated the effect parameter on existing block.
on countdown end, on life zero: removed default sound and visual effect from game over dialog. They can be re-added using the new blocks above.
Single player examples

Multiplayer examples

It looks good to me too!


Requirements By Site

Hello,
I maybe missing something very simple here, but how can I do a requirement for the Configuration Manager Site?

Would it be as simple as?
<RequirementsRules>
	<RequirementsRule>
		<RequirementsRuleType>Value</RequirementsRuleType>
		<RequirementsRuleOperator>OneOf</RequirementsRuleOperator>
		<RequirementsRuleValue>
			<RuleValue>Configuration Manager site</RuleValue>
		</RequirementsRuleValue>
		<RequirementsRuleValue2>
			<RuleValue>CM1</RuleValue>
		</RequirementsRuleValue2>
		<RequirementsRuleGlobalCondition>Or</RequirementsRuleGlobalCondition>
	</RequirementsRule>
</RequirementsRules>


py_remote hostname length

Hello,
I am trying to execute a code remotely using py_remote(hostname, hints, code, recovery) and I happen to be working with hostnames which length might exceed 32 chars. When I launch py_remote I get
log_message: rstrcpy not enough space in destination buffer, source length:[33], destination length:[32];
resulting state of destination [x-yyyy-00xx77.xxyyy.leidenuniv.],
truncated from source [x-yyyy-00xx77.xxyyy.leidenuniv.nl]

Is this done deliberately? Many thanks in advance.

iRODS definitely supports hostnames longer than that. My guess is the implementation of py_remote needs a tweak, but we'll investigate to be sure.

Nice investigative work!
We'll get a fix in for the next release of the PREP.

Changing that value could break people's deployments and backwards compatibility, so we can't change it at this time.

Which one does the iRODS team prefer?

It's not clear which way to go at the moment. We need to confirm what the input requirements and expectations are for remote, py_remote, and parseHostAddrStr.


Enum Field names cannot end in underscore

<opc:DataType SymbolicName="EnumUnderscoreTest" BaseType="ua:Enumeration" ForceEnumValues="true">
  <opc:Fields>
    <opc:Field Name="x_x" Identifier="1"/>
    <opc:Field Name="_x" Identifier="2"/>
    <opc:Field Name="x_" Identifier="3"/>
    <opc:Field Name="_" Identifier="4"/>
  </opc:Fields>
</opc:DataType>

Number 1 and 2 is ok, but 3 and 4 are failing.
I believe this is a bug.

I see now that I should probably have reported this issue in the member only github repo.

Either works. Will look into it.

Pushed fixed


Multiple Typos

An event is published by adding C/AL function that is specifically set up as an event publisher.
Should be by adding a C/AL function

Trigger events are by predefined event publisher functions that are called automatically at runtime.
Should be Trigger events are predefined event

restrictions that you must follow, otherwise you not able to compile your code changes:
Should be otherwise you will not be able to compile

4a. Set the function Event Property to Publisher and the EventType Property to either Business or Integration.
4b. Set the function EventType Property to Business or Integration.
Should either delete line 4b or remove and the EventType Property to either Business or Integration in line 4a

that are defined in the other objects than publisher function object, set the Local Property to No.
Should be that are defined in other objects than the publisher function

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 07689958-6e86-fb5c-3540-cbbc6bf94704
Version Independent ID: b0023147-971a-f105-7c65-c40a124e9aae
Content: Publishing Events - Dynamics NAV
Content Source: dynamics-nav/Publishing-Events.md
Product: dynamics-nav-2018
GitHub Login: @jswymer

Thanks for the feedback! The issues have been fixed and will be available with the next update to the live site.

Another typo: "You can create a new object or use and existing object."
and -> an


Probability may not be accurate

current algorithm calculates probability via redistribution probability based on user input price falling into some price intervals and rule out those impossible ones, right? But I think this way may not be accurate. (still a good approximation)
say 100 for buy price and 85 on MonAM and last week is pattern3, it rule out pattern0 and redistribute. Total probabilities are:
pattern1 = 0.25*1   /(0.25*1+0.15*7/8+0.15*1)=0.47/7=0.0672each
pattern2 = 0.15*7/8 /(0.25*1+0.15*7/8+0.15*1)=0.28
pattern3 = 0.15*1   /(0.25*1+0.15*7/8+0.15*1)=0.247/7=0.0353 each

But for pattern 1 and 2 (they follow same rule on Mon so treat as one), it needs : rate = 0.85 for rate = randfloat(0.85,0.9)
and for pattern3, it needs: rate = 0.85 for rate = randfloat(0.4,0.9)
clearly the probability for pattern3 to get rate = 0.85 is much smaller(10 times) than pattern 1 and 2
using bayes equation it should be:
pattern1 = 0.25*0.01/(0.9-0.85) /( 0.25*0.01/(0.9-0.85)+0.15*0.01/(0.9-0.4)+0.15*0.01/(0.9-0.85))=0.602/7=0.0860 each
pattern2 = 0.15*0.01/(0.9-0.85) /( 0.25*0.01/(0.9-0.85)+0.15*0.01/(0.9-0.4)+0.15*0.01/(0.9-0.85))=0.361
pattern3 = 0.15*0.01/(0.9-0.4)  /( 0.25*0.01/(0.9-0.85)+0.15*0.01/(0.9-0.4)+0.15*0.01/(0.9-0.85))=0.0361/7=0.0051 each

or generally
P(pattern is k | input price is X) = P( X | k) *P(k) / sum(P( X | k) *P(k)) k from 0 to 3
key here is P( X | k), under pattern_k find probability of input price X, i think assuming X is uniformly distributed in calculated maxmin interval is a good start, since most of turnip price is generated by sellPrices[work++] = intceil(randfloat(A, B) * basePrice);, only for decreasing pattern like
rate = randfloat(0.9, 0.85);
    for (work = 2; work < peakStart; work++)
    {
      sellPrices[work] = intceil(rate * basePrice);
      rate -= 0.03;
      rate -= randfloat(0, 0.02);
    }

the price X = A-sum(B_k), A and B are uniform distributed but X is bell shape distributed

I think you're correct, it's not accurate. But my stats knowledge is pretty weak.
I would love to fix that, but it's going to take me some time to figure out how to code that - this is a great analysis to help with that.
Also very open to anyone else providing a PR to fix this :)

I'm working on the code, but know little about JS so can't help with PR. maybe Python or C++ ? or just pseudo code

Not a great statistician myself, but I agree the odds seem funky.
If last week was pattern 1 (high spike), the odds of each pattern is:

Pattern 0 (fluctuating) - 50%
Pattern 1 (high spike) - 5%
Pattern 2 (decreasing) - 20%
Pattern 3 (small spike) - 25%

But if we eliminate patterns 1 and 2, it follows that the new odds are:

Pattern 0 (fluctuating) - 66.67%
Pattern 3 (small spike) - 33.33%

However, if I put in the calculator large spike, buy_price = 100 and monAM = 105, it gives small spike odds of 7.69%!
I'm not certain how the script is calculating 7.69%, and 2.2% for the 42 possible Pattern 0's (fluctuating).
My pseudocode:
base_pattern0_odds = 0.50
base_pattern1_odds = 0.05
base_pattern2_odds = 0.20
base_pattern3_odds = 0.25

remaining_pattern0_patterns = x
remaining_pattern1_patterns = x
remaining_pattern2_patterns = x
remaining_pattern3_patterns = x

odds_denominator = 0
if remaining_pattern0_patterns > 0 then
     odds_denominator += base_pattern0_odds
if remaining_pattern1_patterns > 0 then
     odds_denominator += base_pattern1_odds
if remaining_pattern2_patterns > 0 then
     odds_denominator += base_pattern2_odds
if remaining_pattern3_patterns > 0 then
     odds_denominator += base_pattern3_odds

remaining_total_pattern0_odds = base_pattern0_odds / odds_denominator
remaining_total_pattern1_odds = base_pattern1_odds / odds_denominator
remaining_total_pattern2_odds = base_pattern2_odds / odds_denominator
remaining_total_pattern3_odds = base_pattern3_odds / odds_denominator

I'm not certain how the script is calculating 7.69%, and 2.2% for the 42 possible Pattern 0's (fluctuating).
I think the easiest way to illustrate current algorithm is:

choose last week pattern and using predefined probability
(0.5,0.05,0.2,0.15 for your example)
calculate all pattern and their subpattern and uniformly distribute to all subpattern
(there are 56 initial pattern 0 subpattern so you get 0.5/56=0.00893=0.893%)
everytime you input a price, it will rule out some impossible subpattern, and recalculate probability for each subpattern based their pervious probability
( after you input 105 to MonAM, there will only 42 of 56 pattern0 remain, 0 of 7 pattern1 remain, 0 of 1 pattern2 remain, and only 1 of 7 pattern3 remain, so you will have 420.893%/(420.893%+00.714%+020%+13.12%) / 42 = 0.0219 =2.20% for each pattern0
13.12%/(420.893%+00.714%+020%+13.12%) / 42 = 0.0767 = 7.67% for each pattern3, )

I think you may confused that only 1 of 7 pattern3 remain part, this is subpattern small spike with MonAM price between 90-140, not the overall small spike, it only has 1/7 of all pattern3 probability

Python code here, give current price, base price, and random bound ABCD to get corresponding probability
def get_uniform_prob(price,base,A,B):
    # sellPrices[work++] = intceil(randfloat(A, B) * basePrice);

    # it is uniform distribution
    if price >= int(np.ceil(A*base)) and price <= int(np.ceil(B*base)):
        return (1/base)/(B-A)
    else:
        return 0

def get_uu_prob(price,base,A,B):
    # rate = randfloat(A, B); sellPrices[work++] = intceil(randfloat(C, rate) * basePrice) - 1;

    # => X->U(A,B), Y->U(C,X), Y-C->U(0,X-A), Y-C->U(0,1)*(X-A), Y-C->U(0,1)*U(C-A,B-A)
    # luckly here A=C, let Z=Y-A/B-A,  Z->U(0,1)*U(0,1), Z is product of two 2 uniform distribution
    # pdf_Z = -log(z) cdf_Z = z-z*log(z)
    rate_max = ((price+1)/base-A)/(B-A)
    rate_min = ((price)/base-A)/(B-A)
    cdf = lambda z: 0 if z<=0 else z-z*np.log(z) if z<=1 else 1
    # def cdf(z):
    #     if z > 0:
    #         if z <=1:
    #             return
    #         else:
    #             return 1
    #     else:
    #         return 0
    return cdf(rate_max)-cdf(rate_min)

def get_bell_prob(price,base,A,B,C,D,L):
    # rate -= randfloat(A, B);
    # for (work = 2; work < L; work++)    {
    #   sellPrices[work] = intceil(rate * basePrice);
    #   rate -= randfloat(C, D);    }

    # X = U(A,B), Y_k = U(C,D), Z = X-sum(Y_k), sum(Y_k) follows irwin–hall distribution
    # cdf of z is not easy to get, so here i'm using numerical method
    rate_max = ((price)/base-A)/(B-A)
    rate_min = ((price-1)/base-A)/(B-A)
    price_max = np.ceil((B-C*L)*base)
    price_min = np.ceil((A-D*L)*base)

    pdf_X = np.ones(int((B-A)/0.001))/(B-A)
    pdf_Y = np.ones(int((D-C)/0.001))/(D-C)
    pdf = pdf_X
    for i in np.arange(L):
        pdf = np.convolve(pdf,pdf_Y)
    cdf = np.cumsum(pdf)
    margin = cdf.size/bins
    idx_start = int(np.ceil((price-price_min)*margin))
    idx_end = int(idx_start+margin)
    # idx_end = int(np.ceil((price+1-price_min)*margin))
    return (cdf[idx_end]-cdf[idx_start])/cdf[-1]

I'm not sure what the variables A, B, C, D and L refer to.
I do believe the prediction is inaccurate.
If only 1 out of 7 pattern3 remain, the overall odds that pattern3 is the correct pattern is unchanged, i.e. still 25%. And that 25% should now be redistributed amongst all remaining pattern3 subpatterns (so 25% / 1 = 25%). Instead, the algorithm would redistribute those odds to all patterns, which is incorrect. You cannot redistribute a patterns odds to the remaining unless all of the subpatterns are eliminated.

From the code itself I feel that you should redistribute a patterns odds to remaining even if there are some subpatterns left.

If only 1 out of 7 pattern3 remain, the overall odds that pattern3 is the correct pattern is unchanged, i.e. still 25%. And that 25% should now be redistributed amongst all remaining pattern3 subpatterns (so 25% / 1 = 25%). Instead, the algorithm would redistribute those odds to all patterns, which is incorrect.

I don't think it's true, the odds of getting pattern3 condition on your current input would change.
The python code looks good to be except the part that the range is actually uniform on the randfloat(A, B) part, not on ceil(Abase) and ceil(Bbase), so there might be a little inaccuracy from there. The current probability on master is definitely off though.
If no one take this, I can try to implement this tomorrow.

You cannot redistribute a patterns odds to the remaining unless all of the subpatterns are eliminated.

you confused probability with conditional probability, everytime you feel confusing, using bayes law:
P(pattern is 3| give MonAM price 90~140) = P(90~140 | pattern is 3) * P(pattern 3)/ P(90~140)
                                         = 1/8                      * 25% / (1/8*25% + 42/56*50%)
                                         = 1/13 = 7.69%

or even easier, take every subpattern as independent events,  it give same answer

the range is actually uniform on the randfloat(A, B) part, not on ceil(Abase) and ceil(Bbase)

you're right, I'm working on fixing that

tried to convert python function to js one, may have bug
function get_uniform_prob(price,base,A,B) {
  // sellPrices[work++] = intceil(randfloat(A, B) * basePrice);

  // it is uniform distribution
  var price_max = intceil(B*base)
  var price_min = intceil(A*base)
  var norm = 0
  if (price > price_min && price < price_max) {
    norm = 1
  }
  if (price == price_min) {
    n
```orm = price_min - A*base
  }
  if (price == price_max) {
    norm = B*base-price_max+1
  }
  return norm/base/(B-A)
}

function get_uu_prob(price,base,A,B) {
    // rate = randfloat(A, B); sellPrices[work++] = intceil(randfloat(C, rate) * basePrice) - 1;

    // => X->U(A,B), Y->U(C,X), Y-C->U(0,X-A), Y-C->U(0,1)*(X-A), Y-C->U(0,1)*U(C-A,B-A)
    // luckly here A=C, let Z=Y-A/B-A,  Z->U(0,1)*U(0,1), Z is product of two 2 uniform distribution
    // pdf_Z = -log(z) cdf_Z = z-z*log(z)
    var rate_max = ((price+1)/base-A)/(B-A)
    var rate_min = ((price)/base-A)/(B-A)
    var cdf = (z)=> {
      if (z > 0) {
        if (z <=1) {
          return z-z*Math.log(z)
        } else {
          return 1
        }
      } else {
        return 0
      }
    }
    return cdf(rate_max)-cdf(rate_min)
}

function conv(vec1, vec2){
  var disp = 0; // displacement given after each vector multiplication by element of another vector
  var convVec = [];
  // for first multiplication
  for (j = 0; j < vec2.length ; j++){
      convVec.push(vec1[0] * vec2[j]);
  }
  disp = disp + 1;
  for (i = 1; i < vec1.length ; i++){
      for (j = 0; j < vec2.length ; j++){
          if ((disp + j) !== convVec.length){
              convVec[disp + j] = convVec[disp + j] + (vec1[i] * vec2[j])
          }
          else{
              convVec.push(vec1[i] * vec2[j]);
          }
      }
      disp = disp + 1;
  }
  return convVec;
}

function get_bell_prob(price,base,A,B,C,D,L) {
    // # rate = randfloat(A, B);
    // # for (work = 2; work < L; work++)    {
    // #   sellPrices[work] = intceil(rate * basePrice);
    // #   rate -= randfloat(C, D);    }

    // # X = U(A,B), Y_k = U(C,D), Z = X-sum(Y_k), sum(Y_k) follows irwin–hall distribution
    // # cdf of z is not easy to get, so here i'm using numerical method
    var price_max   = intceil((B-C*L)*base)
    var price_min   = Math.max(intceil((A-D*L)*base),0)
    if (price>price_max || price< price_min){return 0}
    var bins        = price_max-price_min+1
    var pdf_X       = Array.from({ length: intceil((B-A)/0.001) }).fill(1/(B-A));
    var pdf_Y       = Array.from({ length: intceil((D-C)/0.001) }).fill(1/(D-C));
    var pdf         = pdf_X
    for (i=0; i<L; i++) {
        pdf = conv(pdf,pdf_Y)
    }
    const cumulativeSum = (sum => value => sum += value)(0); //cumsum
    cdf             = pdf.map(cumulativeSum)
    var margin      = cdf.length/bins
    var idx_start   = Math.max(intceil((price-price_min)*margin),0)
    var idx_end     = Math.min(Math.floor(idx_start+margin),cdf.length-1)
    return (cdf[idx_end]-cdf[idx_start])/cdf[cdf.length-1]
}

Realized (as in #103) that the price that would affect the rate range is not only the previous known one, so it might be hard to only use get_bell_prob to calculate the correct probability.
I'm currently working on using numerical methods all the way down to do this, would send a PR soon after I complete it.

I realized (as in #103) that the price other than the previous known one might also affect the rate range, so it might be hard to only use get_bell_prob to calculate the correct probability in some edge case.
I doubt, in bell shape distribute, the rate now(rate[n]) is only dependent on the last rate(rate[n-1]) rate[n] = rate[n-1] -randfloat(A,B) , not other history rate. It's true that rate[n-1] is dependent on rate[n-2], but once you input pirce[n-1] and derive rate[n-1], that random event is fixed and not conditional anymore


retry to print the chart with the refresh option, should the attempt with the refresh option fail

In the interest of efficiency, ChartMapGenerator uses the ChartMap class without the refresh option. Recall that the refresh option causes a helm dependency update command to be issued before processing the chart. This is usually used in cases where you want to be sure that that the chart dependencies are up-to-date but it is also useful in cases where the chart contains embedded sub-charts not found in any repo.
So add code that will retry to print the chart with the refresh option, should the first attempt fail. Log the fact that this is being done.

done


feat(*): add helm rollback functionality

This feature allows you to rollback release to the
previous version of release.
resolves #1004

This change is

googlebot, same team man

@googlebot confirm

@googlebot ok

TODO: accept a release version on the cli
ref #1244


OpenBL Bot Crash

2016-06-15 21:17:46Z openbl[17092] CRITICAL Traceback (most recent call last):
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/bot.py", line 308, in execute
2016-06-15 21:17:46Z openbl[17092] CRITICAL     return self.run()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/bot.py", line 417, in run
2016-06-15 21:17:46Z openbl[17092] CRITICAL     return idiokit.main_loop(throw_stop_on_signal() | self._run())
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/bot.py", line 406, in _run
2016-06-15 21:17:46Z openbl[17092] CRITICAL     yield self.lobby.offer(self.bot_name, service)
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/services.py", line 229, in offer
2016-06-15 21:17:46Z openbl[17092] CRITICAL     yield self.fork() | service.run()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/services.py", line 307, in run
2016-06-15 21:17:46Z openbl[17092] CRITICAL     state = yield self.errors | self.kill_sessions() | self.main(state)
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/bot.py", line 628, in main
2016-06-15 21:17:46Z openbl[17092] CRITICAL     cleanup, arg = yield self._poll_queue.wait()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/utils.py", line 448, in wait
2016-06-15 21:17:46Z openbl[17092] CRITICAL     yield waiter | idiokit.sleep(timeout)
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/services.py", line 325, in kill_sessions
2016-06-15 21:17:46Z openbl[17092] CRITICAL     yield idiokit.consume()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 735, in map
2016-06-15 21:17:46Z openbl[17092] CRITICAL     value = yield next()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 735, in map
2016-06-15 21:17:46Z openbl[17092] CRITICAL     value = yield next()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/services.py", line 340, in _guarded
2016-06-15 21:17:46Z openbl[17092] CRITICAL     state = yield session
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 354, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.send(peel_args(args)))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/bot.py", line 600, in feed
2016-06-15 21:17:46Z openbl[17092] CRITICAL     yield self.poll(*key) | self.dedup(key)
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 352, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.throw(*args))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/core/bot.py", line 570, in dedup
2016-06-15 21:17:46Z openbl[17092] CRITICAL     event = yield idiokit.next()
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/idiokit/idiokit.py", line 354, in _next
2016-06-15 21:17:46Z openbl[17092] CRITICAL     next = require_stream(self._gen.send(peel_args(args)))
2016-06-15 21:17:46Z openbl[17092] CRITICAL   File "/usr/lib/python2.6/site-packages/abusehelper/bots/openbl/openblbot.py", line 43, in _poll
2016-06-15 21:17:46Z openbl[17092] CRITICAL     ip, time = line.split()
2016-06-15 21:17:46Z openbl[17092] CRITICAL ValueError: need more than 1 value to unpack

Fixed in #64


Ta

Adding process state API
Adding IP for host path API
(origianl in my forch branch. Moved to a new branch called 'ta')


Write up section on how users set up their keypairs to SSH into instances and database

This is pretty straightforward. We need a section for the admin user setting everything up to actually get into their instances and database. In AWS, Security Groups define the inbound/outbound rules of everything.... therefore, we need to make sure inbound port 22 is opened up for the purposes of going through our guide.
It is obviously bad to leave port 22 open all of the time to the world, so we need to note how to tweak the security group to either a) not have 22 open unless you need to get in or b) ONLY allow a specific IP address in (i.e.: that of the admin user's computer). Either approach is good in terms of security!

 Let me know if you need access to the AWS if Daniel hasn't already hooked you up

For context, this step needs to be filled in: https://github.com/GoTeamEpsilon/OpenEMR-AWS-Guide#provision-the-server
We don't actually need a whole section for this. Going to change the name of the ticket.

Ths work is covered in our new issue/task tracker at https://app.asana.com/0/346554951567668/346554951567703


Add tagging when training with SQL storage

Closes #924

[ ] Tests

This is the pull request to add tags to statements, which will greatly increase efficiency on trained models, right?

@kyle-sorensen It will make it possible to do that. Other pull requests will need to be created after this one that apply filtering by tags database queries that retrieve possible response candidates.


Dose CameraCtrl support custom trajectory?

Thanks for the implement of CameraCtrl. According to the page of original CameraCtrl it supports custom trajectory. Wanna know is it supported in ADE?

Yes, look under CameraCtrl sub menu in Gen2.


1.9.7 consistently crashes while loading wikipedia search page

I'm running Mac OSX 10.9.2 with a standard build. I tried to extract the stack trace, but the instructions for minidump_stackwalk didn't produce any hash to continue with the instructions, sorry about that!
Here's the dump:
https://dl.dropboxusercontent.com/u/682022/C53A30B8-C38B-40C1-86EC-8D3F413DE31B.dmp
The fastest way to reproduce is just call .open("http://en.wikipedia.org/wiki/Special:Search?search=&go=Go")

Please upgrade to PhantomJS 2. 1.9.x is no longer supported, and known to have many crasher bugs that are fixed in 2 version.


Prepare for CRAN release

[ ] get the java part sorted.

[ ] remove old folder from inst\java
[ ] i think i need to add a java folder at the root level with the java source. research this

[ ] fix the credentials issue

[ ] option 1: bug @mattpollock to setup a drat repo for the package
[x] option 2: bug @mattpollock to submit to CRAN
[x] option 3: see if there's a newer alternative already on CRAN. something sticks in my mind.

@restonslacker you're welcome to pick this up if you like, but it seems unlikely that either of us is going to get to it soon.

Yeah… there are probably better ways to do this now too.


Fix/webview - fixes #371

This change is

Reviewed 3 of 3 files at r1.
Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable

Review status: all files reviewed at latest revision, all discussions resolved.

Comments from Reviewable


Attempting to connect to ODBC for MS SQL

Failure attempting to MS SQL
julia> ODBC.connect("NolanTest")
ODBC Connection Object
Connection Data Source: NolanTest
NolanTest Connection Number: 1
Contains resultset(s)? No
julia> query("select * from StoreProducts")
ERROR: invalid UTF-8 sequence
in convert at utf8.jl:162 (repeats 2 times)
or
julia> query("select * from StoreProducts")
[ODBC] 42000: [Microsoft][ODBC Driver 11 for SQL Server][SQL Server]Incorrect sy
ntax near '@'.
ERROR: [ODBC]: SQLExecDirect failed; Return Code: SQL_DEFAULT_ERROR
in error at error.jl:21 (repeats 2 times)

I get the same issues with Julia v0.3.6 on Windows 7. This breaks the package for me.
I use a cumbersome workaround calling pyodbc for those in need of an immediate solution:
using PyCall
@pyimport pyodbc
cnxn  = pyodbc.connect("DSN=my_dsn_name")
cursor = cnxn[:cursor]()
cex = cursor[:execute]("SELECT * FROM LAI_App.dbo.results")
res = cex[:fetchall]()

And I do a final [collect(res[i]) for i=1:length(res)] to convert the data to Julia types.
For me a connection to Microsoft SQL is an essential of Julia. There seems to be some related issues and PR's on this, so I understand it's not easy to fix.

should be resolved by the overhaul 7ae7ebfac60ed3ffb1ccefd552993a3073f8b77b


JBPM-4718: Rename Complete button in tasklist to make it reflect its …

…true function

+1

master: d0709547e393791f17a564fc12d12cb26f17a3f4