Windows / Azure Consultant

More information about Linux support is needed.  All the examples and documentation is Windows focused, but most companies have at least a couple of Linux machines.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 52f7582c-c2a6-87bb-d236-2066e727c90c
Version Independent ID: 1cbc7ee7-2518-137a-f6d6-d1d62a1a1bc3
Content: What can Azure Backup Server back up
Content Source: articles/backup/backup-mabs-protection-matrix.md
Service: backup
GitHub Login: @markgalioto
Microsoft Alias: markgal

@jaweekes Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

@Adam-Smith-MSFT Please assign to me

@jaweekes - Thank you for taking the time to share your product and documentation feedback with us. Your input is valued because it helps us create the right documentation for our customers.
Due to the volume of issues in our queue, we are closing open issues older than 90 days. We hope to continue hearing from you. Thank you.


Attach API Policies

Description:
Add docs for Attach Policies

Update
Finally, when Hisan got his setup sorted I had a discussion with Hisan to get a background on the feature.
Monday, March 13⋅3:20 – 4:20pm

Update
Added an overview and a feature page. Need to get code snippets from Hisan.
https://github.com/wso2/docs-apk/pull/88

Update

Revamped all the content further for the CR flow and REST API flow in https://github.com/wso2/docs-apk/pull/88

Live links

API Policies - Overview
Attach Operational-level API Policies to APIs via CRs
[Attach API Policies via the REST API Interface] (https://apk.docs.wso2.com/en/latest/develop-and-deploy-api/api-policies/attach-policies-via-rest-api/)


Incompatibility with numpy versions >= 1.24

Hi, thanks for making this excellent software. I've recently noticed that in numpy 1.24 the deprecation of aliases like np.bool, np.str, etc has expired. These aliases are still in use in both GPy and paramz and will now result in a crash. This could be fixed either by substitution with the native python types or by enforcing a maximum numpy version <=1.23.5 in the setup.py (right now,  GPy installed in, e.g., a fresh venv will crash), but this option is maybe less appealing.

Hi @joalof ! Yes, same problem here when GPy tries to use np.int within gp_plots.py. I have versions 3.10.9 (python) and 1.24.2 (numpy). Do you have any solution to use GPy plots?
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
Cell In[12], line 17
     14 q1, q2 = m.predict_quantiles(newX)
     16 fig, ax = plt.subplots()
---> 17 m.plot(ax=ax, plot_data=False)
     18 ax.scatter(Xgrid, mu, c="b")
     19 ax.scatter(newX, mu1, marker=".", c="r")

File ~/.local/lib/python3.10/site-packages/GPy/plotting/gpy_plot/gp_plots.py:334, in plot(self, plot_limits, fixed_inputs, resolut
ion, plot_raw, apply_link, which_data_ycols, which_data_rows, visible_dims, levels, samples, samples_likelihood, lower, upper, plo
t_data, plot_inducing, plot_density, predict_kw, projection, legend, **kwargs)
    331     kwargs['ylim'] = (xmin[1], xmax[1])
    333 canvas, _ = pl().new_canvas(projection=projection, **kwargs)
--> 334 helper_prediction = helper_predict_with_model(self, helper_data[2], plot_raw,
    335                                       apply_link, np.linspace(2.5, 97.5, levels*2) if plot_density else (lower,upper),
    336                                       get_which_data_ycols(self, which_data_ycols),
    337                                       predict_kw, samples)
    338 if plot_raw and not apply_link:
    339     # It does not make sense to plot the data (which lives not in the latent function space) into latent function space.
    340     plot_data = False

File ~/.local/lib/python3.10/site-packages/GPy/plotting/gpy_plot/plot_util.py:75, in helper_predict_with_model(self, Xgrid, plot_r
aw, apply_link, percentiles, which_data_ycols, predict_kw, samples)
     73     predict_kw['Y_metadata'] = {}
     74 if 'output_index' not in predict_kw['Y_metadata']:
---> 75     predict_kw['Y_metadata']['output_index'] = Xgrid[:,-1:].astype(np.int)
     77 mu, _ = self.predict(Xgrid, **predict_kw)
     79 if percentiles is not None:

File ~/.local/lib/python3.10/site-packages/numpy/__init__.py:305, in __getattr__(attr)
    300     warnings.warn(
    301         f"In the future `np.{attr}` will be defined as the "
    302         "corresponding NumPy scalar.", FutureWarning, stacklevel=2)
    304 if attr in __former_attrs__:
--> 305     raise AttributeError(__former_attrs__[attr])
    307 # Importing Tester requires importing all of UnitTest which is not a
    308 # cheap import Since it is mainly used in test suits, we lazy import it
    309 # here to save on the order of 10 ms of import time for most users
    310 #
    311 # The previous way Tester was imported also had a side effect of adding
    312 # the full `numpy.testing` namespace
    313 if attr == 'testing':

AttributeError: module 'numpy' has no attribute 'int'.
`np.int` was a deprecated alias for the builtin `int`. To avoid this error in existing code, use `int` by itself. Doing this will
not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the pre
cision. If you wish to review your current use, check the release note link for additional information.
The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
    https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations
AttributeError: module 'numpy' has no attribute 'int'.
`np.int` was a deprecated alias for the builtin `int`. To avoid this error in existing code, use `int` by itself. Doing this will
not modify any behavior and is safe. When replacing `np.int`, you may wish to use e.g. `np.int64` or `np.int32` to specify the pre
cision. If you wish to review your current use, check the release note link for additional information.
The aliases was originally deprecated in NumPy 1.20; for more details and guidance see the original release note at:
    https://numpy.org/devdocs/release/1.20.0-notes.html#deprecations

+1 :)

@AngelBerihuete Until this is fixed the easiest solution is to just use numpy version <=1.23.5.

Done. I've downgraded numpy and GPy works again.

Hi GPy team, any chance you can fix the inconsistency with numpy soon? Many thanks!

Or at least add a version restriction to numpy in setup.py?

This should be fixed now. However, we are a bit behind when it comes to linux wheels and keeping up with the changelog.
Since we are sorting out which issue to fix by the next release, could you please check if the issue persists after updating to the latest GPy release?

Thanks! Using GPy 1.12 (note: only available from the github repo since there is no wheel/source distribution on pypi atm) the incompatibility related to the typing aliases is now fixed so I can use numpy <=1.24.4.
For numpy > 1.25 however there is still an incompatibility due to the import of the deprecated numpy.testing.Tester in:
https://github.com/SheffieldML/GPy/blob/279f8e83f13c363c86b456862fd388df34671df2/GPy/__init__.py#L32

thanks for checking. I will address this via #1025 and #1030 .

Hi @joalof
we adressed this in #1040 .
Though, there is no new release yet, but there are only few issues remaining on our board towards a hotfix.
In the meantime, you can use GPy via git dependency on the devel branch. It also uses an updated fork of paramz as it seems like paramz is no longer maintained.
I will close your issue for the sake of overview on our issue board. Feel free to reopen if you encounter any issues according to this issue when working with the devel branch or any of the upcoming releases.
Best regards
Martin


Fix Storage Bugs

Fixes #229 , Fixes #230 , Fixes #231

Codecov Report

Merging #233 (40f5ace) into master (8550cd6) will decrease coverage by 0.05%.
The diff coverage is 0.00%.

@@             Coverage Diff              @@
##             master     #233      +/-   ##
============================================
- Coverage     38.51%   38.46%   -0.06%
- Complexity      528      530       +2
============================================
  Files           125      125
  Lines          3191     3185       -6
  Branches        409      407       -2
============================================
- Hits           1229     1225       -4
  Misses         1781     1781
+ Partials        181      179       -2

Impacted Files
Coverage Δ

.../java/seedu/address/storage/JsonAdaptedClient.java
43.39% <ø> (-1.25%)
:arrow_down:

...n/java/seedu/address/storage/JsonAdaptedIssue.java
43.07% <0.00%> (ø)

...java/seedu/address/storage/JsonAdaptedProject.java
42.85% <ø> (-1.22%)
:arrow_down:

...u/address/storage/JsonSerializableAddressBook.java
71.79% <0.00%> (ø)

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Add depext for @emotion/css >= 11.0.0

This way, running opam exec opam-check-npm-deps will return output for styled-ppx and warn you if your version of @emotion/css is absent or too old.

Cool


Added grammer support to allow for multi-argument attributes

Parser support for attributes with multiple arguments #2248

This should be done if and when we have an attribute that supports multiple arguments. Otherwise, it just complicates the codebase for no benefit.


Queries with many Guids in Linux: System.InvalidOperationException: Invalid operation. The connection is closed.

I have a query which runs under windows without problems, but if we get around 4000 guids there the query fails on a Linux App Service
var issues = await context.Issues.Where(i => guids.Contains(i.Id)).ToListAsync();
Exception message: System.InvalidOperationException: Invalid operation. The connection is closed.
Stack trace:
at Microsoft.Data.SqlClient.SqlCommand.<>c.b__164_0(Task1 result) at System.Threading.Tasks.ContinuationResultTaskFromResultTask2.InnerInvoke()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location where exception was thrown ---
at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot, Thread threadPoolThread)
--- End of stack trace from previous location where exception was thrown ---
at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)
at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReaderAsync(RelationalCommandParameterObject parameterObject, CancellationToken cancellationToken)
at Microsoft.EntityFrameworkCore.Query.Internal.QueryingEnumerable1.AsyncEnumerator.InitializeReaderAsync(DbContext _, Boolean result, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.SqlServer.Storage.Internal.SqlServerExecutionStrategy.ExecuteAsync[TState,TResult](TState state, Func4 operation, Func4 verifySucceeded, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.Query.Internal.QueryingEnumerable1.AsyncEnumerator.MoveNextAsync()
at Microsoft.EntityFrameworkCore.EntityFrameworkQueryableExtensions.ToListAsync[TSource](IQueryable1 source, CancellationToken cancellationToken) at Microsoft.EntityFrameworkCore.EntityFrameworkQueryableExtensions.ToListAsync[TSource](IQueryable1 source, CancellationToken cancellationToken)
at App1.UnitTestProject1.WhereClauseTest.InternalTest(SampleContext context, Int32 amount) in /home/vsts/work/1/s/App1/App1.UnitTestProject1/WhereClauseTest.cs:line 85
at App1.UnitTestProject1.WhereClauseTest.TestWhereClauseWithManyIds_OnSqlServer() in /home/vsts/work/1/s/App1/App1.UnitTestProject1/WhereClauseTest.cs:line 53

To reproduce
Enclosed i build a simple sample, which runs under a windows maschine, but on a Linux Build Server it is failing:
EfCoreLinux.zip
Not please add correct: SQL Azure Connection String
Further technical details
Microsoft.Data.SqlClient version: EF Core 3.1.10 (SqlClient 1.1.3) but I also tried newer versions, which had similar problems
.NET target: Core 3.1
SQL Server version: Microsoft Azure SQL
Operating system: Ubuntu 18.04

Hi @simader
This looks related to issues https://github.com/dotnet/SqlClient/issues/786, #459 and #54
There's a likely fix from #579 which is currently under further improvements.


Processing additional fields during registration

Hello.
I need help, please. I want to add authboss into my current project and still don't understand how to intercept the registration event to check additional fields and do some actions with them before the registration occurs. For example, I want to add fingerprint hidden field into the form and when user clicks on Register button I need to get this value and do some action with the database and if all is Ok finish registration by authboss, otherwise return the error message back to the form. How to do it?

See the implementation in authboss-sample. Look for the "name" field. It is an additional field that uses the PutArbitrary and GetArbitrary methods of the interface.
Additional configuration required is here:
https://github.com/volatiletech/authboss-sample/blob/master/blog.go#L108
And here:
https://github.com/volatiletech/authboss-sample/blob/master/blog.go#L136-L139
https://github.com/volatiletech/authboss-sample/blob/master/blog.go#L151-L153

Thank you for reply, but that’s not exactly what I need.
I asked about callback function for additional fields where I can validate values by my own code.

So we have our default implementation of a BodyReader here:
https://pkg.go.dev/github.com/volatiletech/authboss@v2.4.0+incompatible/defaults?tab=doc#HTTPBodyReader
It takes these rulesets that you can configure yourself but if the Rulesets are not enough for youit'll  require a replacement of the default BodyReader implementation entirely.
The body reader's Read returns a Validator which can do what you'd like.

Thank you very much!


Split actual output in: JSON mails and JSON attachments

Split result in two parts:

mail result with all fields except details of attachments (only hashes)
attachment result with all attachment details

Store only a sample for hash and attach Tika and Virustotal analysis only a time for hash.

Splitted results only in elasticsearch output. Added filter function to store only a sample/mail for hash.
Issue solved in release v1.1


Support for Laravel ^7.0?

I have an older project that I can't upgrade to Laravel 8 yet (for reasons that I won't burden you with). Is there any particular reason we can't expand the dependencies here to include 7.0 contracts, console, or support modules? I was looking through the codebase quickly, and I haven't found any direct dependencies.

Laravel 7.x is not support autoupdate variables from .env, you must restart sail after update .env
See:
https://github.com/laravel/framework/blob/7.x/src/Illuminate/Foundation/Console/ServeCommand.php
https://github.com/laravel/framework/blob/8.x/src/Illuminate/Foundation/Console/ServeCommand.php

Laravel 7 isn't supported anymore.

Thanks @finagin and @driesvints, I appreciate the thoughtful replies.


Task 1 file format

Should the file be in py format? Or ipynb works fine for task 1?

I saved it in .py format but we cannot show plots and datas when we save it in .py format yes??

Yes that is why I have used ipynb for task 1


Inference performance improvements

No matter what is decided in #10, inferencing will be a key component of the new DanNet in some way. Obviously, if the end goal is a single shared database with inferencing, performance will be extremely important, but it also is in many other cases.
Currently, the lowest level of OWL inferencing - OWL Micro - is used (specifically: OntModelSpec/OWL_MEM_MICRO_RULE_INF). This still incurs a heavy performance penalty which results in 10+ minute long queries in some cases... with subsequent queries being only a few seconds, though.
Another issue is that the inferred information is not really all that valuable, e.g. Owl:thing or some of the transitive SKOS relations, e.g.skos:narrowerTransitivewhich returns hundreds of results, and also many useless anonymous resources included in e.g. :rdf/type, presumably also through some transitive relation.
So it is in the interest of the inference model itself to make it more performant as this will also lead to much less cluttered results.
Possible Solutions

I will probably first experiment with a few of the less comprehensive built-in inference models.
If that doesn't work out I will have to build my own custom inference layer which should be possible. It is fortunately relatively well-documented.
In either case, the most important relation to infer is the opposite relations of all of the triples that go unspecified.

Once other complication is that copying the inferred triples from an InfModel to a TDB graph takes up a great deal of memory, e.g.
(def persisted-inf
  (-> dannet
      :db-path "resources/tdb2-inf"
      :db-type :tdb2))

(q/transact (:model persisted-inf)
  (.add (:model persisted-inf) model))

Attempting the above using the default (I think 4GB) heap space results in a an out of memory error when the model uses OWL micro inferencing.
This will need to be resolved, so that it becomes possible to infer all possible triples of some snapshot of the base graph and populate a second  graph - likely a TBD, to ensure persistence - with all of the inferred data.

Increasing to 8GB max heap space also yielded an OutOfMemoryError when copying all triples from an InfModel to an empty TDB 2 model. It seems that unless the sweet spot is slightly above 8GB, preserving all of the triples inferred by OntModelSpec/OWL_MEM_MICRO_RULE_INF is simply out of the question.
I also tried the operation using an RDFS inference model and this completes in a very short time, likely due to little-to-no actual inference taking place. Unfortunately, there is no ready-made OntModelSpec that only infers opposite relations which is the primary need I have.

I initially implemented a custom Reasoner based on the OWLMicroReasoner class with a custom .rules file and closed the issue in that commit, but it turns out that no Java code is necessary, as one can simply instantiate a GenericRuleReasoner to apply the same custom rule set: fb7329d998535d59c2a8b9bf72a4ae4b84b18525


Disable coap-client debug output.

Prevent coap-client from outputting annoying debug output to stdout, which we need to filter out afterwards.
Using some autoconf magic ensures no modifications to the coap source code are made.
This might also be useful for #2, as coap-client now provides a clean json stream when subscribed.

Fixed it myself. Thanks for the contribution 👍


Potential ++zing issue?

In celebration of reserving my first star, I thought I'd explore the potentially available star names. I ran these commands in dojo:
> =p (turn (gulf 0x1 0xff) |=(a/@p (turn (gulf 0x1 0xff) |=(b/@p (cat 3 a b)))))
> =q (zing p)
> (lent q)
65.025
> q
recover: dig: over
-
bail: meme

recover: top: meme
meme
leak 0x360048d4 524afbd6
leak 0x360048ec 64b98402
...
leak 0x3d421504 5da0da6b
leak 0x3d423240 f54bf9
address 0xbe440000 out of loom!
loom: [0x36000000 : 0xb6000000)

bail: oops
Aborted (core dumped)

What's going on here? According to the docs here for ++zing, q should simply be a flattened list. However, when I try to run a simple snag, I also receive an error:
> (snag 0 q)
/~mastyr-harlud/home/~2017.4.17..22.17.39..3dd3/arvo/ford:<[1.211 24].[1.211 52]>
fuse-loop
ford: build failed ~[/g/~mastyr-harlud/use/dojo/~mastyr-harlud/inn/hand /g/~mastyr-harlud/use/hood/~mastyr-harlud/out/dojo/drum/phat/~mastyr-harlud/dojo /d //term/1]

I am new to Hoon, so hopefully this isn't a mistake on my part (it probably is!). I'll bet there's a better way to generate p also, rather than nesting turn calls.
Thanks!

These are real issues that everyone has unfortunately learned to work around.
65535 names is a giant list, you don't really want to print that.  And cast the product of ++turn before using it.
You shouldn't have a problem with this -- the prettyprinter shouldn't head recurse on a list, for instance.  But rough spots which are easily worked around don't get enough love.
Sent from my iPhone

On May 21, 2017, at 7:12 PM, Matthew Levan<EMAIL_ADDRESS>wrote:
In celebration of reserving my first star, I thought I'd explore the potentially available star names. I ran these commands in dojo:

=p (turn (gulf 0x1 0xff) |=(a/@p (turn (gulf 0x1 0xff) |=(b/@p (cat 3 a b)))))
=q (zing p)
(lent q)
65.025
q
recover: dig: over

bail: meme
recover: top: meme
meme
leak 0x360048d4 524afbd6
leak 0x360048ec 64b98402
...
leak 0x3d421504 5da0da6b
leak 0x3d423240 f54bf9
address 0xbe440000 out of loom!
loom: [0x36000000 : 0xb6000000)
bail: oops
Aborted (core dumped)
What's going on here? According to the docs here for ++zing, q should simply be a flattened list. However, when I try to run a simple snag, I also receive an error:

(snag 0 q)
/~mastyr-harlud/home/~2017.4.17..22.17.39..3dd3/arvo/ford:<[1.211 24].[1.211 52]>
fuse-loop
ford: build failed ~[/g/~mastyr-harlud/use/dojo/~mastyr-harlud/inn/hand /g/~mastyr-harlud/use/hood/~mastyr-harlud/out/dojo/drum/phat/~mastyr-harlud/dojo /d //term/1]
I am new to Hoon, so hopefully this isn't a mistake on my part (it probably is!). I'll bet there's a better way to generate p also, rather than nesting turn calls.

Thanks!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

Yes, giant list: 65.025 to be exact!
I just want a handy text file, so I try:
> =p (turn (gulf 0x1 0xff) |=(a/@ (turn (gulf 0x1 0xff) |=(b/@ `@p`(cat 3 a b)))))
> =q `(list @p)`(zing p)
> (snag 0 q)
~marnec
> *%/web/stars/txt (turn q |=(a/@p (scot %p a)))

And now we wait for the spinning to cease. Casting was the trick!
Thanks Curtis.


npm install fails with 403 from mozilla-releng-tofino.s3.amazonaws.com

Started happening after https://github.com/mozilla/tofino/pull/652
Update changeset: https://github.com/mozilla/tofino/commit/56cfa6de526b71d437d695a53928632451d41844
Happens locally as well.
@Mossop ?

Update was hastily merged, reopened the PR. https://github.com/mozilla/tofino/pull/659


About the token Selection

Nice work!
When selecting tokens from the encoder output, the output dimension of the class_embedding is 91, which includes the category of "no object". Will the tokens selected in this way have an impact on the results?

We use focal loss, where no "no object" token exists. Or you can view it as multiple binary classifications.


Added option to manually set DatePickerIOS locale.

Motivation
Sometimes there is a need to set DatePickerIOS locale manually. For that I added optional prop locale. If user pass locale prop the DatePickerIOS will use it, otherwise it will use current phone locale.
Issues: #12405, https://github.com/mmazzarolo/react-native-modal-datetime-picker/issues/31
Test Plan
Added location to RNTester DatePickerIOS screen. You can type locale and it will change to that one.  For checking default locale I change phone language/region to other and it used the new locale.

Hello,
Should I do something next about this PR? I see that CI is broken for all PR's.

@javache , @shergin, so thanks for amazing experience with open source possibilities in this project. I see that this functionality was added to react native already. Great support! Keep it up!


Code to Create a dataset for the Azure-stored data

Hello - The code in this page to create a dataset is not working. I think the blob store is down

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 789ff09b-04b0-6262-420b-90770d0f8a1f
Version Independent ID: cbdf5d7d-0c4b-65fc-256b-f13816d6ab4c
Content: Tutorial: ML pipelines for training - Azure Machine Learning
Content Source: articles/machine-learning/tutorial-pipeline-python-sdk.md
Service: machine-learning
Sub-service: mlops
GitHub Login: @nibaccam
Microsoft Alias: nibaccam

Hi @rajmadhavan, Thanks for your feedback! We will review and update this doc accordingly.

assign: @ssalgadodev

@rajmadhavan
Thank you for your feedback. To make it easier for you to submit feedback on articles on learn.microsoft.com, we're transitioning our feedback system from GitHub Issues to a new experience.  As part of that transition, we are closing  older issues that we believe have been resolved by subsequent document updates.
If you feel that this issue still persists, please respond and let us know.
#please-close


Updating Racket to 6.4

Thank you for the contribution. It was merged directly as eddd939555fc1b038b17d60630f4478f5f6cd842 to keep commit history cleaner. Your contribution is still credited to you.


Mixing class and array

---@class color
---@field r number
---@field g number
---@field b number

---@class palette:color[]
---@field name string
---@field version string
---@field size number

---@type palette
local palette

local color = palette[2] -- color is any :(

I know that I can say ---@type palette|color[], but the problem is that I want palette:color[] to be a real class (with integer keys => color values) from which other classes can inherit.

Look what a terrible "class" I have! 🎃

Possible keys/values:

integer color_index = string color_name
string color_name = integer color_index

First format is required; second is optional.
@alias lib.table.palette table<integer,string>|table<string,integer>

Can use ---@field [integer] color now.


Code Scanning Dashboard

This PR adds a dashboard for GitHub Code Scanning, along with documentation and minor big fixes.
What changed?

Docs now include references to Code Scanning
Security navigation menu is now called Advanced Security
Security Alert Overview dashboard is now called Advanced Security Overview

What's new?

GitHub::CodeScanning event type
Code Scanning Alerts dashboard
DATETIME_CONFIG is now set to CURRENT for [github_json] in props.conf

What was fixed?

security_alert_overview dashboard base search now uses the github_webhook macro

These changes look awesome and can't wait to try them out!


Extend Stream library to support serializing vectors of non-trivial types

Instead of trying to copy the whole vector to the stream at once (only possible for non-trivial types), we could instead iterate over each element of the vector, and serialize the element individually. This is possible if there is an appropriate Write(T& object) method. Such is already the case for std::string, as the Stream library natively supports this. The code of course generalizes to any non-trivial type, given the existence of an appropriate serialization method.
Example vector write method for non-trivially-copyable objects:
  Write(const std::vector<T, A>& vector) {
    for (const auto element : vector) {
     writer.Write(element);  // Call custom serializer for element type
    }
  }

Example usage:
void f(Stream::Writer& writer) {
  std::vector<std::string> nonTrivial;
  // ...
  writer.Write(nonTrivial);
}

In the above example, the serialization code would loop over the vector's elements, and call the custom std::string serialization code for each element.
Combine this with the proposal in Issue #277, and it would also add support for other arbitrary non-trivial types, provided they supply an appropriate T::Write(Stream::Writer& writer) method.

I was just thinking, the above method generalizes to any container type, even ones that use non-contiguous memory. The specific reference to std::vector can be removed, and replaced with a generic template type parameter. That could simplify the allocator A type parameter part as well.
I suppose technically you might want to guard the template with the notion of the container being iterable (and the element type being writable by the stream library). There's no built in type_trait check for iterable, but a solution can be found here:
https://stackoverflow.com/questions/13830158/check-if-a-variable-is-iterable

I came across void_t, which uses an example that checks for iterable:
https://en.cppreference.com/w/cpp/types/void_t
Another point worth mentioning, which is touched on in that, is using cbegin and cend, rather than begin and end. The "c" prefix is for const, and produces a const iterator, which can not modify the object being iterated over. Reference:
https://en.cppreference.com/w/cpp/iterator/begin

I came across std::data:
https://en.cppreference.com/w/cpp/iterator/data
It allows for consistent treatment of containers with a .data() method, as well as arrays, and initializer lists. In terms of built in containers, and container like objects with .data(), that includes std::array, std::vector, and std::string. In particular, the method to write strings and vectors can be collapsed, as the method body is effectively the same.
More to the point here, I realized the only contiguous memory containers are likely to provide a .data() method. It wouldn't really make sense for other container types to provide such a member. That may lead to a useful check for the write method that assumes a container with contiguous memory.


Can't get the login to work?

Govee Device SKU
Light Bulbs
Govee2MQTT Version
2024.07.13-82ddc6e9
Describe the issue
Hey,
sorry if this is a dumb question, but I just can't get the login to work. I am logged into the app, where I can see all the lights. Yet with the same login credentials, the app won't work. Any idea? Is there a website I have to sign up? I couldn't find anything in the FAQs etc. Help would be much appreicated. Thank you for your work <3
Cheers
Startup Diagnostics
[2024-07-14T17:16:27 INFO  govee::commands::serve] Starting service. version 2024.07.13-82ddc6e9
[2024-07-14T17:16:27 INFO  govee::commands::serve] Querying platform API for device list
[2024-07-14T17:16:27 INFO  govee::commands::serve] Querying undocumented API for device + room list
Error: request https://app2.govee.com/account/rest/account/v1/login status 200: OK: parsing https://app2.govee.com/account/rest/account/v1/login response: Failed with status 451 Unavailable For Legal Reasons Unavailable For Legal Reasons: Request to https://app2.govee.com/account/rest/account/v1/login failed with code 451 Unavailable For Legal Reasons This email hasn't been registered yet.. Full response: {"status":451,"message":"This email hasn't been registered yet."}
Additional Logs
No response
Home Assistant Logs
No response
Anything else?
No response

I cannot help with this; the error message is being returned from govee.

I cannot help with this; the error message is being returned from govee.

Hey, thank you for your answer. So using the credentials of the app is the correct way? and my account is just unable to use it? Your instructions are a little unclear what credentials to use. The Apps? The stores? Sorry :(

Alright, I found a solution after all.
This comment was bang on!
For anyone encountering this issue: do not fill in your email and password. Just fill in the API key and leave the rest blank.
That way it works.
Thank you and /closed


Add support show database

Fixes #2922.
Changes proposed in this pull request:

Make RoutingEngine route show database return DatabaseBroadcast
New ShowDatabasesMergedResult construction

Some Question

beacuase type erasure, ShowDatabasesMergedResult constructor has a useless param
For Proxy, Should Return authorizedSchemas or all schemas?

This change is

Pull Request Test Coverage Report for Build 689

18 of 18 (100.0%)  changed or added relevant lines in 3 files are covered.
3 unchanged lines in 3 files lost coverage.
Overall coverage increased (+0.01%) to 67.876%

Files with Coverage Reduction
New Missed Lines
%

sharding-core/sharding-core-common/src/main/java/org/apache/shardingsphere/core/strategy/keygen/TimeService.java
1
50.0%

sharding-core/sharding-core-merge/src/main/java/org/apache/shardingsphere/core/merge/dal/show/ShowDatabasesMergedResult.java
1
95.0%

sharding-core/sharding-core-route/src/main/java/org/apache/shardingsphere/core/route/router/sharding/RoutingEngineFactory.java
1
93.75%

Totals

Change from base Build 489:
0.01%

Covered Lines:
11317

Relevant Lines:
16673

💛  - Coveralls


Updated BDD tests

Additional BDD tests for Devex.  As stated in the comments the test should be extended to include logging in as admin and creating an issue.

Thanks, George!


Change default rpc for berachain-testnet

Related to #534

Publicnode rpc is working more reliable than current default rpc
berachain-testnet default rpc is swapped with publicnode rpc.
Default rpc is not removed entirely as it shows signs of recovery and will be remain monitored

As a note this provider causes Airseeker to throw exceeded maximum retry limit half of the time

This needs to be merged and published before the Cint today so I'll do that


Figure out how to use Float textures on iOS

Currently half float textures are used on ios and any platform that doesn't support float texture blending. However this will result in heavily skewed colors during blending. Screenshots after ~ 5000 samples
HalfFloat

Float

On ios we can render to two buffers and manually blend instead of relying on hardware support. Or we can perform the blend in the raytracing buffer itself.


Sublime Text 3 failing to invoke gksu

Issue description
When opening a root-owned file, like /etc/nixos/configuration.nix, with user-launched Sublime, and trying to save it, I get the following error:
Failed to run cp '/tmp/<snip>.tmp' '<snip>' as user root.

Failed to communicate with gksu-run-helper.

Received:
 Unable to run /run/wrappers/bin/su: No such file or directory
While expecting:
 gksu: waiting

Technical details

System: 16.09.1827.f89ab94
Nix version: 1.11.7
Nixpkgs version: same as System, but I'm using unstable for sublime3

@wmertens @codyopel @zimbatm (as per @mention-bot in my ST-related PR)

Are you able to invoke gksu directly?
What is the output of ls -la /run/wrappers/bin/su ?

@zimbatm Yes, I can invoke gksu after installing it (or doing nix-shell of sublime3). And I have no /run/wrappers on my system.

Setuid wrappers are a bit awkward to use right now. Because the /nix/store doesn't store them they have to be installed by nixos with a systemd service. See http://nixos.org/nixos/options.html#security.setuidprograms

Sorry, I'm really out of my depth on this one 🙂 What does that mean for ST and gksu?

No worries :)
Basically as a user you would expect all required the dependencies to be installed with sublime but it's not.
To get the su dependencies try to add the following to configuration.nix:
{
  environment.systemPackages = [ pkgs.su ];
  security.setuidprograms = ["su"];
}

Hmm, added that, but nothing has changed, same error. Thing is, gksu works by itself, even though libgksu refers to /run/wrappers/bin/su. On my system su is in /var/setuid-wrappers, not /run/wrappers/bin.

Yeah that might be the issue, the wrappers have changed location

Okay, thanks, that was indeed the issue. FrankenNix is a thing too :)


Docker is not installed on RHEL during Pharos cluster installation

I tried to install Kontena Pharos Cluster (tried pharos-cluster 1.2.2 and 1.2.3) but the installation (pharos-cluster up) failed with the following error:
No package docker-1.13.1 available.

RHEL7 doesn't by default include docker, but it can be enabled with the following command:
sudo subscription-manager repos --enable=rhel-7-server-extras-rpms

After I ran this on every Kontena node the installation proceeded (and docker was installed).
Proposed fix: enable the extras repository in the installation script.

Documentation update: https://github.com/kontena/pharos-docs/pull/66

fixed in #624


[WIP] Fixes #87

ADD:

database/schemas.go:Torrent a new structure used to represent how the
torrent exists in the DB.
database/database_test.go Working on adding tests for all Database
abstractions

CHANGE:

server/server.go:scrapeHandler() Or whatever its called. Removing for now.

Right now it looks like if the password is empty, it's fails. We need to assert that password can be "" somehow.

All right, don't get over eager now just because your stupidity has finally managed to overcome, you still got stuff to be done:

[ ] Verify a torrent is in torrents before adding it to redis. (STARTED event)


nested destinations

Support destinations like
class OuterDestination {
     @Destination
     class InnerDestination
}

Closed with prototype 0.2.0 #49


Is it posible to make nightly builds?

Been a long time since an update. Is it possible to do a steady stream of small updates instead of just one big update?

Until we get GitHub releases automated, you can find nighty builds at https://github.com/isJuhn/KAMI/actions?query=branch%3Amaster


Final details for package

Adds license and details to the final package

@mgoin let's hold off with landing this; I want to add some more details into that PR ok?


Remove extensions

Remove unused extensions
Fix graphite check to honor no_proxy env var
Bump version

PR closed as puppet module already has a way to manage external extensions


Backport HSEARCH-4303 to branch 6.0 - No automatic reindexing on insert/delete of contained entity without corresponding update in the containing entity

https://hibernate.atlassian.net/browse/HSEARCH-4303
Backport of #2647

Merging now, because I want this to be in the release.


Update-06-30

What new features does this PR implement?
Please summarize the features that this PR implements. As relevant, please indicate the issues that the PR closes.

Adds ABC (closes #X)
Adds XYZ (closes #X)

What bugs does this PR fix?
Please summarize the bugs that this PR fixes. As relevant, please indicate the issues that the PR closes.

Fixes ABC (closes #X)
Fixes XYZ (closes #X)

Does this PR introduce any additional changes?
Please summarize any additional changes that this PR introduces.

Corrects typos in documentation
Changes theme of documentation

How have you tested this PR?
Please summarize the tests that you implemented to test this PR.

Added test for ABC
Added test for XYZ

Additional information
Please describe any information needed to review this PR.

:tada: This PR is included in version 9.21.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


where to store MC DL1 information in event structure

I'm starting to refactor stage1.py such that the writing is separate from the calculations (creating a DL1Writer Component), and I've noticed that so far we have nearly everything needed in the event structure except the MCDL1CameraContainer, which is created on-the-fly inside the script, but is never written to the "event".  Now that I'm separating the computation from the writing, everything written must be in the event, so the question is: where would be a good place to put this info?
Current status:
We have 2 containers for DL1 camera info.
Real DL1 images and parameters
In Event Structure:  event.dl1.tel[X]
Written to: /dl1/event/telescope/{images,parameters}/tel_X in the output
ctapipe.containers.DL1CameraContainer:
                         image: Numpy array of camera image, after waveform
                                extraction.Shape: (n_pixel) as a 1-D array with
                                type float32
                     peak_time: Numpy array containing position of the peak of
                                the pulse as determined by the extractor. Shape:
                                (n_pixel) as a 1-D array with type float32
                    image_mask: Boolean numpy array where True means the pixel
                                has passed cleaning. Shape: (n_pixel) as a 1-D
                                array with type bool
                  parameters.*: Parameters derived from images

Simulated DL1 images and parameters
For simulated info we have a similar class:
In Event Structure: nowhere
Written to: /dl1/simulation/telescope/{images,parameters}/tel_X in the output
ctapipe.containers.MCDL1CameraContainer:
             true_image: Numpy array of camera image in PE as simulated
                                before noise has been added. Shape: (n_pixel) as
                                a 1-D array with type float32
             true_parameters.*: Parameters derived from the true_image

Other Simulated info
In Event Structure: event.mc.tel[x]:
Written to: nowhere in the output
ctapipe.containers.MCCameraEventContainer:
                    true_image: Numpy array of camera image in PE as simulated
                                before noise has been added. Shape: (n_pixel)
                      dc_to_pe: DC/PE calibration arrays from MC file
                      pedestal: pedestal calibration arrays from MC file
                   azimuth_raw: Raw azimuth angle [radians from N->E] for the
                                telescope
                  altitude_raw: Raw altitude angle [radians] for the telescope
                   azimuth_cor: the tracking Azimuth corrected for pointing
                                errors for the telescope
                  altitude_cor: the tracking Altitude corrected for pointing
                                errors for the telescope

Options

get rid of MCCameraEventContainer and replace it with MCDL1CameraContainer: are any of the other fields still used? I think the pointing already goes in event.pointing, and dc_to_pe and pedestal are not really per-event quantities and are already in event.calibration.tel[x].dl1 (DL1CameraCalibrationContainer).

put MCDL1CameraContainer somewhere in event.dl1.tel[x] (a bit ugly, since this is only there for simulations)

Any others?

I would go for 3:
Add a new SimulationInfoContainer at event.simulation,
that has all simulation info and that is None for observed data.
class SimulationInfoContainer(Container):
    run_header = Field(MCRunHeaderContainer) # rename to SimulationRunHeader?
    dl1 = Map(DL1SimulationContainer)
    ... any other fields

Get rid of MCCameraEventContainer, all the fields are now available somewhere else. (event.pointing or event.calib or event.simulation.dl1.tel[]...)

#1180 could be solved in the same step

We already removed the runheader from the event (it's not event-wise), so I think leaving that in the EventSource is better, but otherwise, I think this is an ok suggestion.  It's basically the same as  event.mc and replacing it with event.simulation however.

I think I like event.simulation.shower best, since it mirrors event.dl2.shower

dc_to_pe and pedestal are not really per-event quantities and are already in event.calibration.tel[x].dl1

No, these are not put in the event.calibration container. These are applied in SimtelEventSource as an R1 calibration.

EDIT: Ah from the PR I think you have realised this already

Yes, the question now is just do we want to store them somewhere? Right now I just apply them, but don't put them into the event structure anywhere.  Could be added back later in any case,  if we find a need.


Update UG for list command

Closes AY2021S1-CS2103T-F11-3/tp#9

LGTM.

Added more changes to the UG


[mman] move include/mman/sys/mman.h into original include/sys/mman.h

include/mman/sys/mman.h is not usable for Visual C++ Project System, and the mman library is a posix(mman) api wrapper for Windows Memory Management API, so I think mman.h need to move to include/sys, and the mman library is not need to build on system other than Windows.

Thanks for the PR!
The problem with placing this header at the posix location is that too many other packages will automatically detect it in their configuration scripts, then think they are on Linux and fail to build.
When using MSBuild (the VC++ project system) around cross-platform code, I recommend using
#if defined(_WIN32)
#include <mman/sys/mman.h>
#else
#include <sys/mman.h>
#endif


[SCB-1389] write docs for explicit passing transaction context

Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Each commit in the pull request should have a meaningful subject line and body.
[x] Format the pull request title like [SCB-XXX] Fixes bug in ApproximateQuantiles, where you replace SCB-XXX with the appropriate JIRA issue.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Run mvn clean install to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

Coverage decreased (-0.08%) to 82.74% when pulling 5f5b56779e5f54f2780965ccc7bcb5dbd06ff37a on chanjarster:SCB-1389 into fa608a2b660f21bde6870d6dc80a6f2ccc75ef89 on apache:master.

Thanks @chanjarster - it looks good to me.


Fixed path to profile.png

The example coverletter.tex now compiles. I've corrected the path to profile.png, since it was looking in a non existing folder. I believe this fixes #100

It's not the bug because the default compiler is make and Makefile is located in project root directory. If you try to compile with make command in the project root directory, there are no errors.


Add class for optimizing adaptive KDE rescale factors

For multi-dimensional KDE, in general we want a kernel with different bandwidths along different dimensions.  We also want the overall scale of the kernel to vary between data points (adaptive).  I.e. the kernel for a data point $\vec{X}_i$ is
\exp\left[ -\frac{1}{2} (\vec{x} - \vec{X}_i)^T \lambda_i^{-2} \mathrm{diag}(h_1^{-2}, h_2^{-2}, \ldots) (\vec{x} - \vec{X}_i) \right],

where $h_1, h_2, \ldots$ are the global D-dimensional bandwidths and $\lambda_i$ are the per-point adaptive factors.
The KDEpy implementation (TreeKDE) allows adaptive bandwidths, but enforces that the kernel is proportional to the unit matrix for multi-dimensional data.  So, instead we rescale each dimension (after standardizing it so that the variance is equal to 1). Supposing that $X_i$ are already standardized, we define ${\vec{y} = (h_1^{-1} x_1, h_2^{-1} x_2, \ldots)}^T$ such that the kernel in rescaled coordinates is
\exp\left[ -\frac{1}{2} (\vec{y} - \vec{Y}_i)^T \lambda_i^{-2} \mathbb{1} (\vec{y} - \vec{Y}_i) \right].

This is equivalent to an adaptive KDE with global bandwidth equal to 1.  The D-dimensional bandwidths $h_1,\ldots$, i.e. rescaling factors, have to be optimized (and possibly the adaptive parameter $\alpha$).  As there may be several dimensions this is better done with a standard optimizer such as Nelder-Mead.

So, one need to write a clas that compute KDE, that is,  the sum of exponentials rather using KDEpy code?
or we want to pre-compute  ${\vec{y}$ (at which we will compute KDE on)  by already having optimized bandwidths in each dimension?

Addressed by #33


Remove  --no-git-commit  and  --only-release

🤔 What's the problem you've observed?
To solve #48 we have to take interactions with --no-git-commit  and  --only-release into account. This makes things really complicated.
✨ Do you have a proposal for making it better?
We introduced --no-git-commit  and  --only-release for testing because we didn't have a fancy git setup yet. Perhaps we can change the tests so we don't need these commands any more and instead check the patch files produced by git. I don't think there is a good usecase for these options because they leave the repo in a "strange state" that isn't really usable by anyone and requires a deep understanding of polyglot-release to roll back.

Agreed.
We could also use global variables, I guess, (like we do with the RELEASE_DATE) to let the tests tweak the behaviour but I don't like that option as much as modifying the test runner to inspect the git patches as you suggest.


this Cargo does not support nightly features, but if you   switch to nightly channel you can add

Description
this Cargo does not support nightly features, but if you   switch to nightly channel you can add
Steps to reproduce
➜  ~ cargo install illa
Updating crates.io index
Downloaded illa v1.2.6
error: failed to parse manifest at /Users/thomasreggi/.cargo/registry/src/github.com-1ecc6299db9ec823/illa-1.2.6/Cargo.toml
Caused by:
feature edition2021 is required
this Cargo does not support nightly features, but if you
switch to nightly channel you can add
cargo-features = ["edition2021"] to enable this feature
ILLA Builder Version
v1.2.6
Browser
No response
Operating System

[X] macOS
[ ] Windows
[ ] Linux

Additional Information
No response

@reggi Hi, the "illa" is a deploy CLI tool, it will always pull the latest version of illa-builder (our low code tools) docker image.
To fetch the latest version of illa-builder, please run with:
illa upgrade

And we just tested that:
cargo 1.66.0 (d65d197ad 2022-11-15)
cargo 1.68.0-nightly (c994a4a63 2022-12-18)

are installed illa successfully.
And the "Edition 2021"  is part of the stable channel now (https://forge.rust-lang.org/index.html).
Please check your cargo version and update it. try:
rustup default nightly && rustup update

or
rustup default stable && rustup update

Because it has not had recent activity. It will be closed if no further activity occurs.


V7 : ReactTable - Need to change Default Behavior :  Column with Input | TextArea always keeps value when changing page by pagination

Describe the bug
In my project, I use ReactTable V7.
Page 1 - column [ Comment ] -  Index = 0 => I type a "Test" text.

Then, I click Next button.
Page 2 - column [ Comment ] - Index = 0 => I still see  "Test" text.

This behavior still displays with index = 1, index = 2, .... , index = n
Your minimal, reproducible example
https://react-table-v7.tanstack.com/docs/examples/pagination-controlled
Steps to reproduce
In this step, I will use your example.
https://react-table-v7.tanstack.com/docs/examples/pagination-controlled
Step 01: I define the Cell of  column [ progress ]

Step 02: Page 1:  I type "Test" to input 01 & input 02 in column [ progress ]

Step 03: Click the Next button to go to Page 02
Step 04:  At Page 2: I still see the value "Test" in input 01 & input 02

Expected behavior
As a user, I expect the value of input will be cleared on new page.
How often does this bug happen?
Every time
Screenshots or Videos
No response
Platform
All Platforms.
react-table version
v7
TypeScript version
No response
Additional context
No response
Terms & Code of Conduct

[X] I agree to follow this project's Code of Conduct
[X] I understand that if my bug cannot be reliable reproduced in a debuggable environment, it will probably not be fixed and this issue may even be closed.

This has to do with the key you are passing to your row (or cell) objects. If the key stays the same (like an index), it will keep the state for that row/cell.
In short, if you want the state to reset, use a better key like the row ID or something unique to the row.

@tannerlinsley
Thank you very much !! Here is my solution. The custom key was changed in tr tag


Allow specifying dot or convolution fusion for mlir

Seems fine, approved
Could we get a unified comment or a document or something that describes these options and what they do - and what the defaults are?

https://github.com/ROCm/AMDMIGraphX/blob/877c3af54861c5106e488108ce2c39836c6f6fdc/docs/dev/env_vars.rst#L246


Add support for pictures with depth map included

https://threejs.org/examples/webxr_vr_panorama_depth.html

Google Camera portrait mode is supposed to have a depth map

https://depthy.stamina.pl/ and https://www.photopea.com/ are two online tools to view embedded depth map

Spec for Google Camera: https://developer.android.com/static/media/camera/camera2/Dynamic-depth-v1.0.pdf

exiftool implementation

exifr has an example: https://mutiny.cz/exifr/examples/depth-map-extraction.html

There are many standards:

Google "GDepth": https://developers.google.com/depthmap-metadata/reference
Google "Dynamic Depth": https://developer.android.com/static/media/camera/camera2/Dynamic-depth-v1.0.pdf
Apple

Let's keep going for For Dynamic Depth:
The exif have:

From https://stackoverflow.com/questions/58957619/android-q-get-depth-map-from-portrait-mode-photos:

> Pixel phone portrait mode photo is concatenated of 4 JFIF structure https://en.wikipedia.org/wiki/JPEG_File_Interchange_Format. Each JFIF structure is an jpeg image.
> A JFIF structure starts with marker 0xFFD8 and ends with marker 0xFFD9. Therefore, we can split a portrait mode image into 4 jpeg files.


chore(readme): fix package's name

🔗 Linked issue

❓ Type of change

[x] 📖 Documentation (updates to the documentation, readme, or JSdoc annotations)
[ ] 🐞 Bug fix (a non-breaking change that fixes an issue)
[ ] 👌 Enhancement (improving an existing functionality like performance)
[ ] ✨ New feature (a non-breaking change that adds functionality)
[ ] 🧹 Chore (updates to the build process or auxiliary tools and libraries)
[ ] ⚠ Breaking change (fix or feature that would cause existing functionality to change)

📚 Description

Just a typo
📝 Checklist

[ ] I have linked an issue or discussion.
[ ] I have updated the documentation accordingly.

Thanks!


Various changes/additions

Use plusLayer color to tint custom images when used
When using custom image instead of default plus image, rotate it as you would plusLayer
Specify rotation degrees in IB
Set child item image tint separately in IB. Default to plusColor when itemImageColor is left blank
Auto-close items on item tap. Customizable in IB.
Syntax updates for Swift 2.2

Thank you!


Ugly error message for empty programs

Related to https://github.com/uqbar-project/mumuki-gobstones-server/issues/45
If you don't submit anything and no extra code is given, this is what you get from the runner:

ERROR:root:'NoneType' object has no attribute 'children'

But it should return the Gobstones compiler's empty program message:
vacio.gbs (línea 1, columna 1)
cerca de
|
V

--
Error en el programa:

    El programa está vacío.

This should fix it: https://github.com/gobstones/PyGobstones-Lang/issues/9


ENV variables for static binary

Hi guys, thanks for great project!
I dont know where I can ask this question so sorry if its not the right place.
I want to use static binary of my PHP|Laravel app inside alpine image in my CD process (k8, etc).
I`ve read https://frankenphp.dev/docs/config but still have an issue with env vars: My PHP application doesnt see env vars from alpine image.
Dockerfile:
FROM --platform=linux/amd64 dunglas/frankenphp:static-builder AS builder

WORKDIR /go/src/app/dist/app
COPY . .

//custom php.ini with variables_order = EGPCS
COPY config/app.ini /etc/php83/conf.d/custom_php.ini

RUN composer install --ignore-platform-reqs --no-dev -a

WORKDIR /go/src/app/
RUN EMBED=dist/app/ \
    PHP_EXTENSIONS=apcu,intl,opcache,zip,rdkafka,redis,bcmath,pdo_mysql,pcntl \
    ./build-static.sh

FROM alpine:3.19.0

WORKDIR /app

COPY --from=builder /go/src/app/dist/frankenphp-linux-x86_64 lara-app

EXPOSE 80

CMD ["./lara-app", "php-server"]

in the alpine container:
/app # env
HOSTNAME=c6b6a517dc1d
SHLVL=1
HOME=/root
TERM=xterm
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
PWD=/app
USER_NAME=ClarkKent

in the PHP code:
var_dump(getenv('USER_NAME'));
die();

I get NULL
Can you point me where I am wrong?

What is the contents of $_ENV? This might be a bug, but it would be good to check that in your entrypoint (before loading any other files), that it is empty. Sometimes frameworks will clear out the environment based on a whitelist (cough, Symfony).

@withinboredom thanks! You point me in the right way.
My flow was wrong:

build image docker build -f Dockerfile-static -t frankenapp .
run container docker run -d -p 8888:80 frankenapp
add env by export USER_NAME=ClarkKent inside running container <------ wrong
check http://localhost:8888 with var_dump

Correct flow:

build image docker build -f Dockerfile-static -t frankenapp .
run container with correct env var docker run -e USER_NAME=ClarkKent -d -p 8888:80 frankenapp <---- correct
check http://localhost:8888 with var_dump


[KeyVault] - Delete methods should ignore 404

What

Ensure KeyVaultAccessControlClient delete* methods ignore 404s and return void
Update tests to use supportsTracing helper

Why

This came up in a recent architecture discussion. By succeeding when trying to delete a role definition that was already deleted we make retries much easier for the consumer.
The supportsTracing helper was added after these tests were written and is much more comprehensive.

Resolves #15580

@chradek / @xirzec how does this API look to you?


Handling encoding issues in athena.read_sql_query

Hi,
I tried to run a query (setting ctas_approach = False) in a sagemaker processing job but I got some encoding errors.
Then, I tried to run the same query (with the same setting) in a sagemaker notebook instance and it worked fine.
I noticed that everything worked fine in the sagemaker processing job by setting ctas_approach = True, but I have no idea why.
In general, what would be the best way to handle encodings in athena.read_sql_query? Would it be possible to pass extra pandas parameters?
Thanks!

Hi @DavideBossoli88, thanks for reaching out.
Could you copy and paste the error Traceback (log) here, please?

Hi Igor,
below the error on the sagemaker processing job.
Traceback (most recent call last):
File "/opt/ml/processing/input/code/00_create_base_contratti.py", line 135, in
boto3_session = session
File "/usr/local/lib/python3.6/site-packages/awswrangler/athena.py", line 542, in read_sql_query
session=session,
File "/usr/local/lib/python3.6/site-packages/awswrangler/athena.py", line 665, in _resolve_query_without_cache
boto3_session=session,
File "/usr/local/lib/python3.6/site-packages/awswrangler/s3/_read.py", line 437, in read_csv
**pandas_kwargs,
File "/usr/local/lib/python3.6/site-packages/awswrangler/s3/_read.py", line 129, in _read_text
for p in paths
File "/usr/local/lib/python3.6/site-packages/awswrangler/s3/_read.py", line 129, in
for p in paths
File "/usr/local/lib/python3.6/site-packages/awswrangler/s3/_read.py", line 198, in _read_text_full
df: pd.DataFrame = parser_func(f, **pandas_kwargs)
File "/usr/local/lib64/python3.6/site-packages/pandas/io/parsers.py", line 676, in parser_f
return _read(filepath_or_buffer, kwds)
File "/usr/local/lib64/python3.6/site-packages/pandas/io/parsers.py", line 448, in _read
parser = TextFileReader(fp_or_buf, **kwds)
File "/usr/local/lib64/python3.6/site-packages/pandas/io/parsers.py", line 880, in init
self._make_engine(self.engine)
File "/usr/local/lib64/python3.6/site-packages/pandas/io/parsers.py", line 1114, in _make_engine
self._engine = CParserWrapper(self.f, **self.options)
File "/usr/local/lib64/python3.6/site-packages/pandas/io/parsers.py", line 1891, in init
self._reader = parsers.TextReader(src, **kwds)
File "pandas/_libs/parsers.pyx", line 529, in pandas._libs.parsers.TextReader.cinit
File "pandas/_libs/parsers.pyx", line 720, in pandas._libs.parsers.TextReader._get_header
File "pandas/_libs/parsers.pyx", line 916, in pandas._libs.parsers.TextReader._tokenize_rows
File "pandas/_libs/parsers.pyx", line 2063, in pandas._libs.parsers.raise_parser_error
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc2 in position 4857: ordinal not in range(128)

Thank you @DavideBossoli88, we will try to replicate it.

@DavideBossoli88, I was not able to replicate your issue, did you have some news from your side?
Also, could you provide more details?

What kind of query are you running? Simple SELECT queries?
Are you using some encryption or workgroup argument?
Is your workgroup configured with some encryption?

@DavideBossoli88 in the meanwhile could you test the version in our development branch?
pip install git+https://github.com/awslabs/aws-data-wrangler.git@dev

We've refactored the Athena module (PR #325) and maybe it solves your issue.

Released in 1.7.0!

Hi @DavideBossoli88
It is totally off-topic, but we are stating a "Who uses AWS Data Wrangler?" section. So feel free to add yourself if you want 😄 .

has the bug been fixed?

@cotrariello84 Yes this was released in 1.7.0

Hi @malachi-constant I still have the bug in version 2.17.0. I had to use pyathena to solve it. but I 'd like to use wrangler.

@cotrariello84 Can you open a new issue with specifics on the error you're encountering as well as steps to replicate the scenario?


Ability to enable Sentry breadcrumbs

Hi there!
Thanks for simple, but useful middleware. And I'm interested, why you decided to complete disable breadcrumbs in Sentry client by setting enable_breadcrumbs to False in sentry_kwargs?
Maybe it is better to have it disabled by default, but still be able to overwritten by user, like,
    def __init__(self, sentry_kwargs=None):
        if sentry_kwargs is None:
            sentry_kwargs = {}

        sentry_kwargs = {
            'transport': raven_aiohttp.AioHttpTransport,
            **sentry_kwargs,
        }
        sentry_kwargs.setdefault('enable_breadcrumbs', False)
        self.client = raven.Client(**sentry_kwargs)

?

Hey! Glad to hear you like the library :)
It was a long time ago, but I'm pretty sure I did this because raven always used thread local storage to store breadcrumbs, even though all asyncio requests are processed in the same thread. This means all requests' breadcrumbs ended up being passed in all Sentry events :(
Do you think this changed since then? Or maybe I'm completely misremembering?

@underyx
Hm, interesting point. From other side, I'm heavily using Sentry with breadcrumbs for my aiohttp projects (via logging config) and looks like they worked just fine.
Anyway, what I'm proposing here: to have a flexibility for dev to enable breadcrumbs if it wants too.


Parameters marked as type "header" are not place in the header.

I am trying to get a ruby project going with swagger - the API in question requires an API token be passed in the header.
In your examples you mark parameters as "header" but then it swagger-ui still places them in the query string - which only works for your API.
As a temp fix I am always making the token the first parameter and have make the following horrible, horrible hack to get things working; (in submitOperation of swagger-ui.js)

if (error_free) {
	var params = form.serializeArray();
	var token_name = params[0].name;
	var token_value = params[0].value;
	params.splice(0,1);
	var invocationUrl = this.operation.invocationUrl(params);
	$(".request_url", this.elementScope + "_content_sandbox_response").html(
		"<pre>" + invocationUrl + "</pre>"
	);
	$.ajax(
	{  url: invocationUrl,  dataType: 'json',  data: '{}',  success: this.showResponse, beforeSend:
	function (xhr) {
	            xhr.setRequestHeader(token_name, token_value);
	        }

	}
	).complete(this.showCompleteStatus).error(this.showErrorStatus);
}

Any thoughts on a permanent fix for this?

Hi, yes, we need to add support for headers, post, put, delete from the UI.  Will report back here as we get that in.

Hi agileanimal, looks like we're going to bake this into our next release which is 1.1.  More on that soon.

That's great!


Docker build fails because of OpenSSL.

This fails because there is no OpenSSL library for the musl target on the Debian build image. I think this would have to be built manually.
@wk, is there a reason this builds atop a Debian image and not Alpine directly?

Utilizing the rust-lang docker base image allowed for convenient control of rust version, those images happento be based on top of Debian.
Addressed in #199 (from work done in #198 by @partim) to move build over completely to alpine and meet openssl dependency.

Additionally, we don’t even need OpenSSL anymore.


FileNotFoundError: [WinError 2]

Traceback (most recent call last):
File "read.py", line 19, in
run(["gifsicle", "-U", sys.argv[1]], stdout=tmpfile)
File "D:\ProgramFiles\miniconda3\lib\subprocess.py", line 488, in run
with Popen(*popenargs, **kwargs) as process:
File "D:\ProgramFiles\miniconda3\lib\subprocess.py", line 800, in init
restore_signals, start_new_session)
File "D:\ProgramFiles\miniconda3\lib\subprocess.py", line 1207, in _execute_child
startupinfo)
FileNotFoundError: [WinError 2] Nie można odnaleźć określonego pliku

while executing

python read.py wale.gif wale.tgs

wale.gif is in the read.py's directory

I'm having the same issue when trying to load Gif's from either root or any folder within
python read.py ./inputs/1.gif 1.tgs
Maybe this is a Miniconda3 related error?

I'm having the same issue when trying to load Gif's from either root or any folder within
python read.py ./inputs/1.gif 1.tgs
Maybe this is a Miniconda3 related error?

Chances are you are missing gifsicle, not your file. Make sure gifsicle is in PATH.


single quote in text field

It will cause the compiling error such as
syntax error (code 1): , while compiling
I tried replacing single quote with two single quote, but it has no effect. The library will still use backslash to escape one single quote and drop the other one.

I am not sure I understand what is the issue and where ?

check this http://stackoverflow.com/questions/603572/how-to-properly-escape-a-single-quote-for-a-sqlite-database

Everything seems to be working fine.

@andpor  the link says NOT backslash escape BUT two single quotes.
A string constant is formed by enclosing the string in single quotes ('). A single quote within the string can be encoded by putting ## two single quotes in a row - as in Pascal. C-style escapes using the backslash character are not supported because they are not standard SQL. BLOB literals are string literals containing hexadecimal data and preceded by a single "x" or "X" character. ... A literal value can also be the token "NULL".

tx.executeSql('INSERT INTO Employees (name, office, department) VALUES (?,?,?)',["Sylvester Sta'llone's Game", 2,  4]);
What is not working here ? I think you are confusing JS string syntax rules with SQLite..

I'm didn't see this use of escaping in your code demo. So I just thought it couldn't be used like this.
Sorry for missing it.


Changed function expressions declarations from let to const

Every variable that wouldn't change should be declared as const for safety reasons.
We can assume that function expressions would not be overwritten.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.:x: KonradLinkowski sign nowYou have signed the CLA already but the status is still pending? Let us recheck it.

I agree, thank you.


[pcl] fix mismatching number of debug and release binaries

Fixes https://github.com/microsoft/vcpkg/issues/34521

[x] Changes comply with the maintainer guide
[ ] SHA512s are updated for each updated download
[ ] The "supports" clause reflects platforms that may be fixed by this new version
[ ] Any fixed CI baseline entries are removed from that file.
[ ] Any patches that are no longer applied are deleted from the port's directory.
[x] The version database is fixed by rerunning ./vcpkg x-add-version --all and committing the result.
[x] Only one version is added to each modified port's versions file.

Pinging @Adela0814  for response. Is work still being done for this PR?


Why the linear input for Layer.pack "must be of type torch.half"?

It seems that if we remove assert in the Layer.pack, then we can pack an bf16 linear?
By the way, will marlin support "int4 \times bf16" as input?

Hi, Marlin currently does not support BF16 inputs (though in many cases you can just convert your BF16 model to FP16). These require slightly different GPU instructions as well as a slightly different dequantization process (since there are only 5 mantissa bits). This is also why Layer.pack has a corresponding assert.

hi, I notice that the core mma function for bf16 is supported by vllm's gptq marlin. It seems that a few changes can do this feature. https://github.com/vllm-project/vllm/blob/main/csrc/quantization/gptq_marlin/gptq_marlin.cu#L89

@Azure-Tang
Is bf16 support done? Have you made a PR elsewhere?

@Azure-Tang Is bf16 support done? Have you made a PR elsewhere?

Didnt donw yet, maybe next week?


feat(test) - add status page test for 942270

This PR adds the test 942270-2 that only triggers this one rule. Intentionally missing word boundary at the start so that this test does not trigger other sqli detection rules.

Tested: works for me, too.
Merging.


@FormParam produces invalid output

Q
A

Bug or feature request?
Bug

Which Swagger-Core version?
2.0.0-rc2

Which Java version?
1.8u152

Which JAX-RS framework & version?
jax-rs2 2.0.0-rc2

When using @FormParam in a method, the generated spec produces an "in" value of "form"
	@POST
	@Operation
	SomeResponse doSomething(@FormParam("someInput") String someInput);

Would produce parameters in the generated spec that looks like this:
"parameters":[
               {
                  "name":"someInput",
                  "in":"form",
                  "schema":{
                     "type":"string"
                  }
               }]

Which fails when using the spec in swagger editor with the following:
should be equal to one of the allowed values
allowedValues: path, query, header, cookie```

@FormParam support has been fixed in latest 2.0.0-SNAPSHOT available on Sonatype and in coming soon release; please notice the naming/package change since rc2 (see #2485).
The outcome of your example would look like:
...
post:
      operationId: doSomething
      requestBody:
        content:
          '*/*':
            schema:
              type: object
              properties:
                someInput:
                  type: string
...

Closing ticket, please reopen if you are still experiencing issues


[CT-1951] [Feature] get_relations_by_pattern should move from utils to Core

Is this your first time submitting a feature request?

[X] I have read the expectations for open source contributors
[X] I have searched the existing issues, and I could not find an existing issue for this feature
[X] I am requesting a straightforward extension of existing dbt functionality, rather than a Big Idea better suited to a discussion

Describe the feature
This is prompted by https://github.com/dbt-labs/dbt-utils/pull/753, which aims to add support for Redshift external tables to the above macro.
It is unclear whether/how the other adapters' implementations support external tables, and as I started looking into it I realised that since it was poking around in the information schema directly, it is probably something that would be better suited to a consistent, reliable cross-database implementation. That is to say, it would be better suited to living in the adapters!
Describe alternatives you've considered
YOLO-merging the changes and accepting that Redshift finds external tables where BQ wouldn't (NB: I have no idea whether BQ's version finds external tables, that's the whole problem). I'll be back in this same spot in 6 months when someone opens another utils issue for another adapter, and so on.
Who will this benefit?
Mostly me? Also users of smaller adapters, especially those that don't have an info schema.
I forgot to fully deprecate its older and less flexible get_relations_by_prefix sibling macro during the v1 migration. For the avoidance of doubt, you shouldn't migrate that over.
Both of these would stick around in dbt utils using the same sort of forwarding setup as {{ dbt.type_int() }} and friends had in the 0.9.x vintage.
Are you interested in contributing this feature?
If needed, but there's probably others who could do it better!
Anything else?
No response

Thanks for opening this @joellabes !
Big picture

since it was poking around in the information schema directly, it is probably something that would be better suited to a consistent, reliable cross-database implementation

💯 agreed that this would benefit from a reliable cross-database implementation!
Connecting the dots
I see this as spiritually related to:

https://github.com/dbt-labs/dbt-core/issues/6449

And it might resolve many or all of these:

https://github.com/dbt-labs/dbt-utils/pull/698
https://github.com/dbt-labs/dbt-utils/issues/546
https://github.com/dbt-labs/dbt-utils/issues/752
https://github.com/dbt-labs/dbt-utils/issues/648
https://github.com/dbt-labs/dbt-utils/issues/269

Brass tacks
What's involved
I didn't robustly check all the details, but it looks like removing get_relations_by_pattern from dbt-utils would also take a few other macros along with it. So the listing of macros-to-remove from dbt_utils would be:

get_relations_by_pattern
get_tables_by_pattern_sql
get_matching_schemata
get_table_types_sql

These are found in the following files:

https://github.com/dbt-labs/dbt-utils/blob/1.0.0/macros/sql/get_relations_by_pattern.sql
https://github.com/dbt-labs/dbt-utils/blob/1.0.0/macros/sql/get_tables_by_pattern_sql.sql
https://github.com/dbt-labs/dbt-utils/blob/1.0.0/macros/sql/get_table_types_sql.sql

This would require double-checking -- maybe that's it, but maybe there would be more.
Considering the current implementation of get_relations_by_pattern as-is
The current implementation of get_relations_by_pattern defers the actual pattern matching bit to get_tables_by_pattern_sql (whose default of implementation relies on ilike).
Rather than just upstreaming get_relations_by_pattern, etc to dbt-core as-is, I'd like to invert the dynamic and consider:

What abstractions could/should we have in dbt adapters in order to "get a list of relations matching a pattern"?
How can dbt-utils hook utilize those abstractions as-needed to maintain backwards-compatibility for as long as it wants?

Maybe the answers to those will lead us to just lift-and-shift the current implementations. But similar to dbt_utils.get_relations_by_prefix leading to dbt_utils. get_relations_by_pattern, the exploration might yield a slightly different set of abstractions.

What abstractions could/should we have in dbt adapters in order to "get a list of relations matching a pattern"?

I wouldn't be averse to this supporting regex for example if it could be done in a broadly compatible way.

This just came up again in https://github.com/dbt-labs/dbt-utils/pull/779

This is still outstanding 10 months later.  Is it possible we get the original PR i made to resolve this merged @joellabes seeing as there appears to be no traction on a fix in dbt-core.


fixed horizontal scroll on profile page

Horizontal scroll fixed for profile pages with background.

Can you give me a pubkey for which this is an issue so I can duplicate before merging?

You can reproduce it for example on: https://coracle.social/people/npub1xtscya34g58tk0z605fvr788k263gsu6cy9x0mhnm87echrgufzsevkk5s/notes
Horizontal scroll appears on wider screens, when menu is fixed - for example in my screen case 1920x1080

Awesome, thank you! I'll merge this in a little bit.


create function to split environ into an array and extern environ variable

function create_env_vars_array of src/code_pieces/env_array.c is doing this. It was tested with src/tests/create_env_vars_array.c


docs:widget-space

Updated the README.md for space widget on how to use the modules directly by importing and rendering them directly.

Closing this for now, due to npm usage of the widgets not being fully supported yet.


Structured switch checks

Fixes #491

Basic blocks now have a link to the terminator
Check all case sepecific rules
Missing check for branching into the middle of a case

Filed #1618 to check for branches into the middle of a case.
This was a bit complicated because we don't populate case constructs and I don't think the validator representation of constructs would be well suited to it. Instead it checks case constructs if it sees a selection construct with a switch terminator.

I've tried to improve the error messages and comments @dj2. Let me know if they're clearer.

Rebased, squashed and committed as ea7239fa73dfa0daa704d335673220e66e935cbd


Content Management System

Describe the project you want to add with tech stack
Content management system is a MERN based project that allow individuals or organizations to create, manage, and publish digital content on the web.
Expected behavior
The primary purpose of a CMS is to streamline the process of content creation and modification, making it more efficient and accessible to a wider range of users
Screenshots (optional)

Additional context (optional )

Please assign me this issue under gssoc'23


any benchmark against redis?

any benchmark against redis?

It makes no sense to compare the Kvrocks with Redis directly since the storage and thread model was totally different. We have a simple performance benchmark on README: https://github.com/KvrocksLabs/kvrocks#performance, from the throughput side, the Kvrocks would be better than Redis in many commands.

how much slower do u think kvrocks will be compared with redis?

It depends on the disk type, the latency of most commands on NVMe should be as good as Redis, SATA disks would much worse but we didn’t have any performance on it.

@hiqsociety I ran a simple test using redis-benchmark tool, I can say that kvrocks perform very well as below using DigitalOcean. Eventhough it persist data to disk, it can be almost as fast as Redis/KeyDB. I reckon if we give it more cpu cores and ram, it would perform even better. Very good job to kvrocks team @git-hulk @ShooterIT. We are awaiting their cluster mode feature and hope they can make their cluster mode to work like Redis whereby it can automatically handle failover and high availability!
Single Node - General Purpose / 16 GB / 4 vCPUs instance
kvrocks
PING_INLINE: 88339.23 requests per second
PING_BULK: 92678.41 requests per second
SET: 58513.75 requests per second
GET: 96525.09 requests per second
INCR: 50968.40 requests per second
LPUSH: 46728.97 requests per second
RPUSH: 46970.41 requests per second
LPOP: 43308.79 requests per second
RPOP: 42973.79 requests per second
SADD: 53390.28 requests per second
HSET: 39261.88 requests per second
SPOP: 63211.12 requests per second
LPUSH (needed to benchmark LRANGE): 45187.53 requests per second
LRANGE_100 (first 100 elements): 44742.73 requests per second
LRANGE_300 (first 300 elements): 21542.44 requests per second
LRANGE_500 (first 450 elements): 15434.48 requests per second
LRANGE_600 (first 600 elements): 12137.39 requests per second
MSET (10 keys): 16835.02 requests per second
I didn't get to save the results for above machine spec for KeyDB which is a forked of Redis but run on multithreads.
4C (Shared), 8GB, NVMe, 10 worker threads
kvrocks
PING_INLINE: 59630.29 requests per second
PING_BULK: 63131.31 requests per second
SET: 34352.46 requests per second
GET: 56785.91 requests per second
INCR: 30156.82 requests per second
LPUSH: 26652.45 requests per second
RPUSH: 24527.84 requests per second
LPOP: 24166.26 requests per second
RPOP: 23424.69 requests per second
SADD: 22644.93 requests per second
HSET: 21720.24 requests per second
SPOP: 55187.64 requests per second
LPUSH (needed to benchmark LRANGE): 24764.73 requests per second
LRANGE_100 (first 100 elements): 24218.94 requests per second
LRANGE_300 (first 300 elements): 11956.00 requests per second
LRANGE_500 (first 450 elements): 8792.75 requests per second
LRANGE_600 (first 600 elements): 6853.07 requests per second
MSET (10 keys): 10051.26 requests per second
4C (Shared), 8GB, NVMe, 10 worker threads
KeyDB (purely memory based)
PING_INLINE: 57971.02 requests per second
PING_BULK: 61236.99 requests per second
SET: 59066.75 requests per second
GET: 56689.34 requests per second
INCR: 50301.81 requests per second
LPUSH: 52631.58 requests per second
RPUSH: 60679.61 requests per second
LPOP: 49578.58 requests per second
RPOP: 54525.63 requests per second
SADD: 58616.65 requests per second
HSET: 54495.91 requests per second
SPOP: 54555.38 requests per second
LPUSH (needed to benchmark LRANGE): 51975.05 requests per second
LRANGE_100 (first 100 elements): 35587.19 requests per second
LRANGE_300 (first 300 elements): 17590.15 requests per second
LRANGE_500 (first 450 elements): 12269.94 requests per second
LRANGE_600 (first 600 elements): 9795.28 requests per second
MSET (10 keys): 54614.96 requests per second

Many thanks for @hengsok benchmark data, those were benched without the -r option? which would use random keys instead of a single one. I think kvrocks would perform better with random keys since we have to lock the key when writing to prevent data race.

And you should enable multi threads in redis-benchmark, such as --threads 8

I have tried again following @git-hulk suggestions with the -r options using length of 8 and 16 for comparisons. I also experiment with changing the number of workers setting in the kvrocks.conf file.
I have noticed that during the SET test, below is the CPU and Memory stats from TOP. It seems kvrocks does not fully utilise the 32GB memory I provisioned. Strange. Is there any configuration to make sure kvrocks maximises memory usage?
CPU also only hover around 20-25% range.
I have tried your suggestions @ShooterIT but the current build of redis-benchmark no longer support --threads params.
We got the error
Invalid option "--threads" or option argument missing
I believe by specifying the -c which is the number of clients, redis-benchmark is already parallelising the requests up to 500 clients as we have specified in the test.
General Purpose / 32 GB / 8 vCPUs / NVMe
%Cpu(s): 20.2 us, 21.1 sy,  0.0 ni, 54.5 id,  0.0 wa,  0.0 hi,  4.1 si,  0.0 st
MiB Mem :  32116.9 total,  26104.4 free,   1001.6 used,   5010.9 buff/cache
MiB Swap:      0.0 total,      0.0 free,      0.0 used.  30663.2 avail Mem
kvrocks (8 workers)
redis-benchmark -p 6666 -d 50 -c 500 -n 1000000  -r 16 -q
PING_INLINE: 75448.92 requests per second
PING_BULK: 78733.95 requests per second
SET: 62247.12 requests per second
GET: 81853.16 requests per second
INCR: 62664.49 requests per second
LPUSH: 48260.22 requests per second
RPUSH: 47114.25 requests per second
LPOP: 38842.49 requests per second
RPOP: 37030.18 requests per second
SADD: 49091.80 requests per second
HSET: 55285.27 requests per second
SPOP: 71525.64 requests per second
LPUSH (needed to benchmark LRANGE): 45203.87 requests per second
LRANGE_100 (first 100 elements): 41012.18 requests per second
LRANGE_300 (first 300 elements): 16218.23 requests per second
LRANGE_500 (first 450 elements): 12822.49 requests per second
LRANGE_600 (first 600 elements): 8941.90 requests per second
MSET (10 keys): 9546.72 requests per second
General Purpose / 32 GB / 8 vCPUs / NVMe
kvrocks (16 workers)
redis-benchmark -p 6666 -d 50 -c 500 -n 1000000  -r 16 -q
PING_INLINE: 77845.24 requests per second
PING_BULK: 80121.79 requests per second
SET: 59333.09 requests per second
GET: 74693.76 requests per second
INCR: 58661.34 requests per second
LPUSH: 45543.56 requests per second
RPUSH: 44507.74 requests per second
LPOP: 36072.43 requests per second
RPOP: 37378.98 requests per second
SADD: 48887.80 requests per second
HSET: 58654.47 requests per second
SPOP: 74521.20 requests per second
LPUSH (needed to benchmark LRANGE): 44004.40 requests per second
LRANGE_100 (first 100 elements): 39089.98 requests per second
LRANGE_300 (first 300 elements): 15401.44 requests per second
LRANGE_500 (first 450 elements): 12331.67 requests per second
LRANGE_600 (first 600 elements): 8924.75 requests per second
MSET (10 keys): 9741.18 requests per second
General Purpose / 32 GB / 8 vCPUs / NVMe
kvrocks (8 workers)
redis-benchmark -p 6666 -d 50 -c 500 -n 1000000  -r 8 -q
PING_INLINE: 79936.05 requests per second
PING_BULK: 79182.84 requests per second
SET: 62065.54 requests per second
GET: 73844.34 requests per second
INCR: 61087.35 requests per second
LPUSH: 43230.16 requests per second
RPUSH: 45491.77 requests per second
LPOP: 36296.32 requests per second
RPOP: 37767.20 requests per second
SADD: 48236.94 requests per second
HSET: 58775.12 requests per second
SPOP: 69189.79 requests per second
LPUSH (needed to benchmark LRANGE): 44255.62 requests per second
LRANGE_100 (first 100 elements): 38172.31 requests per second
LRANGE_300 (first 300 elements): 15107.57 requests per second
LRANGE_500 (first 450 elements): 12413.26 requests per second
LRANGE_600 (first 600 elements): 8837.20 requests per second
MSET (10 keys): 9850.18 requests per second

hi @hengsok To use --threads in benchmark, you should use latest redis-benchmark, unstable branch of redis https://github.com/redis/redis. And -r is specified range, you should use a bigger number.
such as redis-benchmark -p 6666 -d 50 -c 500 -n 1000000 -r 10000000 -q --threads 8

For memory usage, please see https://github.com/KvrocksLabs/kvrocks/blob/unstable/kvrocks.conf#L324
Currently, cluster solution is experimental, we are developing a meta server to manage cluster, coming soon, if you want to have a try, please https://github.com/KvrocksLabs/kvrocks/pull/302
Kvrocks support Codis cluster, but doesn't  support to scale i.e. can't migrate slot date.

@ShooterIT thanks for the tips.
Can't wait for your full cluster solution. I have tried the try_cluster. Does your implementation support dynamic addition of more nodes? If it supports, then how do we reassign slots? It seems your current implementation is still very manual based and I am not sure how the nodes are gonna handle moving of data from one node to the next to rebalance upon adding more nodes

Coming soon!


fromInfinite errors

Running the following example:
naturals :: UChimera Int
naturals = fromInfinite (0...)

main :: IO ()
main = print (index naturals 0)

results in the error
Data.Primitive.Array.fromListN: list length greater than specified size
CallStack (from HasCallStack):
  error, called at ./Data/Primitive/Array.hs:373:19 in primitive-<IP_ADDRESS>-EBSr4O8W5US1YYODUpLUQc:Data.Primitive.Array

Can you confirm if you can also reproduce this @Bodigrim? I can prepare a PR for this one as well. Thanks!

Yep, I can reproduce this one as well.

Opened PR https://github.com/Bodigrim/chimera/pull/41 with a fix

Fixed in #41.


harbor_project_member_group are always replaced

harbor_project_member_group are always recreated.
Example of plan output :
# harbor_project_member_group.registries["quay-io"] must be replaced
-/+ resource "harbor_project_member_group" "registries" {
      ~ id         = "/projects/6/members/23" -> (known after apply)
      + member_id  = (known after apply)
      ~ project_id = "/projects/6" -> "6" # forces replacement
        # (3 unchanged attributes hidden)
    }

I have the opposite behaviour as in Issues 175
My stack:

terraform harbor provider : 3.7.1
terraform: 1.1.9
OS: osx

@michenux: I cannot reproduce your issue. Could you please share your terraform code ?


Query builder old queries

NOw when a query number changes and you need to rerun it, the old query stays and you need to delete it manually.
Is that intentional? Maybe this is better?
Not a big issue, we can discuss it briefly on the next call.

Was this only happening for phenotype queries?  If so, the small fix I just released might help.

It could have been, I can't remember. But I'll keep an eye out for it  again. Not critical.

seems to be fixed.


Style with ~path is not resolved correctly

Hi!
I noticed that I cannot build my app properly on Windows, the problem seems to lie in ~ import in sass file (bootstrap specifically), the resolved path looks broken because it is doubled, take a look at the log
I guess the problem was caused by this code https://github.com/angular/angular-cli/commit/9caa7ca#diff-aa06fda1fc53d1b1e6d1259f3cf4ca2d .
The resolved path for fonts becomes c:\vhosts\frontend-client\src\c:vhosts�rontend-clientnode_modules�ootstrap-sass ssets�onts�ootstrapglyphicons-halflings-regular.eot
Versions
Angular CLI: 1.6.3
Node: 8.9.4
OS: win32 x64
Angular: 5.2.0
... animations, common, compiler, compiler-cli, core, forms
... http, language-service, platform-browser
... platform-browser-dynamic, router

@angular/cli: 1.6.2
@angular-devkit/build-optimizer: 0.0.36
@angular-devkit/core: 0.0.22
@angular-devkit/schematics: 0.0.42
@ngtools/json-schema: 1.1.0
@ngtools/webpack: 1.9.3
@schematics/angular: 0.1.11
@schematics/schematics: 0.0.11
typescript: 2.6.2
webpack: 3.10.0

Repro steps

install<EMAIL_ADDRESS>create new project with scss styles
install<EMAIL_ADDRESS>and<EMAIL_ADDRESS>in src/styles.scss set $icon-font-path: '~bootstrap-sass/assets/fonts/bootstrap/'; at the top
then below add @import "~bootstrap-sass/assets/stylesheets/bootstrap";
try to ng serve or ng build

Observed behavior
ERROR in ./node_modules/css-loader?{"sourceMap":false,"importLoaders":1}!./node_modules/postcss-loader/lib?{"ident":"postcss","sourceMap":false}!./node_modules/sass-loader/lib/loader.js?{"sourceMap":false,"precision":8,"includePaths":[]}!./src/styles.scss
Module not found: Error: Can't resolve './c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot' in 'c:\vhosts\frontend-client\src'
resolve './c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot' in 'c:\vhosts\frontend-client\src'
  using description file: c:\vhosts\frontend-client\package.json (relative path: ./src)
    Field 'browser' doesn't contain a valid alias configuration
  after using description file: c:\vhosts\frontend-client\package.json (relative path: ./src)
    using description file: c:\vhosts\frontend-client\package.json (relative path: ./src/c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot)
      no extension
        Field 'browser' doesn't contain a valid alias configuration
        c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot doesn't exist
      .ts
        Field 'browser' doesn't contain a valid alias configuration
        c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot.ts doesn't exist
      .js
        Field 'browser' doesn't contain a valid alias configuration
        c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot.js doesn't exist
      as directory
        c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot doesn't exist
[c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot]
[c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot.ts]
[c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot.js]
[c:\vhosts\frontend-client\src\c:vhostsrontend-clientnode_modulesootstrap-sass
ssetsontsootstrapglyphicons-halflings-regular.eot]
 @ ./node_modules/css-loader?{"sourceMap":false,"importLoaders":1}!./node_modules/postcss-loader/lib?{"ident":"postcss","sourceMap":false}!./node_modules/sass-loader/lib/loader.js?{"sourceMap":false,"precision":8,"includePaths":[]}!./src/styles.scss 7:4344-4479 7:4510-4645
 @ ./src/styles.scss
 @ multi ./src/styles.scss

Desired behavior
Successful build

Still get same error with 1.6.7
By the way I figured out that error happens only with .css files import.
For example:
@import "~font-awesome/css/font-awesome.css"; // Compile error

but
@import "~font-awesome/less/font-awesome.less"; // No error

it looks a bit strange

Is this issue abandoned? @hansl, do you have any plans to fix it?

@Iverson  All of the issues discussed in this thread have been addressed if using the latest stable release (1.7.3).   If you are still encountering issues while using this version (within the project), please open a new issue with a minimal reproduction that demonstrates the problem.


Missing files

Hey, I came across your work and found it great. Can you please provide the GT label files, just wanted to check the performance of the Multi cam tracker

Thanks, because of policy of the dataset I think I cannot provide it.
Maybe you can get the dataset from public site : https://www.aicitychallenge.org/2023-data-and-evaluation/
You can use there GT and evaluation metric for comparing with another teams also.