Rework on error reporting to make it more verbose and human-friendly.

Co-authored-by: MaxKsyunz<EMAIL_ADDRESS>Co-authored-by: forestmvey<EMAIL_ADDRESS>Signed-off-by: Yury-Fridlyand<EMAIL_ADDRESS>Description
Re-creation of PR #108.
Issues Resolved
1.
Added cast validation and user-friendly error messages
SELECT phrase, insert_time2 from phrase WHERE match_phrase(phrase, 'brown fox', slop = 0.5);

before
{'reason': 'Invalid SQL query', 'details': 'For input string: "0.5"', 'type': 'NumberFormatException'}

after
{'reason': 'There was internal problem at backend', 'details': "Invalid slop value: '0.5'. Accepts only integer values.", 'type': 'RuntimeException'}

2.
Cast validation and user-friendly errors for all enum types
select `key` from calcs where multi_match([str1], 'DVD', zero_terms_query=meow);

before
{'reason': 'Invalid SQL query', 'details': 'No enum constant org.opensearch.index.search.MatchQuery.ZeroTermsQuery.MEOW', 'type': 'IllegalArgumentException'}

after
{'reason': 'There was internal problem at backend', 'details': "Invalid zero_terms_query value: 'meow'. Available values are: NONE, ALL, NULL.", 'type': 'RuntimeException'}

3.
Extended error message when incorrect parameters specified
SELECT phrase, insert_time2 from phrase WHERE match(phrase, 'brown fox', slop = 0);

before
{'reason': 'Invalid SQL query', 'details': 'Parameter slop is invalid for match function', 'type': 'SemanticCheckException'}

after
{'reason': 'Invalid SQL query', 'details': 'Parameter slop is invalid for match function. Available parameters are: analyzer, auto_generate_synonyms_phrase_query, boost, fuzziness, fuzzy_rewrite, fuzzy_transpositions, lenient, minimum_should_match, max_expansions, operator, prefix_length, zero_terms_query', 'type': 'SemanticCheckException'}

4.
A bit better error on typo in function name
SELECT phrase, insert_time2 from phrase WHERE match_phrase2(phrase, 'brown fox', slop = 0);

before
TransportError(503, 'Exception', {'error': {'reason': 'There was internal problem at backend', 'details': '[701f78b8-da61-4eb1-a00a-18f089f5644d] Request SQLQueryRequest(jsonContent={"query":"SELECT phrase, insert_time2 from phrase WHERE match_phrase2(phrase, \'brown fox\', slop = 0)"}, query=SELECT phrase, insert_time2 from phrase WHERE match_phrase2(phrase, \'brown fox\', slop = 0), path=/_plugins/_sql/, format=jdbc, params={format=jdbc}, sanitize=true) is not supported and falling back to old SQL engine', 'type': 'Exception'}, 'status': 503})

after
{'reason': 'Invalid SQL query', 'details': "unsupported method: match_phrase2\nQuery failed on both V1 and V2 SQL parser engines. V2 SQL parser error following: \nFailed to parse query due to offending symbol [(] at: 'SELECT phrase, insert_time2 from phrase WHERE match_phrase2(' <--- HERE... More details: Expecting tokens in {<EOF>, ';'}", 'type': 'SqlParseException'}

Check List

[x] New functionality includes testing.

[x] All tests pass, including unit test, integration test and doctest

[x] New functionality has been documented.

[x] New functionality has javadoc added
[x] New functionality has user manual doc added

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

The query
select Title, Body from stackexchange_beer where match(Title, 'Cicerone', blah=0);
returns a useful error message of
{
  "error": {
    "reason": "Invalid SQL query",
    "details": "Failed to parse query due to offending symbol [blah] at: 'select Title, Body from stackexchange_beer where match(Title, Cicerone, blah' <--- HERE... More details: Expecting tokens in {'ALLOW_LEADING_WILDCARD', 'ANALYZER', 'ANALYZE_WILDCARD', 'AUTO_GENERATE_SYNONYMS_PHRASE_QUERY', 'BOOST', 'CUTOFF_FREQUENCY', 'DEFAULT_FIELD', 'DEFAULT_OPERATOR', 'ESCAPE', 'ENABLE_POSITION_INCREMENTS', 'FIELDS', 'FLAGS', 'FUZZINESS', 'FUZZY_MAX_EXPANSIONS', 'FUZZY_PREFIX_LENGTH', 'FUZZY_REWRITE', 'FUZZY_TRANSPOSITIONS', 'LENIENT', 'LOW_FREQ_OPERATOR', 'MAX_DETERMINIZED_STATES', 'MAX_EXPANSIONS', 'MINIMUM_SHOULD_MATCH', 'OPERATOR', 'PHRASE_SLOP', 'PREFIX_LENGTH', 'QUOTE_ANALYZER', 'QUOTE_FIELD_SUFFIX', 'REWRITE', 'SLOP', 'TIE_BREAKER', 'TIME_ZONE', 'TYPE', 'ZERO_TERMS_QUERY'}\nQuery failed on both V1 and V2 SQL engines. V1 SQL engine error following: \nsyntax error, expect AGAINST, actual EOF",
    "type": "ParserException"
  },
  "status": 400
}

but the query
select Title, Body from stackexchange_beer where match_phrase(Title, 'Cicerone', blah=0);
returns
{
  "error": {
    "reason": "There was internal problem at backend",
    "details": "[match_phrase] requires query value",
    "type": "IllegalArgumentException"
  },
  "status": 500
}


Add Basic MVDR module

Summary:

Add PSD module for computing covariance matrix.
Add Time-Frequency Masking based MVDR beamforming module.

TODO:

[x] Add steering vector solution for getting mvdr beamforming weight
[x] Add test code for PSD and MVDR modules
[ ] A colab example to show how to use MVDR on multi-channel audios
[x] Add support for multi-channel Time-Frequency masks
[ ] Add support for complex-valued Time-Frequency masks.

I also benchmark the performance of torch.einsum and torch.matmul when computing the PSD matrix. Here's the test script.
Here is the result:
CPU:
[----------- PSD Computation ------------]
                      |  einsum  |  matmul
1 threads: -------------------------------
      [1, 2, 4000.0]  |     43   |    100
      [1, 2, 8000]    |     62   |    170
      [1, 2, 16000]   |     97   |    290
      [1, 2, 32000]   |    400   |    710
      [1, 4, 4000.0]  |     90   |    240
      [1, 4, 8000]    |    300   |    600
      [1, 4, 16000]   |    550   |   1100
      [1, 4, 32000]   |   2400   |   3400
      [1, 6, 4000.0]  |    400   |    800
      [1, 6, 8000]    |    600   |   1200
      [1, 6, 16000]   |    770   |   2100
      [1, 6, 32000]   |   2300   |   4200
      [1, 8, 4000.0]  |    520   |   1000
      [1, 8, 8000]    |   1300   |   2200
      [1, 8, 16000]   |   1600   |   3400
      [1, 8, 32000]   |   9000   |  13000
4 threads: -------------------------------
      [1, 2, 4000.0]  |     43   |    100
      [1, 2, 8000]    |     61   |    160
      [1, 2, 16000]   |    140   |    400
      [1, 2, 32000]   |    460   |    900
      [1, 4, 4000.0]  |     90   |    240
      [1, 4, 8000]    |    290   |    570
      [1, 4, 16000]   |    550   |   1100
      [1, 4, 32000]   |   2000   |   3600
      [1, 6, 4000.0]  |    460   |    700
      [1, 6, 8000]    |    890   |   1200
      [1, 6, 16000]   |    700   |   2460
      [1, 6, 32000]   |   2300   |   4500
      [1, 8, 4000.0]  |    600   |   1000
      [1, 8, 8000]    |   1000   |   2500
      [1, 8, 16000]   |   1600   |   3700
      [1, 8, 32000]   |   9000   |  13000
16 threads: ------------------------------
      [1, 2, 4000.0]  |     43   |     99
      [1, 2, 8000]    |     60   |    160
      [1, 2, 16000]   |    110   |    330
      [1, 2, 32000]   |    320   |    720
      [1, 4, 4000.0]  |     83   |    240
      [1, 4, 8000]    |    300   |    560
      [1, 4, 16000]   |    560   |   1500
      [1, 4, 32000]   |   1800   |   3100
      [1, 6, 4000.0]  |    330   |    700
      [1, 6, 8000]    |    700   |   1300
      [1, 6, 16000]   |    900   |   1800
      [1, 6, 32000]   |   2100   |   4400
      [1, 8, 4000.0]  |    510   |   1000
      [1, 8, 8000]    |   1300   |   2400
      [1, 8, 16000]   |   1600   |   3600
      [1, 8, 32000]   |   8900   |  13000
32 threads: ------------------------------
      [1, 2, 4000.0]  |     40   |     98
      [1, 2, 8000]    |     60   |    160
      [1, 2, 16000]   |    110   |    340
      [1, 2, 32000]   |    320   |    710
      [1, 4, 4000.0]  |     90   |    240
      [1, 4, 8000]    |    300   |    600
      [1, 4, 16000]   |    800   |   1200
      [1, 4, 32000]   |   2000   |   3200
      [1, 6, 4000.0]  |    300   |    640
      [1, 6, 8000]    |    620   |   1300
      [1, 6, 16000]   |    700   |   1700
      [1, 6, 32000]   |   2100   |   4400
      [1, 8, 4000.0]  |    530   |   1000
      [1, 8, 8000]    |   1400   |   2000
      [1, 8, 16000]   |   1600   |   3400
      [1, 8, 32000]   |   9300   |  13000

Times are in microseconds (us).

According to the table, einsum is faster than matmul operation.

PyTorch currently doesn't support batch version of trace method. There's a linalg.trace PR ongoing. We can change it to PyTorch method after the PR is settled.

@Emrys365 Could you help review the MVDR implementation? Thanks!
In terms of the unit tests, do you have any idea to verify the correctness of the solutions?

I will keep the "complex-valued mask support" as a future plan since I'm not sure of the formula to normalize the psd matrix by the mask. Here is my proposed method:
S = X * mask.unsqueeze(-3)  # complex multiplication
psd = torch.einsum("...cft,...eft->...ftce", [S, S.conj()])
if self.normalize:
    mask = mask.abs() * mask.abs()  # since the numerator multiplies the mask twice
    mask = mask.sum(dim=-1, keepdim=True)
    psd = psd / (mask + eps)


[SPARK-18057][FOLLOW-UP][SS] Update Kafka client version from <IP_ADDRESS> to 2.0.0

What changes were proposed in this pull request?
Increase ZK timeout and harmonize configs across Kafka tests to resol…ve potentially flaky test failure
How was this patch tested?
Existing tests

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/1780/
Test PASSed.

Test build #94182 has started for PR 21995 at commit 517a48e.

Test build #94182 has finished for PR 21995 at commit 517a48e.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/94182/
Test PASSed.


Equal Distribution of Funds using smart contract

PROJECT DESCRIPTION
There are two entities in this project:

A person owner of funds=
A person who has a property can divide and equally distribute his property to his relatives after they get x years old (for example
18 years old)
A beneficiar =
beneficiars will get equally distributed funds after they gets x years old.

Features :
1)A owner can add more funds.
2)A owner can add  or delete beneficiars.
Domain
[x] Solidity
[x] Remix
Are you contributing under any open-source program ?
yes

Great issue @DevSwayam .Start working in this .

Great issue @DevSwayam .Start working in this .
to include in which level?

Great issue @DevSwayam .Start working in this .
to include in which level?

Level 1

Task completed. Contract added in level 1 names as funds distribution


Injecting history

Hi,
I have my backend pushing activity history to my webchat client when someone connects or reconnects.
In my javascript I have the following:
var lastActivityId;

const handleConversationHistory = function (activities) {

    if (activities.length <= 0)
        return;

    var container = document.createElement("div");
    container.className = "wc-message-group-content";

    $.each(activities,
        function (index, activity) {
            if (activity.type !== "event") {
                if (activity.from.id === user.id) {
                    lastActivityId = ("0000000" + (parseInt(activity.id.substr(activity.id.length - 7)) + 1)).slice(-7);
                    const inner = fromMe.format(activity.id, activity.text, activity.from.name);
                    const fromMeElement = document.createElement("div");
                    fromMeElement.innerHTML = inner;

                    container.appendChild(fromMeElement.firstChild);
                } else {
                    const temp = activity.replyToId.substr(0, activity.replyToId.indexOf('|')) + "|" + lastActivityId;
                    const innerAgain = fromBot.format(temp, activity.text, activity.from.name, new Date(activity.timestamp).toLocaleString());
                    const fromBotElement = document.createElement("div");
                    fromBotElement.innerHTML = innerAgain;

                    container.appendChild(fromBotElement.firstChild);
                }
            }
        });

    document.getElementsByClassName("wc-message-group-content")[0].outerHTML = container.outerHTML;
};`

At first sight, activities are inserted nicely into the chat window, and I see the entire history.
But when I post another question to the bot, my question and the corresponding answer are added at the top of the history activities, not at the bottom. So they are in fact inserted at index 0, instead of history.length + 1.
And for the moment I can only handle IActivity of type messageActivity, not yet Herocards or other types.

I made a project a while back that injects chat history into the webchat control.  It may help you https://github.com/JasonSowers/ChatHistoryBot-Public

@youtoofan Here is the code for appending messages. I think we just add it as-is and I didn't see any sorting code in History.tsx.
BTW, we are planning to complete the preservation/restoration/continuation of history in the next phase. It will be more like @JasonSowers solution, a client-side solution.


Online is back ?

Hi!
I think other repo have solution of get online and offline without chat.
https://github.com/mukulhase/WebWhatsapp-Wrapper/issues/578
I think it will help to improve this one.
Thanks

Thanks, @smarteutech.
@LoranKloeze Hey Loran, when you have time, could you please check in the above-provided thread to see if we can get online status without a chat with the target number?
I tried but as I am not great at coding, I am not able to get it to work.
Thanks.

Hi,
I tried. This solution also uses store object and data not set in client. At the same time if i try to connect from phone, data come over websocket. Without chat getting online status is not possible.
Thanks..

Gonna close this. Checking online presence of unknown WA users is not possible. Are you sure it is possible? Send this repo a PR with a working fix.


Some ruby-style refactorings

While reading through the ruby sources of this gem I did some walk-by refactorings to make the ruby sources read more like the ruby style guide recommends.
It is mostly:

trailing whitespaces
rescue statements
needless return statements

If you find this helpful I might follow-up with a PR which integrates rubocop, a highly configurable ruby code linter.
For me (running ruby 2.3.1) the tests do not pass in master nor in my branch. My branch doesn't add any more rspec failures -- it should not change any code semantics.

Hi @tessi, awesome job!
Regarding test failures, are you by any chance using macOS?

Thanks!
yes, I'm on macOS. Can I somehow make things work?

Oh, I just saw https://github.com/SciRuby/rubex/issues/31. This might explain the failures


Suggest adding cairo-path to the protostar.toml

What it task is about?

After a user installs a package Protostar should suggest adding proper cairo-path to the configuration file for example
$ `protostar install OpenZeppelin/cairo-contracts`
...
Should Protostar add `{LIBS_PATH}/cairo_contracts/src` to `protostar.toml::protostar.shared_command_configs::cairo_path` (Y/n)?


194 enh covered distances

Hi! I think the test file is completely correct, but the file with the function still needs some adjustments here and there because it currently contains certain functions that were necessary to execute the function. Hopefully, this won't be needed anymore once it's in the package.

close #194


Unexpected error, I was not using the App

Error: Command failed: /Applications/Kit.app/Contents/Resources/app.asar.unpacked/node_modules/frontmost-app/frontmost-app

    at ChildProcess.exithandler (node:child_process:408:12)
    at ChildProcess.emit (node:events:526:28)
    at maybeClose (node:internal/child_process:1092:16)
    at Process.ChildProcess._handle.onexit (node:internal/child_process:302:5)

Kit 1.30.8
Electron 19.0.16
darwin 21.6.0
Locale: en-US

Hmm, thanks.
The clipboard history manager ignores adding copied items to the clipboard when certain apps are open. It must have failed detecting which app it was.
Do you remember if you were attempting to copy something or do you remember which app was "frontmost" when the error occurred?


Craft 3 support?

We're using your excellent spamguard on a number of our Craft sites. Wondering if there is an upgrade planned for Craft 3.

@pioneerdesign I wasn't planning on upgrading it because there hasn't been much demand for that plugin. However, it wouldn't be a difficult plugin to migrate.
I'll think about migrating it and let you know when I have a time table.

+1 Yes, please this plugin-in is amazing and we would love to use it with all of our future Craft 3 projects.

I'm also interested in this plugin and would love to see it in Craft 3.

@selvinortiz Is this the Craft 3 repository? The README still references Craft 2, but the CHANGELOG states that Craft 3 support was added in version 0.7.0.

@monooso This is the Craft 2 compatible version of the plugin. For Craft 3, see https://github.com/selvinortiz/craft-plugin-spamguard
However, the Craft 3 version is not quite there yet.

@selvinortiz Ah, looking through that repo, it seems somewhat incomplete.
Do you have an update on the status of the Craft 3 work? No expectations, I just have a project which requires Akismet integration, and I don't want to roll my own if you're just about to release an update.

@selvinortiz  Sorry, our comments overlapped. Thanks for the update.

@monooso I shooting for a release within 2 weeks.

Would also love a Craft 3 version :)

Thank you for reminding me to update this thread.
SpamGuard is now Shield (Craft 3) https://plugins.craftcms.com/shield


Show Item ID & Owner for Items in Search Results

When I search my ArcGIS Online Organization for a particular web map item, I may receive multiple results...multiple users having maps with the same title.  If we want to use the 'Update the URLs of Services in a WebMap', we have no way of knowing which map is which.  Can you please include an Item ID and owner Name with each item in the search results?

What, you don't like inspecting every item to figure all of that out?
I've tried to keep the item info as clean as possible, but I agree that more metadata needs to be exposed. I've thought about adding a little info button that would hover a popup with the extra info. Do you think that would suffice? Any suggestions?

The challenge is that sometimes you have the same Item duplicated in a Portal, so we want to make sure that whatever item we're updating/modifying in any way is the correct item.
I would suggest maybe a popup when you hover over an item in the Search Results list.  For starters, I think just showing Item ID on hover would be good enough.

What, you don't like inspecting every item to figure all of that out?

Haha, good one
I've also experienced this exact issue where the item name was the exact same in the search results, but one was owned by a 'Production' user account and the other owned by the 'Staging' user account. Would be great to have the Item ID and the Item Owner Username in an on-hover popup or another mechanism.
I will put something together soon for this one to see how it looks in practice.

Addressed via PR #194.


Mesh: add thin instances

I took model on the regular instance implementation for the thin instance implementation:

added a property _thinInstanceDataStorage of type _ThinInstanceDataStorage to hold the main data (much like _instanceDataStorage / _InstanceDataStorage).
created an additional _userThinInstanceBuffersStorage to hold data for additional custom attributes other than the matrices (much like _userInstancedBuffersStorage). This way, if no custom attributes are added, no penalty paid

I have prefixed all methods by thinInstance, I can change that (notably, addThinInstance is thinInstanceAdd instead).
By default, the bounding box is recomputed to encompass all thin instances, but it can be disabled by setting doNotSyncBoundingInfo to true (already existing property).
As discussed, thin instances are always displayed with shader code assuming non uniform scaling, but with an optimized code (shearing not supported).

Hum, shouldn't I add an optional parameter to the thinInstanceSetBuffer method to create a static buffer instead of a dynamic one, in case the user know they won't update the buffer?

sounds totally fine to me :-)

Also should try to ensure we use the types that are not creating dupplicate in the engine updateBuffer ???

I also wonder if we shouldn't also let the user be able to set the current number of instances (but always < matrixBuffer.length / 16): that way, they would be able to allocate a bigger buffer at start in case they need to have more instances during the course of the program, they would not have to reallocate / copy a buffer each time they have to add an, instance.

Visual test added


The expanded topbar menu remains visible when clicking the browser "back" button

...I just looked at the Foundation site, and this appears to be the default behavior. It seems strange to me though. Clicking the back button should load the previous page, not an open menu. If I want the menu to expand I'll click the menu icon, not the back button. Is there a way to change this behavior?
Thanks.
After further testing, it seems this only occurs in Safari, both mobile and desktop.

Hello everybody.
Looks like this issue is still actual for Firefox and iOS Safari. It can be seen on Foundation website (http://foundation.zurb.com/). After opening website and loading any page via off-canvas menu, then clicking browser's "Back" button, I get back to the home page, but off-canvas menu is in expanded state. Looks like Chrome behaves correctly though.
Thanks.


GE: Minio deployment endet with "something went wrong please contact support"

after entering all parameter and payment
I got this error, and no more info...
could maybe nr: 9511
chatflow: minio
Solution name: gs31
Disk type: HDD
Access key: miniog1
Secret: m987654321
CPU: 1
Memory: 1024
Locations: 6
Locations allowed to fail: 2
ZDB number: 8
Solution expiration: 1w 5d 12h 31m 3s

how can I export the log, where can I find it in cli

@hteibler
goto your dashboard and press in logs in your left hand like the screenshot in the comment above.
Then select from list box threebot server
and goto the last page and screenshot this page please

This log after errror of the minio reservation from minio chatflow ?
if not, please screenshot of all logs after make reservaion of minio to see where's the error.

an export would be great!

@hteibler please try again and if you hit an issue, attach the alerts and reservation number. indeed, an export button would make life easier, will create a FR

now it was working...
what was the problem?

we didn't do anything

working with me
Please make sure of the entered values before starting deployment
chatflow 	minio
Solution name 	tests3
Disk type 	HDD
Access key 	test105
Secret 	secret12345
CPU 	1
Memory 	1024
Locations 	6
Locations allowed to fail 	2
ZDB number 	8
Solution expiration 	17h 23m 56s
IP Address 	<IP_ADDRESS>


Watched Addresses Have Incorrect Timestamp in Qt Wallet

Using the core wallet, if you add a watched address (importaddress) - when it rescans for existing transactions, the existing transactions all get the same timestamp (when the rescan was done).  Later transactions received the expected timestamps.
Raptoreum Core version <IP_ADDRESS>.

Fixed in develop.


Please add Abuse.ch list

http://ransomwaretracker.abuse.ch/blocklist/
Mentioned in AV forum
It need to add <IP_ADDRESS> into each line, but this will worth it.

Which AV forum, @v5fwlijftwoz81h0hyci4egwlcufw3ov73gayf2 ?

It's not currently in a readily usable form.  We could pre-process the list, though.
Let me think about this.


[T5A2][W14-A2]HonKeanWai

Some comments added. Feel free to add more comment if you have any questions. Once you are done, you may close the PR after reading comments.


Why cvloader.js remove the node suffix path name?

Hello. I'm conflicted the problem of require path in cvloader.
I know the opencv4nodejs build result exist in build/Release/opencv4nodejs.node, and there was no problem in the past when 6 version.
I recently installed the latest version(7.1.2) of opencv4nodejs, there are so many good changes. But I don't know why this tries to find the build result of no suffix name(build/Release/opencv4nodejs). Of course, there should be a reason you have to add this code. Could you explain why it tries to import the file name of the no suffix .node?
Thank you.

There was what I misunderstood about commonjs setting in jest.config. I'm sorry!


ORC-184: Refactor ColumnStatistics classes for writer

Added several functions to ColumnStatistic class inclduing hasNull, merge, reset, toProtoBuf, etc.
Added functions to scale up/down for Int128 and comparision function for Decimal types.

@omalley @majetideepak @xndai
As I am waiting for PR of ORC-185 being resolved, I haven't added all functions that we have implemented for column statistics to avoid huge effort for refactoring later. In this PR, I just followed the style of current code base which puts function declaration in the class ColumnStatistics and implements them in every ColumnStatisticsImpl class and it contains a lot of copying and pasting duplicate code (e.g. in c++/src/Statistics.hh). Actually in our internal implementation, we put the implementation of functions like hasNull(), getNumberOfValues(), increase(), merge(), reset(), etc. into the base class ColumnStatistics. What are your thoughts?

I am strongly for rebasing this on top of ORC-185.

Exposing the functions you mentioned in the public API is bad design.
ORC-185 adds templates, which will further reduce code duplication.

On Java side, ColumnStatistics and [Type]ColumnStatistics are very simple interfaces with minimum getter functions. It is the duty of ColumnStatisticsImpl class to define/implement most common interfaces and act as the base class in most writer implementations. Other [Type]ColumnStatisticsImpls just extend ColumnStatisticsImpl and implement [Type]ColumnStatistics to add their own logic to remove duplicate code. However, on C++ side, ColumnStatisticsImpl and [Type]ColumnStatisticsImpl have no inheritance relation like Java side. We cannot simply make [Type]ColumnStatisticsImpl inherit ColumnStatisticsImpl as it may introduce virtual inheritance issue because they have a common base class. Templates do not solve this issue as there is still no base class defining all common interfaces. In this case, we can expect that we need to use dynamic_cast almost everywhere if we want to use ColumnStatistcis abstraction; otherwise, we need to bind each [Type]ColumnStatistics to [Type]ColumnWriter leading to another place with huge amount of duplicate code.

You are right that we cannot make  [Type]ColumnStatisticsImpl inherit ColumnStatisticsImpl. That is why I introduced InternalStatisticsImpl in ORC-185.
With that, you will just use InternalStatisticsImpl<Type> in your templated [Type]ColumnWriterImpl.
I guess without the design for the ColumnWriter, it is hard to discuss at this point.
Can you open a separate PR for your ColumnWrite code? Things will get more clear then.
We can converge on the necessary overall changes.

We are progressively working on moving all the code here. As there is a big gap between the current code and our code, it is not possible to create a PR for ColumnWriter right now.
This PR is not a final decision, but a piece of code to show our ideas and introduce the discussion as we actually need some sort of ColumnStatistics class to act as the base class in the ColumnWriter implementation. To use your InternalStatisticsImpl, I have following thoughts:

InternalStatisticsImpl is an implementation class, so the interface functions like increase, merge, reset, etc. should still be defined in a base class somewhere;
We can implement ColumnWriter class using templates as well to adopt InternalStatisticsImpl; but ColumnWriter and ColumnStatistics are slightly different since ColumnWriter has more types and less common code, so I doubt template is not a good choice for ColumnWriter class.
BTW, I really appreciate your refactoring in your PR @majetideepak. I would like to add our code based on your changes. Before that, we have to achieve a consensus on which class is the best choice of the base class in ColumnWriter implementation (like the ColumnStatisticsImpl on the java side). In our design, it is ColumnStatistics itself.

To answer your concerns,

The functions like increase, merge, reset, etc. can be added to InternalStatisticsImpl also. I don't see the need for a base class. The implementation for non-primitive types must be specialized anyway.
I don't see how the Types can be different between the ColumnWriter and the ColumnStatistics. Can you give an example? If your [Type]ColumnWriter design is similar to the existing [Type]ColumnReader design, then we can easily stick in an InternalStatisticsImpl instance.

I opened ORC-185 as a pattern we could use to overcome the lack of a base class with [Type]ColumnStatisticsImpl. Ultimately, we should definitely do what is easier to get the Writer code in with minimal code changes possible. However, without the ColumnWriter design, it is hard to enumerate and discuss other options for ColumnStatistics.
However, putting methods that should be internal, in the public API is definitely not the right approach.

Yes, our current ColumnWriter design follows the approach of ColumnReader. One base class ColumnWriter takes care of all common work, and specific inherited ColumnWriters like IntegerColumnWriter, StructColumnWriter, BooleanColumnWriters, etc. manage their own logic. To integrate ColumnStatistics, we have two options (correct me if I'm wrong):

Put a based ColumnStatistics class in the base ColumnWriter like I said previously, and in each TypeColumnWriter, use dynamic type of ColumnStatistics to do its type-specific logic. In this way, we can save many duplicate code by polymorphism in the base ColumnWriter class; (our current code is written in this fashion)
There is no ColumnStatistic variable in the base class ColumnWriter. Instead, each inherited TypeColumnWriter class uses one TypeColumnStatisticsImpl (not TypeColumnStatistics), e.g. IntegerColumnWriter uses IntegerColumnStatisticsImpl. This is feasible except for a little bit more duplicate stuff compared with the 1st approach.

Your InternalColumnStatisticsImpl design is more inclined to the 2nd approach as it is still not a base class to use in the base class ColumnWriter. We can discuss ColumnWriter later as it is difficult without actual code. To save both of our time and effort and avoid significant change of our current ColumnWriter implementation, I will update this PR accordingly based on the approach 2 after your PR is merged. @majetideepak

I see your concern now.
My idea is to directly use InternalIntegerStatisticsImpl from ORC-185 inside the IntegerColumnWriter. If we use the existing IntegerColumnStatisticsImpl, then we need to duplicate all the new methods being introduced.
I think if I add a base class to the InternalIntegerStatisticsImpl in ORC-185, your problem should be solved.

For not making it more complex, I think your current work in ORC-185 is good enough. I also agree that it is not right place to put them into ColumnStatistics. I will fix this in the next commit after ORC-185.

Sounds good then. Thanks.

I'm sorry, I closed the wrong pull request.


python310Packages.gflanguages: 0.5.10 -> 5.0.4

Automatic update generated by nixpkgs-update tools. This update was made based on information from passthru.updateScript.
meta.description for python310Packages.gflanguages is: Python library for Google Fonts language metadata
meta.homepage for python310Packages.gflanguages is: https://github.com/googlefonts/lang
Updates performed

Ran passthru.UpdateScript

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS
The tests defined in passthru.tests, if any, passed
found 5.0.4 with grep in /nix/store/h67y1ldygkhzm5di79gmlj8fz0bdp696-python3.10-gflanguages-5.0.4
found 5.0.4 in filename of file in /nix/store/h67y1ldygkhzm5di79gmlj8fz0bdp696-python3.10-gflanguages-5.0.4

Rebuild report (if merged into master) (click to expand)

8 total rebuild path(s)

8 package rebuild(s)

First fifty rebuilds by attrpath
fontbakery
python310Packages.fontbakery
python310Packages.gflanguages
python310Packages.shaperglot
python311Packages.fontbakery
python311Packages.gflanguages
python311Packages.shaperglot
shaperglot

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/h67y1ldygkhzm5di79gmlj8fz0bdp696-python3.10-gflanguages-5.0.4 \
  --option binary-caches 'https://cache.nixos.org/ https://nix-community.cachix.org/' \
  --option trusted-public-keys '
  nix-community.cachix.org-1:mB9FSh9qf2dCimDSUo8Zy7bkq5CX+/rkCWyvRCYg3Fs=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(The Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python310Packages.gflanguages https://github.com/r-ryantm/nixpkgs/archive/7c1b9bb0b5a070021f5557959626320d3ddf5c51.tar.gz

Or:
nix build github:r-ryantm/nixpkgs/7c1b9bb0b5a070021f5557959626320d3ddf5c51#python310Packages.gflanguages

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/h67y1ldygkhzm5di79gmlj8fz0bdp696-python3.10-gflanguages-5.0.4
ls -la /nix/store/h67y1ldygkhzm5di79gmlj8fz0bdp696-python3.10-gflanguages-5.0.4/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review run on x86_64-linux 1

6 packages built:

fontbakery (python311Packages.fontbakery)
python310Packages.fontbakery
python310Packages.gflanguages
python310Packages.shaperglot
python311Packages.gflanguages
shaperglot (python311Packages.shaperglot)

Maintainer pings
cc @danc86 for testing.

The 5.0.4 release on PyPI was a typo (should have been 0.5.4) and has since been yanked: https://pypi.org/project/gflanguages/5.0.4/
The actual latest release is 0.5.13, I'm not sure if the bot is going to find that one or it might keep seeing 5.0.4 even though it was yanked...

I sent https://github.com/NixOS/nixpkgs/pull/275729 for the update to 0.5.13.


Move to python 3.11 when available

Implemented here: https://github.com/Flagsmith/edge-proxy/pull/70


variable "simple_tokenizer" is missing

In the 10 line in scenic/projects/baselines/clip/tokenizer.py:
   ` from clip.simple_tokenizer import SimpleTokenizer`

But there are no objects or files including "simple_tokenizer"

This file is a part of the official CLIP code release:
https://github.com/openai/CLIP/blob/main/clip/simple_tokenizer.py


How to implement breadcrumbs

How to implement breadcrumb to hide full URL and show categories in search engine.

There are limitations of what Jekyll can do, it’s designed for smaller blogs not for large blogs to attract loads of views and act as a business. If you want that, look at Wordpress and the Yoast plugin.


⚠ Bofrost.be has degraded performance

In 019a821, Bofrost.be (https://www.bofrost.be) experienced degraded performance:

HTTP code: 200
Response time: 833 ms

Resolved: Bofrost.be performance has improved in 7941e36 after 6 minutes.


feat: add the possibility to remove default bindings

Why ?
Some default bindings might conflict with user bindings.
For example, in the task list <C-l> is bound to increase detail but for many users it's already bound to Go to the right window.
Currently, setting a binding to nil use the default behavior and setting it to the empty string will unbind the key.
Proposed solution
Add some special string like "None" or the empty string that prevents Overseer from rebinding this key.

Done!
Do you want me to remove selene related files ?

It's probably fine. I've never used Selene, but maybe I'll give it a try and add it to the CI if it's useful.
Thanks for the PR!


On Ubuntu 20.04, postgresql.conf is left with 640 permission, should be 644

When installing on a raw Ubuntu 20.04 without postgres pre-installed, the file /etc/postgresql/11/main/postgresql.conf is left with 640 permission which causes trouble for omero-server:
omero-server@ip-172-31-48-38:~$ omero admin diagnostics
================================================================================
OMERO Diagnostics (admin) 5.9.2
Commands:   java -version                  1.8.0     (/usr/bin/java)
Commands:   python -V                      3.8.5     (/opt/omero/server/venv3/bin/python)
Commands:   icegridnode --version          3.6.5     (/opt/ice/bin/icegridnode)
Commands:   icegridadmin --version         3.6.5     (/opt/ice/bin/icegridadmin)
Commands:   psql --version                 error:'NoneType' object has no attribute 'group'
Commands:   openssl version                1.1.1     (/usr/bin/openssl)
Fix by changing the permissions to 644.

Hi @dsudar thanks for the report. The permissions for the configuration file are defined into
https://github.com/ome/ansible-role-postgresql/blob/b0fc0994611691988d85eee39f3786e0473a5265/tasks/initialise.yml#L35
and were set to 640 in https://github.com/ome/ansible-role-postgresql/commit/4c86c716c76576f8621efb4e2bfaf0dc5ec4a900. I picked the most conservative choice assuming this file would not need world access but looking around I see similar reports in the Debian. Do you have the output of psql --version when the permissions are set to 640 since omero diagnostics fails to parse it and swallows the output?
Overall, no objections to setting this to 644 if that ensures maximal compatibility with all operating systems without compromising some sensitive information.

@dsudar ome.postgresql 5.0.3 has now been released with this fix. Thanks for reporting it


Missing License file.

There is no License file in the project please add.

Plus one on that. Please add some kind of license, e.g. MIT.

I think it has to be GPL v2+ because flexslider is GPLv2.


Conflict between names of repository and subfolder

System Info
Hi guys,
I am trying to run an AI notebooks in order to do FineTuning.
In the process, i am trying to import bitsandbytes trough a Jupyter notebook like this :
requirements_content = """
torch==2.1.0
accelerate @ git+https://github.com/huggingface/accelerate.git
datasets==2.13.1
transformers @ git+https://github.com/huggingface/transformers.git
peft @ git+https://github.com/huggingface/peft.git
trl @ git+https://github.com/lvwerra/trl.git
scipy
bitsandbytes @ git+https://github.com/TimDettmers/bitsandbytes.git
"""

import bitsandbytes as bnb
But i encounter this error :
ImportError                               Traceback (most recent call last)
Cell In[60], line 2
      1 import argparse
----> 2 import bitsandbytes as bnb
      3 from datasets import load_dataset
      4 from functools import partial

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/__init__.py:6
      1 # Copyright (c) Facebook, Inc. and its affiliates.
      2 #
      3 # This source code is licensed under the MIT license found in the
      4 # LICENSE file in the root directory of this source tree.
----> 6 from . import research, utils
      7 from .autograd._functions import (
      8     MatmulLtState,
      9     bmm_cublas,
   (...)
     13     mm_cublas,
     14 )
     15 from .nn import modules

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/research/__init__.py:2
      1 from . import nn
----> 2 from .autograd._functions import (
      3     matmul_fp8_global,
      4     matmul_fp8_mixed,
      5     switchback_bnb,
      6 )

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/research/autograd/_functions.py:8
      4 import warnings
      6 import torch
----> 8 from bitsandbytes.autograd._functions import GlobalOutlierPooler, MatmulLtState
      9 import bitsandbytes.functional as F
     12 # math.prod not compatible with python < 3.8

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/autograd/__init__.py:1
----> 1 from ._functions import get_inverse_transform_indices, undo_layout

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/autograd/_functions.py:10
      6 from warnings import warn
      8 import torch
---> 10 import bitsandbytes.functional as F
     13 # math.prod not compatible with python < 3.8
     14 def prod(iterable):

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/functional.py:15
     12 import torch
     13 from torch import Tensor
---> 15 from bitsandbytes.utils import pack_dict_to_tensor, unpack_tensor_to_dict
     17 from .cextension import lib
     20 # math.prod not compatible with python < 3.8

ImportError: cannot import name 'pack_dict_to_tensor' from 'bitsandbytes.utils' (/workspace/.miniconda3/lib/python3.11/site-packages/bitsandbytes/utils.py)

In funtional.py, line 15, we have :
from bitsandbytes.utils import pack_dict_to_tensor, unpack_tensor_to_dict
And as i see, we have a subfolder named the same as the repository :
bitsandbytes/bitsandbytes
Is it possible that there is a a conflict between :
site-packages/bitsandbytes/utils.py
and
site-packages/bitsandbytes/bitsandbytes/utils.py
Could you help me with this ? Thank in advance !
Reproduction
requirements_content = """
torch==2.1.0
accelerate @ git+https://github.com/huggingface/accelerate.git
datasets==2.13.1
transformers @ git+https://github.com/huggingface/transformers.git
peft @ git+https://github.com/huggingface/peft.git
trl @ git+https://github.com/lvwerra/trl.git
scipy
bitsandbytes @ git+https://github.com/TimDettmers/bitsandbytes.git
"""
with open('requirements.txt', 'w') as f:
    f.write(requirements_content)
print("requirements file created.")

import os
os.system("python -m pip install -r requirements.txt")
print("requirements installed.")

import argparse
import bitsandbytes as bnb
from datasets import load_dataset
from functools import partial
from peft import LoraConfig, get_peft_model, prepare_model_for_kbit_training, AutoPeftModelForCausalLM
import torch
from transformers import (
    AutoModelForCausalLM,
    AutoTokenizer,
    set_seed,
    Trainer,
    TrainingArguments,
    BitsAndBytesConfig,
    DataCollatorForLanguageModeling
    )

import random
import pandas as pd
from IPython.display import display

Expected behavior
There should be an error during bitsandbytes importation :
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In[60], line 2
      1 import argparse
----> 2 import bitsandbytes as bnb
      3 from datasets import load_dataset
      4 from functools import partial

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/__init__.py:6
      1 # Copyright (c) Facebook, Inc. and its affiliates.
      2 #
      3 # This source code is licensed under the MIT license found in the
      4 # LICENSE file in the root directory of this source tree.
----> 6 from . import research, utils
      7 from .autograd._functions import (
      8     MatmulLtState,
      9     bmm_cublas,
   (...)
     13     mm_cublas,
     14 )
     15 from .nn import modules

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/research/__init__.py:2
      1 from . import nn
----> 2 from .autograd._functions import (
      3     matmul_fp8_global,
      4     matmul_fp8_mixed,
      5     switchback_bnb,
      6 )

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/research/autograd/_functions.py:8
      4 import warnings
      6 import torch
----> 8 from bitsandbytes.autograd._functions import GlobalOutlierPooler, MatmulLtState
      9 import bitsandbytes.functional as F
     12 # math.prod not compatible with python < 3.8

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/autograd/__init__.py:1
----> 1 from ._functions import get_inverse_transform_indices, undo_layout

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/autograd/_functions.py:10
      6 from warnings import warn
      8 import torch
---> 10 import bitsandbytes.functional as F
     13 # math.prod not compatible with python < 3.8
     14 def prod(iterable):

File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/functional.py:15
     12 import torch
     13 from torch import Tensor
---> 15 from bitsandbytes.utils import pack_dict_to_tensor, unpack_tensor_to_dict
     17 from .cextension import lib
     20 # math.prod not compatible with python < 3.8

ImportError: cannot import name 'pack_dict_to_tensor' from 'bitsandbytes.utils' (/workspace/.miniconda3/lib/python3.11/site-packages/bitsandbytes/utils.py)

I noticed also this :
File ~/.miniconda3/lib/python3.11/site-packages/bitsandbytes/functional.py:15
     12 import torch
     13 from torch import Tensor
---> 15 from bitsandbytes.utils import pack_dict_to_tensor, unpack_tensor_to_dict
     17 from .cextension import lib
     20 # math.prod not compatible with python < 3.8

Could it be that it should be :
15 from .utils import pack_dict_to_tensor, unpack_tensor_to_dict
instead of
15 from bitsandbytes.utils import pack_dict_to_tensor, unpack_tensor_to_dict


Replace docker-gc with docker system prune

High-level description
docker-gc is inactive and was replaced by docker system prune.
See: https://github.com/spotify/docker-gc/commit/6a5734c6f0ae20b3a838d2fed077982141a3b81a#diff-04c6e90faac2675aa89e2176d2eec7d8
Corresponding DC/OS tickets (required)

DCOS_OSS-5441

Related tickets (optional)

DCOS-ID JIRA title / short description.

Checklist for component/package updates:
If you are changing components or packages in DC/OS (e.g. you are bumping the sha or ref of anything underneath packages), then in addition to the above please also include:

[ ] Change log from the last version integrated (this should be a link to commits for easy verification and review): example
[ ] Included a test which will fail if code is reverted but test is not. If there is no test please explain.
[ ] Test Results: [link to CI job test results for component]
[ ] Code Coverage (if available): [link to code coverage report]

@mesosphere-mergebot bump-ee

@mesosphere-mergebot request-review @drewvanstone @br-lewis @makkes @bamarni @rgo3

:wave: @drewvanstone @br-lewis @makkes @bamarni @rgo3  Can you review, please? I added changelog entry


Swin-L Pre-trained model

Dear author,
Is Swin-L pre-trained model available?
I thought the best mIoU on ADE20K dataset is 53.5 with Swin-L model, Can I download it anywhere?
Thanks.

you can download them from https://github.com/microsoft/Swin-Transformer

@kartikwar Hi, I only found the Swin-L model trained on ImageNet 1K/22K at https://github.com/microsoft/Swin-Transformer, but not on ADE20K dataset with 53.5 mIoU. Could you please provide the ADE20K one? Many thanks to you!

Hey, @eezywu I am not sure about ADE20K model. Maybe the authors of this repo can give you info about that


always_iterable treats dict as iterable

I'm finally getting around to reconciling always_iterable in jaraco.itertools, as contributed to this project in #37 and #108.
In September last year, I discovered that one would be unlikely to want to iterate over a dictionary (or other Mapping) when using always_iterable, so in jaraco.itertools 2.0, Mappings were treated as non-iterable. The reasoning, as found in the docs, is that a dictionary is likely to be intended as a single object rather than a sequence of keys, but also that one can readily pass iter(dict) or dict.keys() if one does want the value to be treated as iterable.
In order for more_itertools.more.always_iterable to supplant jaraco.itertools.always_iterable, I'd like for more_itertools to adopt this behavior as well.
What do you think?

My first intuition was that always_iterable() should let you loop over dict keys like normal, but I can see your point.
I sort of wanted to take out the special handling of strings to make the default behavior super simple, but decided against it then.
I think PR #165 adds some flexibility such that we don't have to dictate which types are "not considered iterable." This is similar to what collapse() does, and can cover the dict case you mention.
I considered adding something for "don't override anything, just check __iter__ if base_type is None" - any opinions about that? As-is you could do base_type=type('Dummy', (), {}).

Sort of resolved in PR #165.


Microsoft Visual C++is required

Hello,
When installing k-means-constrained, I get the error: "Microsoft Visual C++ 14.0 is required."
Do you know if the Redistribuable Visual C++ package is sufficient or do we need the whole Microsoft Visual?
Thank you!

Hi, I think you need to install the Visual c++ build tools. You can download it here: https://visualstudio.microsoft.com/visual-cpp-build-tools/

Thanks a lot!


Documentation for the new rebuild tree button

Closes #42
I also removed tox builds for Python 3.2 because it was giving me a strange error locally.

Merge conflict resolved and ready for review.

:rocket:


[Feature Request]: Restyling the licensing page

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
I will add a different layout and styles.
Use Case
I will add a different layout and styles.
Benefits
No response
Add ScreenShots
No response
Priority
High
Record

[X] I have read the Contributing Guidelines
[X] I'm a GSSOC'24 contributor
[ ] I'm a VSOC'24 contributor
[X] I have starred the repository

@apu52 please assign this issue to me


[Suggestion] Patching the EXE instead of injecting a DLL every time.

A lot of patchers exist like dUP2 + AT4RE to patch the exe or a DLL. Is there a way that we can do this so we don't have to inject a DLL every time?

Patching the EXE should certainly be possible, though more difficult as it's more protected when not running, but I'd rather not making changes to the EXE itself. The nice thing about the DLL is it's changes are temporary, which was the point.

How would it be possible? Could you make a patched exe then I can create the patcher using dUP2 or AT4RE? Maybe some users are looking for a permanent change instead of injecting the DLL every time they want to play GTA.

How would it be possible?
There's many ways, manual hex editing and writing a program to read the file in as a binary file, make edits and write it back out are the two that come to mind.

Could you make a patched exe then I can create the patcher using dUP2 or AT4RE?
I'm probably capable.

Maybe some users are looking for a permanent change instead of injecting the DLL every time they want to play GTA.
That's not something I'm interested in making, if someone wants that the source is open and people are free to use it to make such a thing if they wish.

How would it be possible?

There's many ways, manual hex editing and writing a program to read the file in as a binary file, make edits and write it back out are the two that come to mind.

Could you make a patched exe then I can create the patcher using dUP2 or AT4RE?

I'm probably capable.

Maybe some users are looking for a permanent change instead of injecting the DLL every time they want to play GTA.

That's not something I'm interested in making, if someone wants that the source is open and people are free to use it to make such a thing if they wish.

That's great you can do it, I would do it myself but I do not know how to create the patched exe. I can do everything else fine (creating the patcher, etc) but creating the patched exe would be the hard part.


[Bug] [ui]  Chinese Official website link error  link

Search before asking

[X] I had searched in the issues and found no similar issues.

What happened
When I browsed the website of "https://dolphinscheduler.apache.org" and chose Chinese site.
then I click the botton of "quick start". then jump to the error page
error link : https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/guide/quick-start.html

What you expected to happen
fix error link
How to reproduce
fix error link
Anything else
No response
Version
dev
Are you willing to submit PR?

[X] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

i will fix it


Add is-hyperterm to Packages

Checklist:

[x] The title for my package or theme uses its npm title (hyperterm-plugin-example)
[x] The link for my package or theme uses the npmjs.com link (https://npmjs.com/package/hyperterm-plugin-example)
[x] There is a visual representation of what my plugin does in the repo. (Plugin: screenshot or gif || Theme: screenshot of the colors within HyperTerm)
[x] Put your awesome item at the BOTTOM of the correct (plugin, theme, or resource) list.
[x] VERY IMPORTANT: I've written a short (one sentence) description for my package or theme of why it's awesome and deserves to be on the list.

HyperTerm is more powerful than other terminals, so it's useful to be able to know if some Node.js code is running in HyperTerm to add extra functionality.
https://github.com/sindresorhus/is-hyperterm

Thanks Sindre! 🦁


Port ObjectMethodExecutor to HubEndPoint

https://github.com/aspnet/Mvc/blob/13b32adeae0bd13f210a166c7d1a0dcb2a917611/src/Microsoft.AspNetCore.Mvc.Core/Internal/ObjectMethodExecutor.cs
Use the same method invocation execution pipeline as MVC.

/cc @BrennanConroy this is a good one to get started on.

#199


IPFS content sync

Evaluate if the next strategy is possible in order to leverage a decentralized storage and release the Content servers from content that is not actively used by the clients.

[ ]  Move the scenes deployments history to IPFS
[ ] Sync the Pins between the Catalyst Servers
[ ] Have a way to navigate the history
[ ] Use a service to flush the content on the IPFS network
[ ] Run an IPFS node

The deployments history is only needed in special cases or for troubleshooting, all this content can be stored in an external service, and it can be decentralized like IPFS. Moving this content from the servers will help to release a lot of disk space and the history could still be find. Moving to IPFS we should consider if we should host our own IPFS node.

This work is being tracked here https://github.com/decentraland/catalyst/issues/1067


Update sonic-weave dependency

Depending on a branch is a bit too nebulous for beta cycle. I'll craft a release...


Added definition for fs-ext

Project: https://github.com/baudehlo/node-fs-ext

fs-ext/fs-ext.d.ts
check list

[ ] is collect naming convention?

https://www.npmjs.com/package/fs-ext
http://bower.io/search/?q=fs-ext
others?

[ ] has a test file? (fs-ext/fs-ext-tests.ts or others)
[ ] pass the Travic-CI test?

Added test file.

@OguzhanE thanks mate!


main-aot.ts references missing file

Line 7: import { AppModuleNgFactory } from '../aot/angular2App/app/app.module.ngfactory';
This file is not present in the solution.

Hi @photostu
Have you done a production webpack build from the cmdline "> npm run buildProduction"
Greetings Damien

main-aot-ts file is the entry point for AoT compilation.
.ngcfatory files are created in aot folder by ngc compiler when you do: npm run buildProduction.
You can find the explanation in official documentation: https://angular.io/docs/ts/latest/cookbook/aot-compiler.html

Apologies guys... still a greenhorn with this webpack stuff... Thank you for the timely response.

So, potential noob question still... what is the best way to get the server portion of this running as well? tsc is not a happy camper when attempting to build in VS

Well tsc is the typescript compiler. If you want to get the server side running you can type
dotnet run on project-json level though this is a asp.net core application.
But hitting "play" in vs should work as well.
BR
Fabian

yeah, server side won't build cause tsc has a ton of errors...

some you can ignore, these show up all the time, but something is causing tsc to fail, thus breaking the build

did you try dotnet run ?

yes, that works, but it runs on :5000 and webpack-dev-server will run on another port.. that's gonna be hard to get working together ;-)

Ok, you're confusing a lot of things.
You should not use tsc in this project because the compilation is made by webpack. To use it, you must ensure that you have:

TypeScript for Visual Studio 2.0.3
TypeScript 2.0.3 installed globally

Webpack-dev-server is a in memory building. However @damienbod we have to change the port 8080 in package.json or remove it.
Greetings

Just to be clear: I think @photostu is starting via Visual Studio, then Visual Studio is running the tsc and throws errors and thats why the backend from Visual Studio does not start. Did I get you right?
 If you now start from VS it should work. If you type npm start it is starting the frontend (webpack-dev-server) AND the backend (dotnet run). Because we activated CORS having front- and backend on different domains/ports/servers etc. should not be a problem.
BR & HTH

We're getting there... get the solution clean.
Determining this workflow for debugging is certainly not easy, I appreciate the help today for sure.
what should the expected flow be?

Hi @photostu,
after the commits of @FabianGosebrink, when you do: npm start from the command line, you start concurrently:

webpack-dev-server: as said, it builds in memory, and it doesn't create the dist folder: https://webpack.github.io/docs/webpack-dev-server.html
the dotnet server

After the launch, you can browse on localhost:8080

If it still doesn't work, I think it's a configuration problem: please, let us know:

Version of Windows
Version of Visual Studio
Version of TypeScript for Visual Studio
Version of node & npm

Thanks!

Ok, I was still going to the 5000 port, switching over to 8080 works and produces the same output. Thanks for the assistance. I'll try not to bug you guys too much more ;-)

It's the same output because on port 8080 the webpack dev server is running. Think of it as a live-reload-server "hosted" in the cache. There is no physically output. It works because the app communicates with the dotnet-core-app which is running on port 5000. There, on port 5000, the dotnet-core app is running serving from the wwwroot-folder. There we are building all the app-files in before starting the app. Thats why the content is the same.
You could also start a lite-server serving from wwwroot, having a watcher watching on the angular2app-folder, copying files to the wwwroot when changing. Would be quite the same.
Hopefully I did not make any confusion but clarified some things :)
BR
Fabian

Thank you for the clarification. I appreciate the explanations for sure :-)


Error on import UniRx 6.2 unitypackage from last build

Errors :
Assets\Plugins\UniRx\Scripts\Async\UnityAsyncExtensions.Jobs.cs(41,22): error CS0246: The type or namespace name 'JobHandle' could not be found (are you missing a using directive or an assembly reference?)
Assets\Plugins\UniRx\Scripts\Async\UnityAsyncExtensions.Jobs.cs(48,37): error CS0246: The type or namespace name 'JobHandle' could not be found (are you missing a using directive or an assembly reference?)
Assets\Plugins\UniRx\Scripts\Async\UnityAsyncExtensions.Jobs.cs(30,51): error CS0246: The type or namespace name 'JobHandle' could not be found (are you missing a using directive or an assembly reference?)
[...] few more of the same type, and then the one wich give all the explanation :
Assets\Plugins\UniRx\Scripts\Async\UnityAsyncExtensions.Jobs.cs(6,13): error CS0234: The type or namespace name 'Jobs' does not exist in the namespace 'Unity' (are you missing an assembly reference?)
Those errors only appear when I try an Unity build. Those errors doesn't appear when I'm coding in Editor mod, and for Visual Studio everything is fine. I have check all the file ("UnityAsyncExtensions.Jobs") and everything is clean in for VS.
Any clue about why Unity go wild on ?

Thank you for reporting.
Could you show your Unity version?

My unity version is 2018.2.0f2, freshly install from Unity hub.
The same goes for the version in unity store, but not on same classes. But it was all about assembly reference not found or namescpace not correctly identified in Unity (and only at build-time)

Hmn, Unity 2018.02, maybe includes Unity.Jobs...
https://docs.unity3d.com/2018.２/Documentation/ScriptReference/Unity.Jobs.JobHandle.html
maybe ENABLE_MANAGED_JOBS symbol is enable/disable Unity Jobs so I'll add this if definition.

Yeah it seems because VS doesn't see a matter. Well at least I still can't use UniRx due to the Incremental Compiler : it broke down the entire HoloLens bundle and nothing compile after. By any miracle, do you see any workaround that could make Async work without having the compiler in Unity package ?
Thanks for your time @neuecc

solvde in https://github.com/Cysharp/UniTask/issues/4


A3C example

@winstywang @tornadomeet @sxjscience

@peterzcc

Here is a group of possible hyperparameters: async-rl/wiki

batch = mx.io.DataBatch(data=S[i], label=[mx.nd.array(A[i]), mx.nd.array(R)])

           module.forward(batch, is_train=True)

           pi = module.get_outputs()[1]

           h = args.beta*(mx.nd.log(pi+1e-6)+1)

           module.backward([mx.nd.array(adv), h])

I can not undertand the label in DataBatch and the module.backward([mx.nd.array(adv), h]), please help

label=[mx.nd.array(A[i]), mx.nd.array(R)]) i think A[i] shape is 1 * batch_size, R is batch_size * 1,
however in sym file output is [batch_sizeact_dim,batch_sizeact_dim,batch_size*1]
But the gradient for backward is [batch_size * act_dim,batch_size * act_dim], I am really confused, maybe
something wrong with my uderstanding of dataBatch or symbol or gredient, please help


How to run iGibson in headless mode?

I installed iGibson on a remote desktop using pip install and when I try to run the demo I get the following error.
startThreads creating 1 threads.
starting thread 0
started thread 0
argc=2
argv[0] = --unused
argv[1] = --start_demo_name=Physics Server
ExampleBrowserThreadFunc started
X11 functions dynamically loaded using dlopen/dlsym OK!
No protocol specified

	cannot connect to X server

I believe this error is because it is trying to render a GUI output. How should I modify the code to run it in headless mode? Thank you!

It looks like you try to start the pybullet gui in headless mode, which is not supported. You can set the mode to "headless" and it will run iG in headless mode.
https://github.com/StanfordVL/iGibson/blob/c0dba21952eb8a9323278be276ea9295425a1f7c/igibson/envs/igibson_env.py#L40

On the latest release, you must set use_pb_gui = True in order to use the pb_gui which is off by default, so this shouldn't happen anymore.


I would like to add some graph algorithms and questions.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

assign it to me plz


Customize and set up my mining proxy

Hi,
I would like to know how much is it going to cost me to set up my own zero proxy with customized fee extraction for 4 coins:
btc, etc, nicehash-kawpow, xna.
The proxy should be security enough to against known exploits and stable for miner to make miners join.
That’s it
Looking forward to hearing from you
Best Regards.

Hi @chilldudu , Zero Proxy fully meets your needs above and it is totally free to use, You can deploy it directly following the One click Install .
If you need to customize your own Zero Proxy and have your fee extraction wallet embedded in it, feel free to contact us at our email<EMAIL_ADDRESS>

Great to hear that, I would contact u for more details.

AltLayer Airdrop Season One Announcement

Exciting news! AltLayer token (ALT) is set to launch on Binance on January 25, 2024. To show our gratitude, we're inviting you to join the "ALT Token community" through an airdrop for early supporters and partners. Below is a summary:

Total Allocated ALT Tokens: 300,000,000 (3% of total supply)
Distribution Categories:

NFT Holders
Altitude Campaign Participants
EigenLayer Restakers
EigenLayer Ecosystem Partners
Celestia Stakers and others
Ethereum Mainnet
Binance Mainnet

For detailed criteria and information, check the full announcement here.
Claim Airdrop Altlayer opens from January 25 to February 03, 2024. Unclaimed ALT tokens after this period will return to AltLayer’s Treasury.
Thank you for being part of AltLayer's success! More to come in Season One, stay tuned.
Note: Certain regions are restricted from the airdrop. Please review the disclaimer before participating.
dis-aster, @HBiomed89, @cryptozion, @26597925, @hbxfwjww, @CodeBradley, @shimco, @andrewpedia, @zard777, @Disneylanden, @yareyaredesuyo, @liyuechun, @SickProdigy, @ckwen, @joeglenn, @theunravelghoul, @curtismorte, @gnanet, @CryptoGreekCafe, @Luatic-Mint


Ability to manage dialogs, catalogs, policies, reports, and buttons at scale.

Associated BZ: https://bugzilla.redhat.com/show_bug.cgi?id=1567415
Proposed title of this feature request:
Ability to manage dialogs, catalogs, policies, reports, and buttons at scale.
What is the nature and description of the request?
We have 9 regions in CloudForms and 40k instances today. We operate on a sprint development cycle to integrate features into CloudForms weekly. Using our CI/CD pipeline we have automated the deployment of our automate domains and this works great. With the dialogs/catalogs/policies/alerts/buttons we are using the miqimport/miqexport scripts, however these are breaking buttons and catalogs by associating incorrect dialogs with these items. Because of this it takes roughly 6 man-hours to deploy an update to our dialogs, catalogs, and/or buttons. We need a way to manage these deployments (and ideally store the content in git) to track and version these releases.
Why does the customer need this?
Improve work flow and ablity to scale

Closing as duplicate of https://github.com/ManageIQ/manageiq/issues/19589


Additional Databases

Is there any way to utilize additional databases with this?  (Such as what would come in the clamav-unofficial-dbs package)

There currently isn't.  I researched this and it's definitely possible with some minor code changes.  Perhaps somebody would like to take this issue on.


Mesonlsp without executable flag

Zed error:
[2024-08-06T21:38:04+03:00 ERROR project] failed to start language server "meson": failed to spawn command. path: "/home/neko/.local/share/zed/extensions/work/meson/mesonlsp-x86_64-unknown-linux-musl.zip/mesonlsp", working directory: "/home/neko/Projects/Test", args: ["--lsp"]
[2024-08-06T21:38:04+03:00 ERROR project] server stderr: Some("")

How to fix:
chmod +x $HOME/.local/share/zed/extensions/work/meson/mesonlsp-x86_64-unknown-linux-musl.zip/mesonlsp

Fixed in 3cc3a06, request to update extension created zed/extensions#1213.


Missing Docs Required by OSC Governance

The following Required docs are missing and should show on the Main page of Code: CODEOWNERS, CHANGELOG.md
If there are CHANGELOG's please create a top level file and link accordingly.
The following documents/features are suggested by OSC Governance: Issue Template, PR Template, SECURITY.md
For Reference: https://intersect.gitbook.io/open-source-committee/policies/governance
Also see Documentation and Legal

Please provide an update.

@Ranchhand87 PR #497 adds SECURITY.md, PR template and CODEOWNERS.
Could you please review that PR.
Top level CHANGELOG.md file makes no sense for that repo, since each individual package has its own CHANGELOG.md. It is important to understand that repository does not get releases, it is individual packages that get released.
Issue template is not needed for this repo. It is ok to submit a free form ticket. Bug reports or feature requests are extremely rare into this repo, so we don't need to have a template for Issues. At least not yet, maybe in the future things will change.


save request.user data inside of database log

when a user created or updated or deleted with signals a new log added to the db_events, everything saved except request.user info

after the first release and desabled admin panel we don need signals to loging eny more,


Create (blank) summary page

A page to collaborate on summarization (related to https://github.com/Quansight-Labs/czi-bokeh-mgmt/issues/17).
(As discussed on Tuesday)

Hi @pavithraes, apologies I actually saw the branch and added my first commit to it just now thinking this was a branch for us to work on the summary. But the PR title makes me think that perhaps we should have merged this in and then I made a separate branch for the actual summarization work. Whoops!
If you're okay with it, we can just use this PR to do the summary work. If not, I can undo my commit, we can merge this in, and then I can make a new branch. Let me know what you'd prefer.

Thanks, yes, collaborating on this PR works for me :)


The urls parameter must be url encode

In tne part[Auto-configure SharePoint site synchronizationof the documentation, I think it will be a good thing to explained that the parameters (siteId, , webId, webUr, listIdl, userEmail, webTitle, listTitle) mus be URL encode. Without URL encode, OneDrive doesn't care about the parameters.
Here is an example.
Add-Type -AssemblyName System.Web
$WebURL = [System.Web.HttpUtility]::UrlEncode("https://plop.sharepoint.com")
$SiteID = [System.Web.HttpUtility]::UrlEncode("{xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx")
$WebID = [System.Web.HttpUtility]::UrlEncode("{xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx}")
$ListID = [System.Web.HttpUtility]::UrlEncode("{xxxxxxxxxxxxxxxxxxxxxxxxxxxxxx}")
$WebTitle = [System.Web.HttpUtility]::UrlEncode("PLOP")
$ListTitle = [System.Web.HttpUtility]::UrlEncode("Folder")
$UserName =<EMAIL_ADDRESS>
Write-Output "Configure OneDrive"
$odopen = "odopen://sync/?onPrem=0&webTemplate=68&libraryType=4&siteId=" + $SiteID + "&webId=" + $WebID + "&webUrl=" + $webURL + "&listId=" + $ListID + "&userEmail=" + $UserName + "&webTitle=" + $WebTitle + "&listTitle=" + $ListTitle

Start-Process $odopen

Here is the related issue : Add office365 Sharepoint library to OneDrive Sync

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: b65a307a-4572-7255-eaad-34a0884cb93d
Version Independent ID: 976efb44-bf8a-ed55-c854-6c49ecdea722
Content: Deploy OneDrive apps using Microsoft Endpoint Configuration Manager - OneDrive
Content Source: OneDrive/deploy-on-windows.md
Service: one-drive
GitHub Login: @kaarins
Microsoft Alias: kaarins

Thank you for submitting feedback and contributing to the docs. We are currently investigating this.


Adding get list of Smiles augmentation

What does this implement/fix? Explain your changes.
this PR is to simplify and speed up the smile augmentation process in Deep learning.
this Method return an unique list of smiles augmented strings directly to python.
Any other comments?

I try another method (std::set)  10-15% faster than python as in this version.

Greg commits a nicer version!


XML Comments don't handle parameters in complex models nicely

When doing XML comment documentation, it's considered desirable (and there are compiler warnings for it) to have the XML param tags match up to the actual parameters of the method. This unfortunately doesn't work well in Swashbuckle, since a complex model may be used to add more query parameters to the api:
class Model {
    int Param1;
    int Param2;
};

[HttpGet]
HttpResultMessage Action([FromUri(Name = "")] Model params) {
    /* ... */
}

In this case, the XML documentation "should" document the param params, but the documentation should be for Param1 and Param2 in the API. You can document the params:
/// <param name="Param1">This is parameter 1.</param>
/// <param name="Param2">This is parameter 2.</param>

but this violates convention and triggers compiler warnings.
My suggestion is to allow another tag to be used for parameters, like:
/// <swashParam name="Param1">This is parameter 1.</param>
/// <swashParam name="Param2">This is parameter 2.</param>

which would allow thise to be documented in a way that clearly separates them from the C# parameters.

Another option would be to pull from the summary documentation from the model.
class Model {
    /// <summary>
    /// This is parameter 1.
    /// </summary>
    int Param1;

    /// <summary>
    /// This is parameter 2.
    /// </summary>
    int Param2;
};


How endpoint works?

Currently I have lemur running, I was able to integrate it with vault on destination and sources.
I'm using cryptography for my testing, I'm not sure how endpoint works, when I open endpoints I dont see anything and I dont see anywhere how to add them

Endpoints currently are created in the AWS plugins (and maybe others), it would be nice to have a way to add custom endpoints to check if the latest certificate is deployed.
This would entail adding a create REST endpoint to the API, and add the button & form to the web interface


Issue with Shared Applications in ApiStore with same names

Description:>
when sharing applications across users from the Store, if the shared applications have the same name then there's issues accessing them through the Store.
For example,
User A - has an application called TestApp
User B - has an application called TestApp
User B shares this application with User A
If user A (who can now see both TestApp from the UI) deletes their own TestApp, then User B also has their application deleted.

Fixed with the above mentioned PRs.


Web Editor: UI Overhaul, DLL Cache

This call site is reachable on all platforms. 'JSExportAttribute' is only supported on: 'browser'.

I don't know if I can get rid of it, I tried but gave up :D


Argo Client - Handle SSL verification from Argo Configuration

We need to tune the WorkflowClient.java to manage the SSL information when connecting to the Argo Server.

will keep track in the epic


Bootstrapping quickly exhausts memory

xclim version: 0.31.0
Python version: 3.9.7
Operating System: Linux 74cf36c51c91 4.18.0-305.19.1.el8_4.x86_64 #1 SMP Wed Sep 15 15:39:39 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Description

Trying to calculate indices with bootstrap set to True results in a rather large amount of RAM (120 GB) being exhausted. No matter how small I make the chunks of the dataset that is used to calculate the index it fails. Is this something that's expected due to the computationally heavy nature of bootstrapping, or is this an issue with xclim?
What I Did

Here's the code that I ran:
import xarray as xr
import xclim

mpi_historical = xr.open_dataset('http://esgf-data3.ceda.ac.uk/thredds/dodsC/esg_cmip6/CMIP6/CMIP/MPI-M/MPI-ESM1-2-LR/historical/r1i1p1f1/day/tasmin/gn/v20190710/tasmin_day_MPI-ESM1-2-LR_historical_r1i1p1f1_gn_19900101-20091231.nc',
                                 chunks=dict(time=1000))

p10 = xclim.core.calendar.percentile_doy(mpi_historical.tasmin, per=10)
TN10p_mpi_historical = xclim.indicators.icclim.TN10p(mpi_historical.tasmin, t10=p10,
                                                     freq='QS-DEC', bootstrap=True)

TN10p_mpi_historical.load()

What I Received

I'm doing these computations through a remote jupyterlab instance, and a short while after the code starts to execute the .load() part it crashes due to memory exhaustion. If the imported dataset is divided into smaller chunks it takes a longer time for the crash to happen.
I also get the following warnings about chunk sizes:
/opt/conda/envs/my_kernel/lib/python3.9/site-packages/xarray/core/indexing.py:1227: PerformanceWarning: Slicing is producing a large chunk. To accept the large
chunk and silence this warning, set the option
    >>> with dask.config.set(**{'array.slicing.split_large_chunks': False}):
    ...     array[indexer]

To avoid creating the large chunks, set the option
    >>> with dask.config.set(**{'array.slicing.split_large_chunks': True}):
    ...     array[indexer]
  return self.array[key]

You don't need to turn bootstrap on if you compute percentiles on exactly the same period as the index.
Bootstrapping is only useful if the percentiles are computed on an in_base period (like WMO standard normals period) and the climate index itself is computed on a longer period.
But yes, bootstrapping process is inherently memory and CPU hungry.
Its principle is to recompute the percentiles multiple times by switching each time which years are in base (part of percentile computation) or out of base (part of index computation). This avoids some statistical bias between the in base and the out of base periods.
Thus, when bootstrapping is used, I would avoid chunking on time dimension, because Dask will likely have to load multiple chunks for the bs to complete.
I also had great results by setting up a Dask distributed scheduler to limit the memory load Dask can use, as @aulemahal recommended me.
Here is the configuration I'm using to run indices on my laptop:
from distributed import Client

c = Client(n_workers=1, threads_per_worker=10, memory_limit='10GB')

Beware the memory_limit is not exact, Dask may use a little more than that, I would advise you not to put you actual physical memory limit in here.

@bzah
I must admit that I'm a bit confused about bootstrapping in general. The code I posted is just a minimal example that produced the issues I was seeing in a longer script. What I'm interested in is finding the difference in TN10p (also a few other indices) between a historical baseline (1990-2014) and a future scenario (2075-2099). Here's the relevant part of the code:
p10 = xclim.core.calendar.percentile_doy(dset_hist.tasmin, per=10)

TN10p_dset = xclim.indicators.icclim.TN10p(dset.tasmin, t10=p10, freq='QS-DEC')
TN10p_dset_hist = xclim.indicators.icclim.TN10p(dset_hist.tasmin, t10=p10, freq='QS-DEC', bootstrap=True)

TN10p_dset_sm = TN10p_dset.groupby('time.season').mean(dim='time')
TN10p_dset_hist_sm = TN10p_dset_hist.groupby('time.season').mean(dim='time')

TN10p_diff = TN10p_dset_sm - TN10p_dset_hist_sm

The 10th percentile (p10) is calculated from the historical tasmin data. This is used to find the TN10p values for the same historical period and the future scenario. I then find the seasonal means and the seasonal difference. I assume that there's no need to set bootstrap=True like I've done for the calculation of the historical TN10p, right?
Also, thanks for showing me Dask distributed. These things are all very new to me, and I really appreciate the help!

Exactly, you don't need bootstrap on neither of the calls of TN10p.
On hist case, you don't have a out_of_base period, both percentiles and tn10p are called on the same period.
On futur case, you have an in_base and an out_of_base but they don't overlap so bootstrap is useless here as well.

Ok, that cleared up my confusion about bootstrapping, Thanks for your help!

I'm closing this, feel free to reopen if there are other concerns on bootstrap.

Hi,
I'm reopening this if you don't mind.
With Christian we have seen that bootstrap can exhaust memory very well on large datasets. It happens even with the latest version of xclim (0.33.x).
I'm trying to fix this and will drop a PR when I'm finished done.
My current approach is to try to use map_block but I'm having very mixed results for now.


fix cmake target include directory exporting

The reason is explained here: https://github.com/nanomsg/nng/pull/733

I will hold this back until we merge the branch for the next version.


Final Export for updated products

Hi @mhaack
Here is the final export for updated products on or after 0
final-product-export-29-06-2023.xlsx
4 May 2023


Plugin for Hyper terminal

Just in case anyone's looking for an integration with Hyper terminal:
I wrote a tiny plugin that will pull the cached colorscheme into Hyper.
hyper-wal

We should add a section to the README about plugins that work with wal. I'll add it to my TODO list.

Added a section to the README.


BigQuery dataset.list_tables() fails when the dataset is empty

Good day.
Getting this exception when the BigQuery dataset contains no tables:
  File "/Library/Python/2.7/site-packages/gcloud/bigquery/dataset.py", line 507, in list_tables
    for resource in resp['tables']]
KeyError: 'tables'

Mac OS X El Capitan. gcloud 0.8.0

Thanks @evmin!

I reproduced with
>>> from gcloud import bigquery
>>> client = bigquery.Client()
>>> dataset_name = 'foo_bar_baz'
>>> dataset = client.dataset(dataset_name)
>>> if dataset.exists():
...     raise ValueError('Expected a new dataset')
...
>>> dataset.create()
>>> dataset.exists()
True
>>> all_tables, token = dataset.list_tables()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "gcloud/bigquery/dataset.py", line 553, in list_tables
    for resource in resp['tables']]
KeyError: 'tables'
>>> dataset.delete()
>>>

at 2323e1a110d240545bf2950e18e5ccefb75d01f1

What is the content of resp at that point?  The API docs don't indicate that the tables key is optional.  We can defend against it, but shouldn't have to, IMHO.

@tseaver I sent out a fix for this already.

Oops, my bad.

@tseaver Here is the full payload
{
  "etag": "\"AMpOK...\"",
  "kind": "bigquery#tableList",
  "totalItems": 0
}

Anything issue there before I merge the fix?

Nope, I was just "arguing with the ref":  like it would have hurt the back-end to send the extra 13 bytes. :(

Gotcha.


Export Node interface

Is Node meant to be implemented by LionCore-compatible libraries such as Tylasu? Right now, it's not exported, so we cannot make a Tylasu node "be-a" LionCore node.

Node in src/types.ts is export-ed. A central mod.ts is lacking, so nothing is discoverable. Would a mod.ts suffice?


Release recorder and test-credential packages

Reasons

Required to migrate the tests in the autorest.typescript repo, to unblock the validation and testing RLC
Since we intend to make it public (as requested by Dina for a better customer testing strategy)
Since it is already published - for the v1

@HarshaNalluru Any update for this issue?

Both the packages, test-recorder, and the test-credential are released.
<EMAIL_ADDRESS><EMAIL_ADDRESS>


Guides publication/upgrade/testing automation

This is my vision for this.
Instead of being a guide per language, lets have a single guide. Each guide will contain build samples (Maven and Gradle), code samples in three languages (Java, Groovy, Kotlin) and test samples (Java Junit, Spock Groovy, Junit Kotlin).
My idea is to use the Launch infrastructure to create guides which upgrade automatically with new version and whose test are execute it each time the Micronaut Launch test suite is run.
For example, the Create your first Micronaut app would be a set of rocker templates:
@import io.micronaut.starter.application.Project

@args (
Project project
)

@if (project.getPackageName() != null) {
package @project.getPackageName()
}

package example.micronaut;

import static org.junit.jupiter.api.Assertions.assertEquals;
import static org.junit.jupiter.api.Assertions.assertNotNull;

import io.micronaut.http.HttpRequest;
import io.micronaut.http.client.RxHttpClient;
import io.micronaut.http.client.annotation.Client;
import io.micronaut.test.annotation.MicronautTest;
import org.junit.jupiter.api.Test;

import javax.inject.Inject;

@@MicronautTest
public class HelloControllerTest {

    @@Inject
    @@Client("/")
    RxHttpClient client;

    @Test
    public void testHello() {
        HttpRequest<String> request = HttpRequest.GET("/hello");
        String body = client.toBlocking().retrieve(request);

        assertNotNull(body);
        assertEquals("Hello World", body);
    }
}

and a Feature per guide:
@Singleton
public class CreatingYourFirstMicronautApp implements Feature, Guide {

    @Override
    public String getName() {
        return "creating-your-first-micronaut-app";
    }

    @Override
    public String getTitle() {
        return "Creating your first Micronaut App";
    }

    @Override
    public String getDescription() {
        return "Learn how to create a Hello World Micronaut app with Java with a controller and a functional test.";
    }

    @Override
    public void apply(GeneratorContext generatorContext) {
        Project project = generatorContext.getProject();
        generateCode(generatorContext, project)

Per guide, before rendering the HTML we will do some curl request to generate the sample projects:
Some projects, those with multiple apps (e.g. distributed tracing) may need to generate six projects or more.
curl micronaut.io/launch
--features=guide-creating-your-first-micronaut-app
    --lang=kotlin

curl micronaut.io/launch --features=guide-creating-your-first-micronaut-app
--lang=groovy

curl micronaut.io/launch
--features=guide-creating-your-first-micronaut-app
--lang=java

We can make the Guide features hidden at the CLI and UI.

We will need to create an asciidoctor macro for the test samples (Java Junit, Spock Groovy, Junit Kotlin).
Ability to wrap some asciidoc comments around configurtation and dependencies since we often embeeded configuration and dependnecies in the guides.
Github actions to republish

I think automating guides it is key to be able to write documentation and will provide a safety net of functional tests.
In fact, my recommendation is that we don't write new guides until we have automate it.
Before going rouge for every guide, I would recommend lets try to create a prototype with one guide.

I like this idea of generating the guides automatically. As someone that has updated the guides manually many times this would be great :smiley:
Some random thoughts in no particular order:
Instead of coupling the guides with Starter I think it would be better to fork the project and keep the guides code only in the fork.
The main two benefits I see for this are to reduce the Starter build time (which already takes too much time) and do not mix the guides code with the features code.
Keeping the fork up to date should be easy because we're not doing big changes in Starter anymore and we won't modify anything related to Starter in the Guides. Probably it would be a matter of merging the changes done upstream once a week and it won't be any merge conflicts.
I agree we should migrate 2-3 guides following this approach to really see how big the effort is and find any problems.
I'm afraid that migrating some of the "complex" guides (the ones with 3-4 microservices), with a lot of steps can be tricky and complicated. A few guides have "intermediate" directory (beside "complete" and "initial") and we fetch files from there as an intermediate solution. Then we explain a better solution and fetch the files from "complete" directory. Maybe we should re-think this and simplify those guides a little bit.
On the user side, I think with this approach it will be more complicated to users to send PRs because the code "is not there" but it's generated from rocker templates.
So, as a summary, :+1:. I think we should prioritize it and if we all agree start working on it. We have ideas for new guides on the pipeline and if the plan is not create more until this is done (or at least, only create new guides with this new approach during the migration), it's better to start soon.

I used a similar approach in Spring Security REST, by having a profile with the tests, and different features with their own dependencies and configurations to test different scenarios. Then I would generate all possible combinations with this custom profile, and add the generated projects to settings.gradle, so at that point it was a matter of ./gradlew test to test everything.
I really miss the possibility to package profiles as JAR files. If micronaut-starter supported that, you wouldn't need to mess with forks.
A poor-man's alternative would be to create blank applications:
curl micronaut.io/launch --lang=kotlin
curl micronaut.io/launch --lang=groovy
curl micronaut.io/launch --lang=java

Then copy the artifacts (controller, test, configuration, etc).
And a third alternative coming to my mind is, instead of forking micronaut-starter, you have a Gradle project with your features that has starter-core and starter-cli as dependencies.
In general, micronaut-starter extensibility is something that should be revisited, and based on that, your strategy to implement this task might vary.

I think the idea of using starter is good. You don't have to fork it though as Alvaro said. You can simply add a dependency on it and your features will be picked up as they are just beans. Looking forward to the POC

In fact, my recommendation is that we don't write new guides until we have automate it.

With your recommendation, is there an ETA on when guide publishing would resume?


Misc fixes

Codecov Report

Merging #46 (4468d51) into master (b7ab208) will increase coverage by 8.72%.
The diff coverage is 59.22%.

@@            Coverage Diff             @@
##           master      #46      +/-   ##
==========================================
+ Coverage   21.06%   29.79%   +8.72%
==========================================
  Files          60       61       +1
  Lines       11024    11117      +93
  Branches      100      145      +45
==========================================
+ Hits         2322     3312     +990
+ Misses       8602     7660     -942
- Partials      100      145      +45

Impacted Files
Coverage Δ

src/clj/skylobby/fx/replay.clj
63.10% <ø> (+59.18%)
:arrow_up:

src/clj/skylobby/fx/root.clj
6.54% <0.00%> (-0.26%)
:arrow_down:

src/clj/skylobby/fx/settings.clj
3.89% <0.00%> (-0.14%)
:arrow_down:

src/clj/spring_lobby.clj
13.27% <0.00%> (-0.22%)
:arrow_down:

src/clj/spring_lobby/client.clj
26.82% <0.00%> (-0.81%)
:arrow_down:

src/clj/spring_lobby/spring.clj
55.22% <1.88%> (+0.16%)
:arrow_up:

src/clj/spring_lobby/client/handler.clj
32.59% <44.11%> (+0.25%)
:arrow_up:

src/clj/skylobby/fx/register.clj
8.45% <50.00%> (+2.48%)
:arrow_up:

src/clj/skylobby/fx/server.clj
7.75% <50.00%> (+1.50%)
:arrow_up:

src/clj/skylobby/fx/matchmaking.clj
6.06% <60.00%> (+2.83%)
:arrow_up:

... and 9 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update b7ab208...4468d51. Read the comment docs.


Handle lxml unicode error

I have a few evtx files were the record_xml being passed to to_lxml() is unicode, with no odd characters. LXML (3.7.3) spits the following out:
$ python process-forest/src/process_forest.py SYSMON%4OPERATIONAL.EVTX summary
INFO:process-forest.global:using evtx log file
DEBUG:Evtx.Evtx:FILE HEADER at 0x0.
DEBUG:Evtx.Evtx:CHUNK HEADER at 0x1000.
DEBUG:Evtx.Evtx:Record at 0x1200.
Traceback (most recent call last):
  File "process-forest/src/process_forest.py", line 483, in <module>
    main()
  File "process-forest/src/process_forest.py", line 461, in main
    analyzer.analyze(get_entries_with_eids(evtx, set([4688, 4689, 1, 5])))
  File "process-forest/src/process_forest.py", line 211, in analyze
    for entry in entries:
  File "process-forest/src/process_forest.py", line 193, in get_entries_with_eids
    for entry in get_entries(evtx):
  File "process-forest/src/process_forest.py", line 183, in get_entries
    yield Entry(xml, record)
  File "process-forest/src/process_forest.py", line 73, in __init__
    self._node = to_lxml(self._xml)
  File "process-forest/src/process_forest.py", line 25, in to_lxml
    record_xml.replace("xmlns=\"http://schemas.microsoft.com/win/2004/08/events/event\"", ""))
  File "src/lxml/lxml.etree.pyx", line 3213, in lxml.etree.fromstring (src/lxml/lxml.etree.c:79010)
  File "src/lxml/parser.pxi", line 1843, in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:118282)
ValueError: Unicode strings with encoding declaration are not supported. Please use bytes input or XML fragments without declaration.

One possible solution, at least for this instance, is to wrap return in to_lxml(), catch the ValueError & manually set the etree.XMLParser to use utf-8 encoding and manually encode record_lxml.replace() as well
...
    except ValueError:
        utf8_parser = etree.XMLParser(encoding='utf-8')
        return etree.fromstring("<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"yes\" ?>%s" % record_xml.replace("xmlns=\"http://schemas.microsoft.com/win/2004/08/events/event\"", "").encode('utf-8'), parser=utf8_parser)

or just manually encode w/o defining a new parser
...
return etree.fromstring("<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"yes\" ?>%s" % record_xml.replace("xmlns=\"http://schemas.microsoft.com/win/2004/08/events/event\"", "").encode('utf-8'))

I like the first suggestion, where we explicitly declare the xml parser encoding, and the encoding of the xml string. it seems we should do this for all records, not just the ones that fail. would you put together a PR with this fix, after demonstrating it works for your sample?

I am using the very latest version of the project, but get the same error:
INFO:process-forest.global:using evtx log file
DEBUG:Evtx.Evtx:FILE HEADER at 0x0.
DEBUG:Evtx.Evtx:CHUNK HEADER at 0x1000.
DEBUG:Evtx.Evtx:Record at 0x1200.
Traceback (most recent call last):
  File "process-forest/src/process_forest.py", line 504, in <module>
    main()
  File "process-forest/src/process_forest.py", line 482, in main
    analyzer.analyze(get_entries_with_eids(evtx, set([4688, 4689, 1, 5])))
  File "process-forest/src/process_forest.py", line 222, in analyze
    for entry in entries:
  File "process-forest/src/process_forest.py", line 203, in get_entries_with_eids
    for entry in get_entries(evtx):
  File "process-forest/src/process_forest.py", line 193, in get_entries
    yield Entry(xml, record)
  File "process-forest/src/process_forest.py", line 78, in __init__
    self._node = to_lxml(self._xml)
  File "process-forest/src/process_forest.py", line 25, in to_lxml
    return etree.fromstring("<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"yes\" ?>%s" %
  File "src/lxml/etree.pyx", line 3237, in lxml.etree.fromstring
  File "src/lxml/parser.pxi", line 1891, in lxml.etree._parseMemoryDocument
ValueError: Unicode strings with encoding declaration are not supported. Please use bytes input or XML fragments without declaration.

I think this should be reopened, shouldn't it?

UPD: I haven't read any other parts of code and haven't worked with lxml/Evtx/etc, so I don't know how good or crutchy this solution is, but I've fixed the issue by editing src/process_forest.py:25 (adding the b character to use bytes instead of str):
    return etree.fromstring(b"<?xml version=\"1.0\" encoding=\"utf-8\" standalone=\"yes\" ?>%s" %

P. S. If you find this solution good, I would be glad to be a co-author of a commit fixing this :)

same problem with master version of today, i'd very much appreciate a fix :)

same problem with master version of today, i'd very much appreciate a fix :)


room-join cannot detect inviteeList when people join in the room with qrcode

room-join cannot detect inviteeList when people join in the room with QR code:

If one contact joins in the room by the QR code shared by the bot, system message as follows:

"李佳芮" joined the group chat via your shared QR Code.
"李佳芮"通过扫描你分享的二维码加入群聊

If one contact joins in the room isn't by the QRcode shared by the bot, system message as follows:

" 李佳芮" joined the group chat via your shared QR Code.
" 李佳芮"通过扫描你分享的二维码加入群聊
(Pay attention that it has more space before 李佳芮)

Coverage remained the same at 54.647% when pulling d91432841193fdd3bd540127dc0d5080b63ed3ab on lijiarui:qrcodeBug into 1830cb3eb7815b9f569e339a694f4b4218ca6abf on Chatie:master.

Coverage remained the same at 54.647% when pulling d91432841193fdd3bd540127dc0d5080b63ed3ab on lijiarui:qrcodeBug into 1830cb3eb7815b9f569e339a694f4b4218ca6abf on Chatie:master.

Thanks


GlobalNet

ref #31 Adding affine transformation option

@RemiDelaunay  I prove this now but the mode build still needs updated - it could well be in your plan ;)

@YipengHu I thought it would be redundant to create a separate build mode for the global network when compared to the ddf one (the regularisation term perhaps but its weight can just be set to 0 in the config file).

One might also want to output the transform parameters theta?
Yipeng

From: Rémi Delaunay<EMAIL_ADDRESS>Sent: Friday, June 19, 2020 1:09:13 AM
To: ucl-candi/DeepReg<EMAIL_ADDRESS>Cc: Hu, Yipeng<EMAIL_ADDRESS>Mention<EMAIL_ADDRESS>Subject: Re: [ucl-candi/DeepReg] GlobalNet (#43)
@YipengHuhttps://github.com/YipengHu I thought it would be redundant to create a separate build mode for the global network when compared to the ddf one (the regularisation term perhaps but its weight can just be set to 0 in the config file).
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/ucl-candi/DeepReg/pull/43#issuecomment-646365379, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AATX37JCNMDKPUHOTOZ3U7DRXKUCTANCNFSM4OCHJUBQ.


[Question]: Input should be an instance of AgentRunner [type=is_instance_of, input_value=<multi_agent_app.agent_se...bject at 0x7f2abaa18fa0>, input_type=ReActAgent]

Question Validation

[X] I have searched both the documentation and discord for an answer.

Question
i am trying use workflow react agent class as a AgentService .
 react_agent1 = ReActAgent(llm=OpenAI(model="gpt-4o-mini"), tools=tools, timeout=120, verbose=True)
 agent_server = AgentService(
    agent=react_agent1,...)

how can i change reactagent to  a Agentrunner instance

AgentService is llama-agents right?
Don't even worry about this actually 😅 Huge refactor coming soon to llama-agents to work solely with workflows
https://github.com/run-llama/llama-agents/tree/v0.1.0

yes it is llama agents . Don't even worry about this actually 😅 Huge refactor coming soon to llama-agents to work solely with workflows 🥳🎉


The "mobility" style in the demo is broken.

Appears to be trying to fetch the style from an old location.

@PetersonGIS hasnt finished porting this style to the new schema. The old one is here https://github.com/PetersonGIS/Mobility

@milafrerichs looks like you have it working, but the preview image is not yet in. Can you add it and then close this issue?