v0.18.3-beta endgame

DRIs

DRI

Endgame
@Jeadie

QA
@ewgenius

Docs
@Sevenannn

Comms
@karifabri

Milestone Release Timeline

Date
Description

Planning
Mon September 23rd

Release
Mon September 30th

Announcement
Tue October 1st

Planning Checklist

[ ] Review the specific GitHub Milestone

Release Checklist

[x] All features/bugfixes to be included in the release have been merged to trunk
[x] Full test pass and update if necessary over README.md @ewgenius
[ ] Full test pass and update if necessary over Docs
[x] Full test pass and update if necessary over existing and new Samples

[x] Sales BI Dashboard @sgrebnov
[x] Local Materialization and Acceleration CQRS @slyons
[x] Accelerated table data quality with constraint enforcement @Jeadie
[x] Streaming changes in real-time with Debezium CDC @peasee
[x] Encryption in transit using TLS @sgrebnov
[x] Adding Spice as a Grafana datasource @Sevenannn
[x] FTP/SFTP Data Connector @ewgenius
[x] Spice with Go SDK sample @Jeadie
[x] Spice with Java SDK sample @Sevenannn
[x] Spice with Rust SDK sample @sgrebnov
[x] Spice with spice.js SDK sample @slyons
[x] Spice with spicepy SDK sample @peasee

[x] Full test pass and update if necessary over existing and new Quickstarts

Data Connectors:
[x] Apache Superset @sgrebnov
[x] AWS RDS Aurora (MySQL Compatible) Data Connector @Jeadie
[x] AWS RDS PostgreSQL Data Connector @ewgenius
[x] Clickhouse Data Connector @slyons
[x] Databricks Delta Lake Data Connector @Sevenannn
[x] Dremio Data Connector @peasee
[x] DuckDB Data Connector @sgrebnov
[x] FTP Data Connector @ewgenius
[x] File Data Connector @Jeadie
[x] GitHub Data Connector @sgrebnov
[x] GraphQL Data Connector @sgrebnov
[x] MSSQL Data Connector @slyons
[x] MySQL Data Connector @Jeadie
[x] ODBC Data Connector @peasee
[x] Planetscale Data Connector @peasee
[x] PostgreSQL Data Connector @slyons
[x] S3 Data Connector @sgrebnov
[x] SharePoint Data Connector @ewgenius
[x] Snowflake Data Connector @slyons
[x] Spark Data Connector @sgrebnov
[x] Supabase Data Connector @peasee
[x] Spice.ai Cloud Platform Data Connector @Sevenannn
Data Accelerators:
[x] DuckDB Data Accelerator @ewgenius
[x] PostgreSQL Data Accelerator @Sevenannn
[x] SQLite Data Accelerator @Jeadie
Catalog Connectors:
[x] Databricks Unity Catalog Connector @sgrebnov
[x] Spice.ai Cloud Platform Catalog Connector @peasee
[x] Unity Catalog Connector @slyons
Other Quickstarts:
[x] Advanced Data Refresh @Sevenannn
[x] Data Retention Policy @Jeadie
[x] Deploying to Kubernetes @ewgenius
[x] Federated SQL Query @slyons
[x] Indexes on Accelerated Data @sgrebnov
[x] Refresh Data Window @peasee
[x] Results Caching @Jeadie
[x] Securing data in transit via TLS @sgrebnov
[x] TPC-H Benchmarking @sgrebnov

[ ] Merge Docs PRs

[ ] Update spice version in docs banner

[x] Merge Samples PRs
[x] Merge Quickstarts PRs
[x] Update release notes

[x] Ensure any external contributors have been acknowledged.

[x] Update acknowledgements by triggering Generate Acknowledgements workflow

[ ] Update acknowledgements in docs

[x] Verify version.txt and version in Cargo.toml are correct using docs/RELEASE.md
[x] Ensure E2E Test CI is green on the trunk branch.
[x] QA DRI sign-off
[x] Docs DRI sign-off
[x] Create a new branch release-v[semver] for the release from trunk. E.g. release-v0.17.0-beta
[ ] Release the new version by creating a pre-release GitHub Release with the tag from the release branch. E.g. v0.17.0-beta
[ ] Release any docs updates by creating a v[semver] tag.
[ ] Trigger algolia search crawler workflow, to reindex updated docs.
[ ] Update the Helm chart version (image.tag version & chart version). Ensure docker build for the tag from the release branch completed (~2 hours) and trigger the Release Chart workflow.
[ ] Final test pass on released binaries
[ ] Run Generate Spicepod JSON schema
[ ] Run E2E Test Release Installation
[ ] Update version.txt and version in Cargo.toml to the next release version.
[ ] Update versions in brew taps
[ ] Remove the released version from the ROADMAP

Announcement Checklist

[ ] X: @spice_ai
[ ] Reddit: reddit.com/r/spiceai
[ ] Discord: #announcements
[ ] Telegram: spiceai
[ ] Blog: blog.spiceai.org

E2E test CI: https://github.com/spiceai/spiceai/actions/runs/11116220560

build_and_release: https://github.com/spiceai/spiceai/actions/runs/11116999014
spiced_docker: https://github.com/spiceai/spiceai/actions/runs/11116999015


expected dense_1 to have shape (6,) but got array with shape (9,) Error

Hi
I got an error in running my code. anyone can help?
Error: expected dense_1 to have shape (6,) but got array with shape (9,)
The role of code to classification images in 6 classes.
code:
PSPI_folder='.../PSPI/042-ll042'
img_folder='.../Images/042-ll042'
X=[]
Y=[]
folders=os.listdir(PSPI_folder)
for i in range(len(folders)):
foldername=folders[i]
PSPI_folder1=os.path.join(PSPI_folder,foldername)
img_folder1=os.path.join(img_folder,foldername)
imgfiles=os.listdir(img_folder1)
pspifiles=os.listdir(PSPI_folder1)
for j in range(len(pspifiles)):
file_name=pspifiles[j]
PSPIfile_path=os.path.join(PSPI_folder1,pspifiles[j])
imgfile_path=os.path.join(img_folder1,imgfiles[j])
PSPIfile = open(PSPIfile_path, "r")
cs=int(float(str(PSPIfile.read()).replace('\n','')))
Y.append(cs)
img=cv2.imread(imgfile_path)
img.resize(224,224,3)
v = np.array(img)
im = img.reshape(-1,1,224,224,3)
v = np.array(im)
v0=[]
    for vv in v:
        v0.append(vv[0])
    X.append(np.array(v0))

def get_y(Y):
output=[]
n_tags = np.max(Y) + 1
for i in range(len(Y)):
vv=[]
for k in range(n_tags):
if(k==Y[i]):
vv.append(1)
else:
vv.append(0)
output.append(vv)
return output
X=np.array(X)
Y=np.array(Y)
n_tags=np.max(Y)+1
YY=np.array(get_y(Y))
X_tr, X_te, y_tr, y_te = train_test_split(X, YY, test_size=0.01)
print (img.shape)
print (X_tr.shape)
print (X_tr.shape)
vggface_model = VGGFace(include_top=False,model='resnet50',input_shape=(224, 224, 3))
top_layers_checkpoint_path = 'cp.top.best.hdf5'
fine_tuned_checkpoint_path = 'cp.fine_tuned.best.hdf5'
last_layer = vggface_model.get_layer('avg_pool').output
x = Flatten(name='flatten')(last_layer)
vfmodel_out = Dense(6, activation='softmax', name='classifier')(x)
vfmodel = Model(input=vggface_model.input, output=vfmodel_out)
first: train only the top layers (which were randomly initialized)
i.e. freeze all vggface layers
for layer in vfmodel.layers:
layer.trainable = False
#our model
input_lay = Input(shape=(None, 224, 224, 3)) #dimensions of your data
time_distribute = TimeDistributed(Lambda(lambda x: vfmodel(x)))(input_lay)
lstm_lay = LSTM(20)(time_distribute)
output_lay = Dense(6, activation='relu')(lstm_lay)
model = Model(inputs=[input_lay], outputs=[output_lay])
compile the model (should be done after setting layers to non-trainable)
model.compile(optimizer='adam', loss='categorical_crossentropy', metrics=['categorical_accuracy'])
#train the model on the new data for a few epochs
model.fit(X_tr, y_tr,  batch_size=24,
epochs=1,
validation_data=(X_te, y_te))

I was having a similar error which i later found out was because of the input parameter to model.fit not being a numpy array. Here i think the problem is that the train_test_split returns a list, which is not a suitable parameter type for fit.

@ghazalbargshady Did you solve the problem?

thanks


Embedding Fonts

It would save a lot of space with larger files if the font is embedded rather than inserting the svg path of each character over and over. It would also allow people to copy the text, which can be useful as well.

We are seeing this same issue when running on Heruko but not on local dev (OSX). File sizes are 5MB and 300K, respectively. Any ideas on how to resolve this?

😢 not again.
https://github.com/marcbachmann/node-html-pdf/issues/63
https://github.com/marcbachmann/node-html-pdf/issues/95

It might be a good idea to add an option to switch between methods, but I do believe that font-embedding should be the default. As it is in both chrome and firefox. Maybe that is my builtin Linux PDF printer (QPDF), but either way...
Sorry this keeps coming up; I appreciate your support greatly.

I our case, the issue is not exclusive to fonts. The entire document is rasterized including the .svg graphics.

opened an issue with phantomjs-prebuilt - https://github.com/Medium/phantomjs/issues/564

Please check that one out https://github.com/ariya/phantomjs/issues/13997 if you haven't seen it already.
They mention that there's a problem for webfonts. If you're installing the font you're using locally, it can work.

I can confirm that the problem is specific to when it is linked as a webfont, installing it locally works as expected.

Does it have to go in the ~/.fonts directory? When deploying to a PaaS like Heroku, you only have access to your code area not system. Wondering if you can reference the fonts within your own code with this src="./path-to-font"

In my case I have them in ~/.local/share/fonts, though /usr/share/fonts should work just the same. I have not been able to get it working with a manually specified directory.


PWA-293: Updated the parameter order of the mergeTranslations call

now matches the method signature of the helper module within common

Pull Request Test Coverage Report for Build 625

0 of 0 (NaN%) changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 41.452%

Totals

Change from base Build 624:
0.0%

Covered Lines:
1857

Relevant Lines:
4378

💛  - Coveralls


Unhandled exception on

Unhandled error even attempting to open Recipe pane.
Unhandled error selecting anything in "Exclude tab from Recipe results"
Error log:
[06-07-2019 22:54] System.ArgumentException: Value does not fall within the expected range. ---> System.ArgumentException: Value does not fall within the expected range.
--- End of inner exception stack trace ---
at Procurement.Utility.StashHelper.buildImage(Tab tab, List`1 images, Bitmap finalImage, Int32 offset, String key)
at Procurement.Utility.StashHelper.GenerateTabImage(Tab tab, Boolean mouseOver)
at Procurement.View.TabIDToStashControlFiltered.Convert(Object value, Type targetType, Object parameter, CultureInfo culture)
at System.Windows.Data.BindingExpression.TransferValue(Object newValue, Boolean isASubPropertyChange)
at System.Windows.Data.BindingExpression.Activate(Object item)
at System.Windows.Data.BindingExpression.AttachToContext(AttachAttempt attempt)
at System.Windows.Data.BindingExpression.MS.Internal.Data.IDataBindEngineClient.AttachToContext(Boolean lastChance)
at MS.Internal.Data.DataBindEngine.Task.Run(Boolean lastChance)
at MS.Internal.Data.DataBindEngine.Run(Object arg)
at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)
After the application crashes and I go back into the settings, my selection for tabs to exclude from recipe results has been registered.
Currently the only tabs that are included in the recipe search results are my 4 standard tabs and my 2 premium tabs.
Special tabs I have:
Cash
Maps
Essences
Fragments
Uniques
Cards
Once everything except my 4 standard and 2 premium tabs is excluded, Recipe's pane works.
Once I try to unselect my main characters personal inventory in the recipe exclusion settings (I tried flagging on/off all special and all other character inventory tabs) the app crashes again with an unhandled exception.

Found another Unhandled exception in the Recipes pane.
When I try to select an item in my Uniques (special) tab, it crashes too.
I found that if I try to open the Uniques tab in the applications inventory screen, the tab is completely empty.
I'm suspecting the way they store things is quite a bit different from normal tabs.
Especially considering you can store 1 of all uniques in there and that makes up for a far larger grid than even a 4x sized super tab.

After trying to use this all day, I've also found that the application doesn't update any of the inventories unless you restart it completely.
Refresh from within the application doesn't work.

Procurement 1.27.2 has been released, which includes a number of refresh related fixes. Please test again and see if you still have issues.

Seems to work so far.
Will report any further bugs I find.


merge from 02-feature/07-investments-page into 00-dev

:tada: This issue has been resolved in version 0.13.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Feature request: Ability to choose locale

Add pls ability to choose locale like theme switching

A workaround:
https://github.com/ookami-kb/storybook_flutter/issues/48#issuecomment-1434688441


PhpMethodHandler - When transferring tasks, avoid double-quote

This might address #15.

Thanks @totten this does make the warning go away and I can see it runs (e.g. it updates ext\greenwich\dist\bootstrap3.css)

Great. Thanks @demeritcowboy. Merging. Will tag as v0.16 shortly.


Ticking bug fix

There is a more minor bug that can be reproduced the following way:

In 'Preferences' -> 'Notifications' -> 'Play tick tock sound during' check 'Pomodoro' and uncheck 'Break'.
Start a pomodoro
Start a short break (without stopping the pomodoro)

The ticking won't stop.
Alternatively if 'Pomodoro' is unchecked and 'Break' is checked then the same happens when a pomodoro is started during a short break.

Thanks @yenshirak, slating this for the next revision release. Cheers.


update of Galaxy-Workflow-Metavisitor__Workflow_for_Use_Case_3-2.ga

in the workflow toolshed repository

👍  do we have the corresponding update in https://github.com/artbio/ansible-artimed ?

Yes indeed ! this pull request is behind the one already merged in ansible-artimed. The diff returns no difference

And the workflow is also already updated in the toolshed by the way


Travis is flaky

due to 403
is there anything we can do to improve the situation ?
/cc @mprobst

This is due to github rate limiting tsd. I think we should be able to fix this with a TSD_GITHUB_TOKEN in .travis.yml. See (here)[https://github.com/DefinitelyTyped/tsd#tsdrc].
@vicb want to take a stab at it?

Thanks for the pointer.
However it seems we already have this setup https://github.com/angular/ts2dart/blob/master/.travis.yml#L20
Looking at why it doesn't work ATM

Maybe we should be using the environment variable TSD_GITHUB_TOKEN, not TSDRC?

Let's hope that fixes it. If not, we can try not having tsd replace the existing files (less traffic), or the .tsdrc way. Kind of nasty to debug and figure out if a solution is correct...


GDB breakpoint not work when firmware address begins 0x80000000 in RV32 mode

Describe the bug
gdb continue working when set breakpoint
Affects version
develop branch
gem5 Modifications
Add system.workload.wait_for_remote_gdb = args.wait_gdb before root = Root(...) in fs_linux.py
To Reproduce

Create rot13.c and rot13.ld anywhere

rot13.c
char text[] = "Vafgehpgvba frgf jnag gb or serr!";

// Don't use the stack, because sp isn't set up.
volatile int wait = 1;

int main()
{
    while (wait)
        ;

    // Doesn't actually go on the stack, because there are lots of GPRs.
    int i = 0;
    while (text[i]) {
        char lower = text[i] | 32;
        if (lower >= 'a' && lower <= 'm')
            text[i] += 13;
        else if (lower > 'm' && lower <= 'z')
            text[i] -= 13;
        i++;
    }

done:
    while (!wait)
        ;
}

rot13.ld
OUTPUT_ARCH( "riscv" )
ENTRY(main)

SECTIONS
{
  . = 0x80000000;
  .text : { *(.text) }
  .data : { *(.data) }
}

Compile the rot13.c

riscv64-unknown-elf-gcc -static -nostdlib -g -Og -nostartfiles -ffreestanding -march=rv32ic_zicsr -mabi=ilp32 -Wl,-Trot13.ld rot13.c -o rot13.elf

Run script

build/ALL/gem5.opt configs/example/riscv/fs_linux.py --bare-metal --kernel rot13.elf --riscv-32bits --wait-gdb

You need to open GDB to let gem5 continue
4. Open GDB
riscv64-unknown-elf-gdb rot13.elf

Run commands in GDB

target remote :7000
si
si
si
si
set wait = 0
b *0x8000000c
c

Expected behavior
gdb should stop at the breakpoint
Host ISA
X86
Compiler used
gcc 13.2

Fixed by #1470


How do I get about/traffic?

Snoowrap seems to be missing a dedicated method for it, but you can do r.oauthRequest({ uri: 'r/theSubreddit/about/traffic' }) to get the traffic page.


Maui port  fix application adapter modal popped

It seems that Navigation is not initialized without calling IApplication#CreateWindow, so it does not work correctly.
Please check here.

Instead of adding that code to that specific test, we can add it to the initializer of ApplicationMock so all tests can be fixed with it.
https://github.com/drasticactions/KAMISHIBAI/commit/370b39f6d7cae6ef7b4bd532e4f8cbb0b0f06855
Good job figuring out that that was missing though!


Configuration

I would like to create tag names.  I cannot find configuration in order to do this?

Hello @timrcoder
Have you tried (in settings.json):
"commentAnchors.tags.list":
[
{
"tag"            : "Read Me",
"iconColor"      : "green",
"highlightColor" : "green",
"backgroundColor": "none",
"scope"          : "file",
"isBold"         : true,
"isItalic"       : true
}
]

Closing as the question has been answered correctly.


use snowflake-connector-python's function to export to pandas

Snowflake has a new method to efficiently export to pandas
https://docs.snowflake.net/manuals/user-guide/python-connector-pandas.html#
A test with 8463105 rows of data shows a ~20x speed up on Snowflake.

@dasjyao Did you want to take a look at this? It could be helpful and replace our own implementation.

Looks good! Will do some performance tests before implement the changes.

@dasjyao Have you done any work on this? I might take a stab at it if not.

@jfyu When you ran this test did you run it on the same table back to back? I'm wondering if the efficiency gain you saw was SF caching the results? I'm just testing it out on 779.0K row dataset and I don't really see any gains. It spends most of the time just downloading the data.

@fdosani huh that's a good question. It's been a while since I did the test. Maybe it's SF after all!! I can try to double check this but not this week.  But if that's what you are finding we can de-prio this.

sorry, I completely forgot about this as it got busy with work earlier. But I remember I did run one test months ago and see some improvements (don't remember exactly how big the difference is). @fdosani Please feel free to work on it If you want. If not, I can pick it up again.

@dasjyao Would you mind running some tests to check performance on your end? I'm still not seeing any really. But it does simplify the code which is a positive.

for sure! I will do some tests and report back this week.

There is also write methods to put a df back into a table which could help clean up the code a bit.

I have run 30 tests to pull data from a table with ~70 columns. From the result below, fetch_pandas_all() performs about 2-3 times better than fetchall() in general. However, The new function seems to have very high requirements for the environment. I always got Segmentation fault: 11 when i ran this function from local. I'm not sure if it's just me. @fdosani would you mind trying to see if you can reproduce the same error? If that's an issue, I would recommend to have an option to switch back to fetchall() in the case when the new function fails.
      row_size  fetch_all  fetch_pandas
0      1987003  36.692733      9.676616
1       393963   5.751460      2.204298
2      1122777  12.095722      4.905406
3      1299286  14.072498      6.290301
4       897154  10.240554      4.604224
5      1029770  12.795818      7.083390
6      1417679  15.777973      7.162826
7      2829893  30.453512     13.125842
8      1481083  16.416293      7.430757
9      1169218  12.856212      5.335738
10     3043863  32.236692     13.772858
11     1920762  21.132539      9.060583
12     3525649  37.232501     17.885588
13     3800646  40.159850     17.240576
14     3199208  34.441831     24.363943
15     1379850  15.075403      8.692440
16     4786611  49.407794     25.387532
17      606383   7.374214      2.919430
18     2963895  30.957134     13.902957
19     2643807  27.739896     12.139245
20     1800207  19.034973      8.413508
21     4613072  47.879083     22.032341
22     2791168  29.589400     11.921853
23     3509180  36.891674     16.042753
24     1849277  19.943107      8.790991
25     1768059  18.980515      8.491843
26     1101614  12.014528      5.204859
27      300523   3.821525      3.384054
28      700474   7.825704      3.129873
29     2628029  28.370677     12.026310

Thanks @dasjyao! That’s interesting are these just back to back test? Again
concerned about the caching within snowflake.  It seems like these are all
different tables with 2 tests each?
On Thu, May 21, 2020 at 7:41 PM dasjyao<EMAIL_ADDRESS>wrote:

I have run 30 tests to pull data from a table with ~70 columns. From the
result below, fetch_pandas_all() performs about 2-3 times better than
fetchall() in general. However, The new function seems to have very high
requirements for the environment. I always got Segmentation fault: 11
when i ran this function from local. I'm not sure if it's just me.
@fdosani https://github.com/fdosani would you mind trying to see if you
can reproduce the same error? If that's an issue, I would recommend to have
an option to switch back to fetchall() in the case when the new function
fails.
  row_size  fetch_all  fetch_pandas

0      1987003  36.692733      9.676616
1       393963   5.751460      2.204298
2      1122777  12.095722      4.905406
3      1299286  14.072498      6.290301
4       897154  10.240554      4.604224
5      1029770  12.795818      7.083390
6      1417679  15.777973      7.162826
7      2829893  30.453512     13.125842
8      1481083  16.416293      7.430757
9      1169218  12.856212      5.335738
10     3043863  32.236692     13.772858
11     1920762  21.132539      9.060583
12     3525649  37.232501     17.885588
13     3800646  40.159850     17.240576
14     3199208  34.441831     24.363943
15     1379850  15.075403      8.692440
16     4786611  49.407794     25.387532
17      606383   7.374214      2.919430
18     2963895  30.957134     13.902957
19     2643807  27.739896     12.139245
20     1800207  19.034973      8.413508
21     4613072  47.879083     22.032341
22     2791168  29.589400     11.921853
23     3509180  36.891674     16.042753
24     1849277  19.943107      8.790991
25     1768059  18.980515      8.491843
26     1101614  12.014528      5.204859
27      300523   3.821525      3.384054
28      700474   7.825704      3.129873
29     2628029  28.370677     12.026310
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/capitalone/Data-Load-and-Copy-using-Python/issues/77#issuecomment-632382611,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACPJA5XZQA5FN63NCUGTXSLRSWU3NANCNFSM4KSUB2LQ
.

These are tests from sampling different row sizes from the same table. The reason I chose to do that is to test the impact from different table sizes. In addition, in order not to confound with caching within snowflake, I put the time() only around fetch_all() and fetch_pandas_all(). So the time here shows only the time that each function takes, not including the execution part.

Makes sense. Thanks for clarifying! Ok looks like it might make sense to
switch then!
On Fri, May 22, 2020 at 11:32 AM dasjyao<EMAIL_ADDRESS>wrote:

These are tests from sampling different row sizes from the same table. The
reason I chose to do that is to test the impact from different table sizes.
In addition, in order not to confound with caching within snowflake, I put
the time() only around fetch_all() and fetch_pandas_all(). So the time
here shows only the time that each function takes, not including the
execution part.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/capitalone/Data-Load-and-Copy-using-Python/issues/77#issuecomment-632723087,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ACPJA5VULIVFNTV7HX4XXKTRS2EGPANCNFSM4KSUB2LQ
.


Add information about Graph/Cassandra multi-master

In an article mentioned that it will work for all 3 OSS APIs, but describe only MongoDB API.
Could you please specify the rest 2 as well?

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f172be9c-a27b-4d98-fab8-287b33b988c7
Version Independent ID: b776f03c-b65a-6580-6178-cfc3fd55c059
Content: Using Azure Cosmos DB multi-master with open source NoSQL databases
Content Source: articles/cosmos-db/multi-master-oss-nosql.md
Service: cosmos-db
GitHub Login: @markjbrown
Microsoft Alias: mjbrown

@SychevIgor Thank you very much for the detailed feedback. I have assigned this to the content owner to evaluate and update as appropriate.

@SychevIgor As you said multi-master works for all API's, however how it appears in MongoDB is little different when compared to other API's. It isn't different for other API's. From the MongoDB driver perspective, the preferred region appears to the client as the replica set primary.
We are in the process of making some changes to the multi-master docs in the next couple of weeks which will remove this confusion.

#please-close


Adaptive Degradation

Hi, this is a brilliant idea and a wonderful project.
One potential improvement would be to increase the degradation over usage time - penalizing addictive behavior but not impeding sane usage.
For example, the delay and throtteling could be adjusted by a linear or exponential factor, based on something as simple as a counter (#visits, sum of time spent) or a windowed counter (time spent in last X hours) or based on a budget (daily budget left).
Not that it's necessary to implement those, it just seems interesting to try and see what the most "constructive" limitation would look like.

Oh this is genius!


Publish to bower/npm

It seems this is not published to npm/bower.

+1

:+1:

yes please

+1

+1

Sorry, I will publish it to npm today :-)

https://www.npmjs.com/package/hammer-simulator


ModuleNotFoundError: No module named 'lime.lime_tabular'; 'lime' is not a package

Please help me in this reagar
Thanks..

Have you installed lime in your python 3 workspace with:
pip install lime ?

yes

Still, it is showing the same error ModuleNotFoundError: No module named 'lime.lime_tabular'; 'lime' is not a package


Update docker-compose.yml for newer Docker image env vars

After Dockerfile changes were accepted into the PictShare-Docker repo, here are the updated environment variables for docker-compose.yml to more-closely match the config.inc.php.
One thing to note is that this should probably not be merged in until the official DockerHub image is updated.
Thanks! Again, let me know if anything looks wrong.

perfect, thanks. new build is live on dockerhub


More site improvements

[x] Change dropdown menu in Nav out into the nav menu to remove issues with black graphics that can't be inverted.
[x] Logo to Merriweather font
[x] Fix header: make one line, center icon vertically, remove some unneeded top/bottom padding
[x] Increase menu font-size to 1.2em
[x] Change checkmark "graphics" to just the number 1
[ ] Try to keep Aside pinned to right at wider screens sizes
[x] Reduce spacing between icons and text (e.g. "Send Feedback")
[x] Increase the Get Involved font-size to 2em

This ticket is mostly done.
The Try to keep Aside pinned to right at wider screens sizes item is too tricky with USWDS' grid system. I'm sure there's a way, but what we have works until the screen gets really wide, so I'm going to hold off on burning too much time struggling with it.


Math magicians: full website

In this pull request, I have implemented:

Created a website consisting of 3 pages: Home, Calculator, and Quote
Add my own styles to improve the look and feel
For every page, I have created a route
Used React Router to make the routes work
And this is what the project looks like:

@AmaduKamara, @fobadara, and @mwanawabangona Thanks for your kind review and feedback.


custom titles instead of random id

Hello and thank you for this plugin!
I am new here, I wanted to ask if it is possible to create a new note with a custom title instead of a random ID. I think there is this possibility in neuron.vim.
I can create in the cli using neuron new -e test. But if I try to insert it in nvim with gzZ and then press enter it says there is no link under the cursor.
Thank you in advance.

I think it's because the function that searches for notes find_zettels and it looks for id's instead of names


Logging of config building

The contents of the experiment.log file start after the config is built. It would be nice if the file contained also the output from config building. The thing is we need to parse the config first in order to know where to store the file.
I suggest to save all text output to a variable and dump it to the log file as soon as the logging file is initialized.

What information are printed during the config building and what are they useful for? From my point of view, the logs during the config building serve mostly debugging the configuration. Once you have it running, all you need to know is in the debugged config file. Adding it would make the log even more cluttered than it is now. So, my question is: what would it be useful for?
Nevertheless, what you suggest is a good idea if we need it.

This morning, I was comparing the monster_decoder with decoder and I wanted to see if a training process that runs now outputted something during the config building or not. Then I realized I cannot see what it logged because that was before the logging was initialized.
And since it was not the first time I had this problem, it was enough for me to create the issue here.. :-)
Anyway, it is a very low priority issue. The real issue is the comparison between the two decoders - there seems to be no difference in semantics of the code, but in reality, the monster_decoder performs much better on translation tasks and I don't see why.

But you can always have a look into the configuration file to see which decoder you have used, can't you?
If the monster does something else (or even better) than the standard decoder, it is the real issue that should have a priority.

That's what I wanted to say.. I've been looking into this but I can't spot any difference.


SNAP-1318 : Default disk store size on lead should be reduced from 1GB to say 1MB so that lead does not gobble up disk.

Changes proposed in this pull request
Fixes:

Default disk store size on lead is reduced to 1MB.
skip pre-blow  if type is accessor.

Patch testing
Tested Manually

Created another PR https://github.com/SnappyDataInc/snappy-store/pull/145 for same changes, as my local branch got some problems.


Bumped version of postgrest-js to 0.24.0

Bumped version of postgrest-js to 0.24.0
What kind of change does this PR introduce?
Update package dependencies.

Oops, I missed this and made another PR instead. Thanks!

Oops, I missed this and made another PR instead. Thanks!

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.3.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Allow unaligned IP Packets

Is your feature request related to a problem? Please describe.
Netx requires that the packet ip header is 4-byte aligned. This is problematic on systems that require 4-byte aligned DMA access, as I believe it makes a 'zero-copy' implementation impossible.
Describe the solution you'd like
An ifdef a long the lines of 'NETX_ALLOW_UNALIGNED_PACKETS'
Describe alternatives you've considered
Copying the packet :)

Thank you for submitting this feature request, @mlsvrts. I will discuss it with the team.

@mlsvrts just wanted to understand your use case:  Is the alignment requirement a problem for packets being received, or packets being transmitted, or both?  Is it on Ethernet, wifi, cellular?  Is the DMA engine capable of writing incoming data with an offset (so the IP be 4-byte alignment)?

So this is an issue for receiving packets; the DMA controller is only capable of writing to a word-aligned address, and there's no support for padding the Ethernet frame or anything like that.
(MAC FIFO -> DMA -> Word Aligned Address)
Because of this the IP header will always be unaligned (Ethernet header is 14 bytes), and I am forced to copy-and-shift the packet before passing it to NetX.

@mlsvrts curious: What is the MCU or Ethernet MAC controller for this application?
If the driver is unable to do an offset when DMA data into the memory, we do recommend a data copy in the driver (as mentioned in the NetX Duo user guide.).

@mlsvrts Do you have feedback for @yuxinzhou5?

@yuxinzhou5 This is for a smart fusion 2, but I don't think it's uncommon for the DMA unit in embedded controllers to have this aligned access restriction.
I of course understand that copying the packet to a new address is perfectly functional, but I am not convinced that the performance gained by having an aligned IP header will outweigh the cost of the copy in all cases.
In particular, I think something like receive - modify - retransmit could require two complete packet copy operations to perform a very small amount of work, to the point where applications with limited resources might need to circumvent netx entirely for some packets.

@mlsvrts Did you try running the stack as-is and letting the CPU handle this unaligned access?
Is Smart Fusion 2 based on Cortex M3?  ARM reference manual indicates unaligned access is supported: https://developer.arm.com/documentation/ddi0337/e/Bus-Interface/Access-alignment
Since the Ethernet header is 14-bytes, the processor takes 2 cycles to load a 4-byte value in your case, which is not bad.
Given what we know, can you run the demo as-is, and see how the CPU handles the incoming packet in this case? I took a quick look at the _nx_ip_packet_receive() and didn't see any validations on alignment, but I won't be surprised if it is enforced in some other places.
On the transmit side, the packet allocation logic always put IP header at 4-byte alignment.  Can your driver handle 2-byte starting address of the Ethernet frame?

I have tested not fixing the packet alignment, if that's what you mean?
I can confirm that NetX will not process the packet correctly if the ipv4 header is not 4-byte aligned -- at a minimum ipv4 header checksum validation will fail. I haven't looked for other issues.

Thanks for the quick answer.  Are you able to do a quick test if you can  run your project without fixing the packet alignment.   Please set a breakpoint in nx_ipv4_packet_receive.c line 131 (https://github.com/eclipse-threadx/netxduo/blob/6c8e9d1c95d71bd4b313e1cc37d8f8841543b248/common/src/nx_ipv4_packet_receive.c#L131), do a single step and read the value of "val".  If the CPU can read the correct value from an unaligned address, "val" should contain the first 4 bytes of the IP header (in network byte order).   Let's verify the CPU's behavior.


Fix windows support in www/install.sh

The current version of install.sh does not quite fully support
installing windows binaries.
This change fixes that by:

handling the fact that windows artifacts are zips not tarballs
handling uname -s output being funky on MINGW compiled bash

Additionally, it adds a CI test job to test that install.sh works on
multiple platforms.

Merged upstream

Merged upstream


fix(cicero) Add missing conditional variable in unquoting logic

Signed-off-by: Jerome Simeon<EMAIL_ADDRESS>

Coverage increased (+0.005%) to 89.121% when pulling 8071aee5f9e361f5b37e137ae02ea4e0b4a322e7 on jeromesimeon:js-fix-unquote into b90553a04c2152e61f7726b4652a8dc960ba6395 on accordproject:master.


Grammatical fixes

Fixed a variety of grammatical inconsistencies

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] None of my changes are plagiarized from another source without proper attribution.
[x] My article does not contain shortened URLs or affiliate links.

If your pull request closes a GitHub issue, replace the XXXXX below with the issue number.
Closes #XXXXX

Keep up the great work!

LGTM

Thank you for your contribution to the page! 👍
We're happy to accept these changes, and look forward to future contributions. 🎉


[ChangeLog] Add entries for SE-0333, -0334, and -0349

Add ChangeLog entries for SE-0333, -0334, and -0349

@swift-ci please smoke test

@swift-ci please smoke test and merge


how to embed in website?

i'd like too embed an html-rendered recording (not gif) in a website, set to loop and auto-play.
any guide on how to do this would be greatly appreciated!

nevermind, i just found https://github.com/faressoft/terminalizer-player
thank you for these amazing tools!!


Reflect cmd/ps syntax diffs when importing cert

Similar to how the instructions for starting the docker container were separated for cmd and powershell, I updated the instructions for importing the SSL certificate to match accordingly.

@David-Noble-at-work is the new owner for this topic. David, can you review this change?

@mimig1 This change looks good to me.

@mikelor Thanks for helping to make our documentation better.


Chin Sol "More Bow Damage at Close Range" Not Applying

This doesn't seem to be applying Chin Sol's unique modifier to damage with bow skills.
I should add that this is with Projectile Travel distance set to 1. Changing the travel distance under Configuration has no effect on damage calculation.

You have to click on the "Configuration" tab at the top left and check the box "Is enemy at close range" as shown here:
http://i.imgur.com/PmV1wCo.png

Interesting. I have no such options there; my configuration tab is missing a lot of those options under Effective DPS.

I have been updating using the Check for Update button in the bottom left. Should I try a fresh install?

Did you actually have Chil Sol equipped when you took that screenshot? Options in the Configuration tab only appear if they can have any effect, otherwise the tab would be far too cluttered to be usable.

That's it! I didn't realize it worked that way. Thanks for helping me better understand how it works :D

All good. I could make the Close Range condition activate if the travel distance is <20, but I'm not sure that the 20 unit limit is actually measured by travel distance, as opposed to distance from the player.


Create insight data for MTTR

What this PR does / why we need it:
Create insight data for MTTR
Which issue(s) this PR fixes:
ref #1142
Does this PR introduce a user-facing change?:

NONE

/golinter fmt

/lgtm

Talking with team members and we noticed that there are many other patterns to calcurate MTTR. So, close for now.


PickPhotoAsync - the first time it doesn't work

The first time I use the application after confirming the permission to access the photos saved on the gallery, pickphoto async seems to do nothing.
in my opinion the problem is that it does not wait for user authorization.
in order to work correctly I have to click on the upload button of the photo more than once.
i am working with android with the latest version of the library.
await CrossMedia.Current.Initialize();
if (!CrossMedia.Current.IsPickPhotoSupported)
{
	await DisplayAlert("Oops", "You Cannot pick an image", AppResources.Label_OK);
	return;
}
var file = await CrossMedia.Current.PickPhotoAsync(new PickMediaOptions
{
	PhotoSize = PhotoSize.MaxWidthHeight,
	MaxWidthHeight = 800,
	SaveMetaData = false
});

Unable to reproduce, working here on latest


The program is stuck at "parse_state, sgame_id = self.lib_proccessor.RecvAIFrameState(self.game_launcher.addrs[id])"

I tested the gamecore with the demo script in WSL but it seemed the program stucked at this position.
I am looking for help.Thank you!

I also met the similar problem but the error reported were different from @peterwu4084 . I succeed to start gamecore in windows, but when I tried the domo script in wsl2, ran python test_env.py, I met the following problem.
<IP_ADDRESS>:23432 <IP_ADDRESS>
load config.dat:  /home/love7/workspace/hok_env-master/hok_env/hok/env1v1.py
load config...
146[skill=80121]        <IP_ADDRESS>       35300   1000
 [('146', '80121'), '<IP_ADDRESS>', '35300', '1000'] ./hok/sgame_simulator.conf
146[skill=80121]        <IP_ADDRESS>       35301   1000
 [('146', '80121'), '<IP_ADDRESS>', '35301', '1000'] ./hok/sgame_simulator.conf
======= test_send_action
try to get first state... [False, False]
Pb2Struct::InitChangeType usedefault=offline
Pb2Struct::InitChangeType change_type=offline
Pb2Struct::InitMainHeroType, no main_hero_type, use default mvp
Traceback (most recent call last):
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 175, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/util/connection.py", line 95, in create_connection
    raise err
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/util/connection.py", line 85, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connectionpool.py", line 710, in urlopen
    chunked=chunked,
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connectionpool.py", line 398, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 239, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1281, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1327, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1276, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1036, in _send_output
    self.send(msg)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 976, in send
    self.connect()
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 187, in _new_conn
    self, "Failed to establish a new connection: %s" % e
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f27df500650>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/adapters.py", line 499, in send
    timeout=timeout,
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connectionpool.py", line 788, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='<IP_ADDRESS>', port=23432): Max retries exceeded with url: /v2/stopGame (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f27df500650>: Failed to establish a new connection: [Errno 111] Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "test_env.py", line 124, in <module>
    config_dicts=[{"hero": "diaochan", "skill": "frenzy"} for _ in range(2)],
  File "test_env.py", line 48, in test_send_action
    use_common_ai=common_ai, eval=eval, config_dicts=config_dicts, render=None
  File "/home/love7/workspace/hok_env-master/hok_env/hok/env1v1.py", line 716, in reset
    self.game_launcher.start(config_dicts, common_config)
  File "/home/love7/workspace/hok_env-master/hok_env/hok/gamecore_utils.py", line 438, in start
    self.remote_gc_proc.remote_stop()
  File "/home/love7/workspace/hok_env-master/hok_env/hok/gamecore_utils.py", line 301, in remote_stop
    self.launch_server, "stopGame", self.user_token, data, ignore_resp=True
  File "/home/love7/workspace/hok_env-master/hok_env/hok/gamecore_utils.py", line 272, in send_http_request
    resp = requests.post(url=url, json=data, headers=headers, verify=False)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/api.py", line 115, in post
    return request("post", url, data=data, json=json, **kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='<IP_ADDRESS>', port=23432): Max retries exceeded with url: /v2/stopGame (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f27df500650>: Failed to establish a new connection: [Errno 111] Connection refused'))
check game stopped.
[Warning] Check game status error, stop it directly. HTTPConnectionPool(host='<IP_ADDRESS>', port=23432): Max retries exceeded with url: /v2/stopGame (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f27e2e77c10>: Failed to establish a new connection: [Errno 111] Connection refused'))

I am looking for help! Thanks a lot!

I also met the similar problem but the error reported were different from @peterwu4084 . I succeed to start gamecore in windows, but when I tried the domo script in wsl2, ran python test_env.py, I met the following problem.
<IP_ADDRESS>:23432 <IP_ADDRESS>
load config.dat:  /home/love7/workspace/hok_env-master/hok_env/hok/env1v1.py
load config...
146[skill=80121]        <IP_ADDRESS>       35300   1000
 [('146', '80121'), '<IP_ADDRESS>', '35300', '1000'] ./hok/sgame_simulator.conf
146[skill=80121]        <IP_ADDRESS>       35301   1000
 [('146', '80121'), '<IP_ADDRESS>', '35301', '1000'] ./hok/sgame_simulator.conf
======= test_send_action
try to get first state... [False, False]
Pb2Struct::InitChangeType usedefault=offline
Pb2Struct::InitChangeType change_type=offline
Pb2Struct::InitMainHeroType, no main_hero_type, use default mvp
Traceback (most recent call last):
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 175, in _new_conn
    (self._dns_host, self.port), self.timeout, **extra_kw
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/util/connection.py", line 95, in create_connection
    raise err
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/util/connection.py", line 85, in create_connection
    sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connectionpool.py", line 710, in urlopen
    chunked=chunked,
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connectionpool.py", line 398, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 239, in request
    super(HTTPConnection, self).request(method, url, body=body, headers=headers)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1281, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1327, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1276, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 1036, in _send_output
    self.send(msg)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/http/client.py", line 976, in send
    self.connect()
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 205, in connect
    conn = self._new_conn()
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connection.py", line 187, in _new_conn
    self, "Failed to establish a new connection: %s" % e
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f27df500650>: Failed to establish a new connection: [Errno 111] Connection refused

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/adapters.py", line 499, in send
    timeout=timeout,
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/connectionpool.py", line 788, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/urllib3/util/retry.py", line 592, in increment
    raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='<IP_ADDRESS>', port=23432): Max retries exceeded with url: /v2/stopGame (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f27df500650>: Failed to establish a new connection: [Errno 111] Connection refused'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "test_env.py", line 124, in <module>
    config_dicts=[{"hero": "diaochan", "skill": "frenzy"} for _ in range(2)],
  File "test_env.py", line 48, in test_send_action
    use_common_ai=common_ai, eval=eval, config_dicts=config_dicts, render=None
  File "/home/love7/workspace/hok_env-master/hok_env/hok/env1v1.py", line 716, in reset
    self.game_launcher.start(config_dicts, common_config)
  File "/home/love7/workspace/hok_env-master/hok_env/hok/gamecore_utils.py", line 438, in start
    self.remote_gc_proc.remote_stop()
  File "/home/love7/workspace/hok_env-master/hok_env/hok/gamecore_utils.py", line 301, in remote_stop
    self.launch_server, "stopGame", self.user_token, data, ignore_resp=True
  File "/home/love7/workspace/hok_env-master/hok_env/hok/gamecore_utils.py", line 272, in send_http_request
    resp = requests.post(url=url, json=data, headers=headers, verify=False)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/api.py", line 115, in post
    return request("post", url, data=data, json=json, **kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/api.py", line 59, in request
    return session.request(method=method, url=url, **kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/sessions.py", line 587, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/sessions.py", line 701, in send
    r = adapter.send(request, **kwargs)
  File "/home/love7/anaconda3/envs/hok/lib/python3.7/site-packages/requests/adapters.py", line 565, in send
    raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='<IP_ADDRESS>', port=23432): Max retries exceeded with url: /v2/stopGame (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f27df500650>: Failed to establish a new connection: [Errno 111] Connection refused'))
check game stopped.
[Warning] Check game status error, stop it directly. HTTPConnectionPool(host='<IP_ADDRESS>', port=23432): Max retries exceeded with url: /v2/stopGame (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f27e2e77c10>: Failed to establish a new connection: [Errno 111] Connection refused'))

I am looking for help! Thanks a lot!

You need to change the SERVER_ADDR in test_env.py. See details in https://github.com/tencent-ailab/hok_env/issues/11

@peterwu4084 Can you run the gamecore (common ai only) manually on the windows side?
Run withcmd.exe
 cd gamecore\bin
 set PATH=%PATH%;..\lib\
 .\sgame_simulator_remote_zmq.exe .\sgame_simulator.common.conf

where sgame_simulator.common.conf is
{
    "abs_file": "../scene/1V1.abs",
    "core_assets": "../core_assets",
    "game_id": "kaiwu-base-35401-35400-6842-1669963820108111766-217",
    "hero_conf": [
        {
            "hero_id": 199
        },
        {
            "hero_id": 199
        }
    ]
}

@peterwu4084 Can you run the gamecore (common ai only) manually on the windows side?
Run withcmd.exe
 cd gamecore\bin
 set PATH=%PATH%;..\lib\
 .\sgame_simulator_remote_zmq.exe .\sgame_simulator.common.conf

where sgame_simulator.common.conf is
{
    "abs_file": "../scene/1V1.abs",
    "core_assets": "../core_assets",
    "game_id": "kaiwu-base-35401-35400-6842-1669963820108111766-217",
    "hero_conf": [
        {
            "hero_id": 199
        },
        {
            "hero_id": 199
        }
    ]
}

It's ok.

@peterwu4084 I can not reproduce the problem on my windows.Please provide more detail about how you run the test.

I ran  .\gamecore-server.exe server on the windows side and the following infomation was printed.

cat /etc/resolve.conf printed nameserver <IP_ADDRESS>. So I changed the code in test_env.py as following.

Then I ran python test_env.py and the program got stucked. But the gameserver printed some new message as following.

I run netstat -nlp and got this message.

Ran telnet <IP_ADDRESS> 23333 and got this message.

 I tested the gamecore with the demo script in WSL but it seemed the program stucked at this position. I am looking for help.Thank you!

do you sovle it ? I meet this problem today.

cat /etc/resolve.conf printed nameserver <IP_ADDRESS>. So I changed the code in test_env.py as following.@peterwu4084

The problem has been solved, thank you！

cat /etc/resolve.conf printed nameserver <IP_ADDRESS>. So I changed the code in test_env.py as following.

Set AI_SERVER_ADDR to <IP_ADDRESS> if you run the hok_env on the wsl and gamecore on the same windows.
@peterwu4084 @Song-Weifeng

Ran telnet <IP_ADDRESS> 23333 and got this message.

Not telnet to the gamecore server, please telnet to the <IP_ADDRESS> 35300 when test_env.py is running. @peterwu4084

Thank you very much. It works now.


reputation: default to command author if no arguments are provided to the replog command

This PR allows using the replog command without having to provide the user argument by making it optional, in which case, it defaults to the user using the command.

Marking as draft because replog 10, for example, will not show page 10 of the user invoking the command.

Now that #1218 has been merged (which implements this change a different way), this can be closed.


Publish v0.4.0 to crates

Raise a version change PR and then publish to crates.io

I'd also say add the change log file along with the publishing.


WEB-4052 Copy link to section in documentation doesn't work

Build succeeded (check pipeline).

https://checklist.intgdc.com/job/compliance/job/gooddata-docs-theme-oss-check/77/ : SUCCESS in 3s

Build succeeded (gate pipeline).

https://checklist.intgdc.com/job/compliance/job/gooddata-docs-theme-fossa-scanning-oss-zuul/48/ : SUCCESS in 50s (non-voting)
https://checklist.intgdc.com/job/compliance/job/gooddata-docs-theme-merge-compliance-check/33/ : SUCCESS in 12s


feat(dependencies): upgrade epsagon version

upgrade epsagon version

:tada: This PR is included in version 1.11.0 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


chore(core): parse legacy rate limit if new rate limit not exist

Description

Fixes WB-18710

What does the PR do? Include a concise description of the PR contents.

when the backend sends back only the old rate limit headers X-RateLimit-Remaining, it uses that without erroring out
The old rate limit doesn't send back X-RateLimit-Reset so it defaults to 0
if the backend sends back the new rate limit headers RateLimit-Remaining & RateLimit-Reset, SDK uses that values over legacy values

Testing

added unit test

We don't use X-RateLimit- headers in any SDK version (only checking 429 in python version), so this PR isn't actually necessary to accommodate other versions.


error when build a debug apk

Hi,
I got an error when build a debug apk for android, How can fix the issue
command:
./gradlew assembleDebug
Log:
FAILURE: Build failed with an exception.

What went wrong:
Could not determine the dependencies of task ':@react-native-community_async-storage:extractDebugAnnotations'.

Could not resolve all task dependencies for configuration ':@react-native-community_async-storage:lintClassPath'.
Could not resolve org.bouncycastle:bcpkix-jdk15on:1.56.
Required by:
project :@react-native-community_async-storage > com.android.tools.lint:lint-gradle:26.4.1 > com.android.tools:sdk-common:26.4.1
project :@react-native-community_async-storage > com.android.tools.lint:lint-gradle:26.4.1 > com.android.tools.build:builder:3.4.1
project :@react-native-community_async-storage > com.android.tools.lint:lint-gradle:26.4.1 > com.android.tools.build:builder:3.4.1 > com.android.tools.build:apkzlib:3.4.1
Could not resolve org.bouncycastle:bcpkix-jdk15on:1.56.
Could not get resource 'https://jitpack.io/org/bouncycastle/bcpkix-jdk15on/1.56/bcpkix-jdk15on-1.56.pom'.
Could not GET 'https://jitpack.io/org/bouncycastle/bcpkix-jdk15on/1.56/bcpkix-jdk15on-1.56.pom'. Received status code 522 from server: Origin Connection Time-out
Could not resolve org.bouncycastle:bcprov-jdk15on:1.56.
Required by:
project :@react-native-community_async-storage > com.android.tools.lint:lint-gradle:26.4.1 > com.android.tools:sdk-common:26.4.1
project :@react-native-community_async-storage > com.android.tools.lint:lint-gradle:26.4.1 > com.android.tools.build:builder:3.4.1
project :@react-native-community_async-storage > com.android.tools.lint:lint-gradle:26.4.1 > com.android.tools.build:builder:3.4.1 > com.android.tools.build:apkzlib:3.4.1
Could not resolve org.bouncycastle:bcprov-jdk15on:1.56.
Could not get resource 'https://jitpack.io/org/bouncycastle/bcprov-jdk15on/1.56/bcprov-jdk15on-1.56.jar'.
Could not HEAD 'https://jitpack.io/org/bouncycastle/bcprov-jdk15on/1.56/bcprov-jdk15on-1.56.jar'. Received status code 522 from server: Origin Connection Time-out

Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

Get more help at https://help.gradle.org

BUILD FAILED in 38s

Environment
"@react-native-community/async-storage": "^1.6.2",
"react": "16.8.6",
"react-native": "0.60.5",
"Platform tested: Android

Fixed it


fix(core): add proper error if manager constructor fails

Example how to produce error atm: if manager's constructor requires a manager that is not yet initialized the whole app comes crashing down


ISPN-8467 Memory Leak in the Rest server

https://issues.jboss.org/browse/ISPN-8467

CI really does not want to build this, apparently there's a wildfly process left behind in the agent.
When running locally, all tests pass

Finally the build went throught


Resolve when cancelling words-export after file was exported

When the user cancels the export-words action after the Login File was downloaded, this new hook will now resolve the request instead of cancelling it.

Yes, that would also work. I decided to keep with the hooks paradigm for optional overwrites.
Because what we currently have in the TopLevelApi are two methods which are meant to be overwritten by extenders: the parseRequest method, which must be overloaded, and the onBeforeRun, which is an optional overload. Since the interception of the global-close button is also optional, I chose to go with the established pattern of a onBeforeCancel hook.

call it onGlobalClose(handler) then? I think my proposal is a simpler, cleaner solution.
I would argue, that onBeforeRun() could be done in a similar fashion, as it is only ever used once to set the text of the global close button.

It's exactly the same solution, just instead of checking for the return value in TopLevelApi, you have to remember call super.onGlobalClose() in the child.

Gets rid of onBeforeCancel though, which basically is globalClose(). Just like onBeforeRun basically is setGlobalCloseButtonText.

Also in both cases the functions exist to alter the default behaviour. They do not exist to perform some action and then return to the default behaviour.
I think in case of altering the behaviour of the base class my approach is preferable. In case we would want to augment it a hook is the better choice.

Your argument that it gets rid of onBeforeCancel is void, because in its place you are adding the onGlobalClose method. Thus it's exactly the same thing and the same amount of code change.
Aber der Klügere gibt nach.


Initial support of the metrics-bridge.

It needs a test, will add it later.

It needs a test, will add it later.

Do you plan to add the test in this PR later, or in a later PR? I'm fine with merging as is, I suppose you've tested this code already in your demo.

Yes, I've tested it in the demo (just extracted the code). I can do another PR for the tests. (not used to test things using IT written in groovy ;-)).

Awesome @cescoffier , thanks!


How to install plugins on Helm deployment

Query
Hi,
I’ve been searching the documentation for some information around installing custom plugins on my cluster that is deployed on k8s via Helm. I can’t seem to find anything concrete and am a bit confused. For context, I’m looking to install the Azure repository to enable snapshots.
I’ve been able to attach single pods in my Kubernetes setup and install the plugin manually via
sudo bin/elasticsearch-plugin install repository-azure

But this approach doesn’t make much sense as I’d have to attach to every pod in the Kubernetes cluster and do the same, and I don’t think it would take effect without a restart which I don’t think would persist.
Even with Azure repository plugin installed I would then need to configure it with my Azure storage settings and I’m not sure where I would do this either, my best guess is via elasticsearch.yml.
Any suggestions or advice would be of great help.
Thanks!
Expected Behavior
I'd like to be able to install plugins on my cluster when using helm. Ideally, I would predefine which plugins so they could be installed on each node.

Hi @cdpierse ,
Thanks for opening the issue. At present we don't have the feature to install the plugins without manual intervention. The other way to minimize the impact is to change the ODFE docker image and include the required plugins and perform a blue-green deployment. If you are able to find a fix which makes it easy for the installation, please feel free to open a PR.
Thanks again !!

@sreekarjami Thanks for the response and thanks for clarifying the situation with plugins. It seems like installing a plugin to a already deployed instance on K8s would still trigger restarts for for node, the only clean solution would be to install all plugins for a fresh ES instance on initial startup but  I think changing the base image with required plugins is probably the simplest solution, thanks for the suggestion.


Added the disclaimer about required timeframe of searches

Added a disclaimer about the timeframe for acceptable searches.

closing


Voice Gate: !voiceban command.

For the Voice Gate project, we require a new infraction type called !voiceban.
This should work exactly like !tempban in that it will take a user and a duration using the exact same mechanisms. Do not reinvent any of these mechanisms, just use the existing converters.
Specifications

The effect of the command will be to temporarily remove the speaking role for the specified duration.
The command should have the alias !vban.
This command should not work on a staff member, or on a member that does not have the speaking role.
This feature should have unit tests.

Dependencies

The speaking permission role must exist. This is specified in https://github.com/python-discord/admin-tasks/issues/31

well you kn9ow this is not a problem.

I'd like to work with this same time when with #1190


Ambiguous serialized keys

From the serde proptests a change with a key Map("0@") serializes to "0@" and then gets parsed as Seq(Id(0@)).
I'm not sure if this has a fix on the JS side but it would be nice to keep keys being unrestricted. We could do some disambiguation in the parsing if we track the type of the parent object. Alternatively we could change the key to be elem_id for sequence types?

I would really like to change key to elem_id, unfortunately I think this would be a pretty disruptive breaking change for JS so we'll probably need to do the object type based disambiguation.

In what context is this? A little while ago I did change the definition of operations in a change so that list operations would use elemId while map operations would use key.

Thanks @ept I think it was just a bug in our deserialization.


chore(release): v0.11.3 🎉

:robot: I have created a release beep boop
0.11.3 (2023-09-08)
Bug Fixes

domain: contactMethod.channel -> contactMethod.type (491985f)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/whodisio/whodis-client/releases/tag/v0.11.3 :sunflower:


Fix the sample for Apdex score

Please refer to the link of Apdex score:
https://en.wikipedia.org/wiki/Apdex
There is an example which demonstrate the score method:
if there are 100 samples with a target time of 3 seconds, where 60 are
below 3 seconds, 30 are between 3 and 12 seconds, and the remaining 10
are above 12 seconds, the Apdex score is:
Apdex3=(60+30/2)/100=0.75
So the sample need to fix against the method.
Signed-off-by: shangxdy<EMAIL_ADDRESS>

Sorry for late response. Just randomly stumbled upon this.
The original example is correct. That's because the Prometheus histogram buckets are cumulative. In your example, the calculation works out as follows:

The 3s bucket is 60 and the 12s bucket is 60+30=90.
60+90 = 150
150/2 = 75
75/100 = 0.75


Requests remain enqueued indefinitely on android 4.4.2 (1.0.0-alpha06)

Description:
I am trying to figure out cases where WorkManager is not able to ensure execution of one time work requests which require internet connectivity.
Work Details:
one time work request
 - 10s linearly increasing backoff
 - internet required
 - keep existing if already present

Relevant Code:
https://gist.github.com/aditya-prasad/9aec64d556f02effca6fc018713ad95e
Observations:

Everything working fine on Pixel 2. Flipping network state, restarting phone, etc. is ok, worker eventually runs. Force stopping the app prevents the worker from running till the next app open (expected, I guess). Turning internet off when a worker is running reschedules it, doesn't matter if the original execution succeeds or fails (again, expected, I guess).
On a low end device (Intex, 4.4.4, ~512 mb RAM), work is rescheduled and remains indefinitely queued if the internet is turned off while the worker was running. In the case when two workers are started simultaneously, and the internet is turned off after one of the work finishes while the other one is still in progress, only the interrupted worker faces the indefinite enqueuing problem, the other one runs immediately if enqueued again. Force stopping the app and opening it again solves the issue and runs the workers again. (weird, is it some kind of lock on the interrupted worker)

Android Version: 4.4.2
compileSdkVersion: 27
minSdkVersion: 16
targetSdkVersion: 27
Support Library Version: 27.1.1

// work manager
implementation "android.arch.work:work-runtime:1.0.0-alpha06"
implementation "android.arch.work:work-firebase:1.0.0-alpha06"

What to expect? What am I missing here?

I am facing the same problem. My workRequests would queue indefinitely after calling workManager.cancelAllWorkByTag()

Thanks for reporting this.
I'm closing this issue because this forum is for issues with the codelab.
If you think that this is a problem of the WorkManager library, please open a bug on the WorkManager public issue tracker: https://issuetracker.google.com/issues/new?component=409906&template=1094197
Please reopen if you still think this is an issue with the codelab.


URGENT BUG: When user changes order in SCRIPT - it only works some of the time

https://user-images.githubusercontent.com/104105362/193839264-a6fe7e13-4249-41ce-95d4-a2af4c95005d.mov

@mrjamieeast I am not able to recreate the issue can you help me with this

I don't know what to do to help you - maybe have a few people working on it at the same time?
It is just quite buggy - however the other bug is the most important... Work goes missing, etc


Make St Paul Default

[x] Issue-#142 Solved

I had made the st Paul default selection(you need to clear your cache to view the functionality) and also when ever the visitor view any page then the selection is saved in localStorage

Also I added comments, you can check it out and send you a video

Thank you @enoren5 brother ❤

Resolves #142 . Thanks, Umar!


Missing property "ml2" in Stroke styles

key: "ml2"
type: Animatable float
in: Stroke (Stroke, GradientStroke)
I am unsure how this is used exactly

Added


limits for using chrome's speech recognition object

is it possible to use chrome's speech recognition object as much as i want? there is no limits?

I cannot comment on whether Google will choose to limit you or not... But I personally haven't seen that happen.


Improve forecasted weather dataset

[x] Add date and time column: x <- noaa_fc %>% mutate(date = startDate + lubridate::hours(time))
[x] Harmonize weather variables with those in Daymet data
[x] TBD: how to deal with multiple ensembles?

either generate ensemble of forecasts and summarize -OR-
use median values

PR 42, which supersedes PR 39.


Do we support WEBSITE_RUN_FROM_PACKAGE with an url to the zip file

I have deployed my function using func azure functionapp publish <APP_NAME> and using terraform. The one with func works fine, but the one with terraform give me a Azure Functions Runtime is unreachable. error when i try to list the App files. Requesting an http trigger function fails with 502.
One mayor difference is that func deployed function uses WEBSITE_RUN_FROM_PACKAGE = 1, while the terraform deployed uses WEBSITE_RUN_FROM_PACKAGE = url-to-zip-file-in-storage. I was wonder if this is supported at this time.
Thanks,
Jose.

Yes, that should work. Would you mind sharing the application name so we can take a look at the logs?

@fabiocav thanks for replying. I have deployed the same code in parallel deployments.
https://jo2-us-dbbackups-function.azurewebsites.net/api/ping works fine, and was deployed with func azure functionapp publish jo2-us-dbbackups-function.
https://jos-us-dbbackups-function.azurewebsites.net/api/ping fails with server error, and was deployed with terraform using WEBSITE_RUN_FROM_PACKAGE .
There might be many other differences, but is hard for me to compare them.
Regards,
Jose.

Apparently there is no support in terraform for specifying netframeworkversion and so it defaults to v4.0.
it's in template.json
"netFrameworkVersion": "v4.0",
under properties mapping
doesn’t seem to be anything to do with either azure function 5.0 preview or azure.


Added author to the header

I added a new author to the list but I forgot to add it to the header. This pull request complements <Recording deployment positions #428>
For more information:
https://github.com/cf-convention/cf-conventions/issues/428
Release checklist

[ X] Authors updated in cf-conventions.adoc?

For maintainers
After the merge remember to delete the source branch.
Tags are set at the conclusion of the annual meeting; until then master always is a draft for the next version.

@JonathanGregory That's the pull request to add the author in the header (in addition to the list)

Thanks


raise a proper TTLibError while opening a "com.adobe.postscript-lwfn-font" type1 font

fonttools/Lib/fontTools/misc/sstruct.py", line 87, in unpack
elements = struct.unpack(formatstring, data)
error: unpack requires a string argument of length 12

raising the correct error is import for packages like Extractor
see https://github.com/typesupply/extractor/blob/master/Lib/extractor/formats/opentype.py#L12-L18
for your reference: http://sourceforge.net/p/fonttools/code/ci/master/tree/Lib/fontTools/ttLib/sfnt.py#l28
thanks!

this could be solved by comparing the size of the 'data' retrieved from the file and size of the header (for each supported format) and raise a TTLibError if needed
a quick fix:
		if self.sfntVersion == b"ttcf":
			sstruct.unpack(ttcHeaderFormat, self.file.read(ttcHeaderSize), self)
			assert self.Version == 0x00010000 or self.Version == 0x00020000, "unrecognized TTC version 0x%08x" % self.Version
			if not 0 <= fontNumber < self.numFonts:
				from fontTools import ttLib
				raise ttLib.TTLibError("specify a font number between 0 and %d (inclusive)" % (self.numFonts - 1))
			offsetTable = struct.unpack(">%dL" % self.numFonts, self.file.read(self.numFonts * 4))
			if self.Version == 0x00020000:
				pass # ignoring version 2.0 signatures
			self.file.seek(offsetTable[fontNumber])
			data = self.file.read(sfntDirectorySize)
			if len(data) != sfntDirectorySize:
				from fontTools import ttLib
				raise ttLib.TTLibError("Not a ttcf font (not enough data)")
			sstruct.unpack(sfntDirectoryFormat, data, self)
		elif self.sfntVersion == b"wOFF":
			self.flavor = "woff"
			self.DirectoryEntry = WOFFDirectoryEntry
			data = self.file.read(woffDirectorySize)
			if len(data) != woffDirectorySize:
				from fontTools import ttLib
				raise ttLib.TTLibError("Not a wOFF font (not enough data)")
			sstruct.unpack(woffDirectoryFormat, data, self)
		else:
			data = self.file.read(sfntDirectorySize)
			if len(data) != sfntDirectorySize:
				from fontTools import ttLib
				raise ttLib.TTLibError("Not a TrueType or OpenType font (not enough data)")
			sstruct.unpack(sfntDirectoryFormat, data, self)
		self.sfntVersion = Tag(self.sfntVersion)

thanks

I can see how useful it is in this context and willing to do that, but we don't guarantee that for rest of the codebase...
@anthrotype WDYT?  Since this probably affects your woff2 branch, can we merge the two?

Ok, I see. You just want to check if there are enough bytes in the file being read before unpacking them with sstruct/struct, and raise TTLibError in case there aren't, to prevent struct from raising its own exception.
Yes, that could be done like you proposed. It'd be easy to amend the woff2 branch accordingly.

Yeah, either that, or we need to add a function to detect file type...

@anthrotype So what do you think about this?

@behdad sorry for late reply. I think we should have a proper function to detect all supported file types. We could extend the current ttx.guessFileType and move that to ttLib.init. The function would be used to pick up the compatible reader class, or to raise a TTLibError if the type is not supported.
However, while we think about that, we can already add a test for "enough data" to sfnt and woff2 modules, like the one proposed by @typemytype. I'll send a PR in a minute.

thanks


how to build static mediainfo without dependent system libraries?

I refer to the following webpage, and build mediainfo. But there are dependent system libraries.
https://github.com/MediaArea/MediaInfo
ldd ./mediainfo
linux-vdso.so.1 =>  (0x00007ffe7e3b6000)
libz.so.1 => /lib64/libz.so.1 (0x00007f91d1cc3000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f91d1aa6000)
libstdc++.so.6 => /lib64/libstdc++.so.6 (0x00007f91d179e000)
libm.so.6 => /lib64/libm.so.6 (0x00007f91d149c000)
libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00007f91d1285000)
libc.so.6 => /lib64/libc.so.6 (0x00007f91d0ec2000)
/lib64/ld-linux-x86-64.so.2 (0x000055c09c0e9000)
Is there any way to build static mediainfo without dependent system libraries?
Thanks!
Regards
andrew

We developed script for static building of all not system.
You are on your own for static building of system libs, it is classic autotools stuff, a patch would be appreciated if you develop this support.
Contact us directly if you want us to develop it.

If your asking if you could build the exe/linuxfile and then run that .exe/linuxfile without the need to other dll and such files, Then yes it's possible. I did it last night using MSYS2 setup.
Here are the Flags I was using:
CFLAGS: -mthreads -mtune=generic -O2 -pipe
LDFLAGS: -pipe -static-libgcc -static-libstdc++
CMAKE: -G Ninja -DBUILD_SHARED_LIBS=off -DCMAKE_INSTALL_PREFIX=/local64 -DUNIX=on -DCMAKE_BUILD_TYPE=Release -DBUILD_ZLIB=off -DBUILD_ZENLIB=off
Maybe this will be a helpful starting point.


BoxyHQSAML provider

What kind of change does this PR introduce?
Adds a provider for https://github.com/boxyhq/jackson which is an open-source SAML SSO service that implements SAML login as an OAuth 2.0 flow.
What is the current behavior?
Login with BoxyHQSAML not available.
What is the new behavior?
This will let supabase developers integrate with SAML service (Jackson) and enable sign in for enterprise users. Multi tenant support is also baked in.
Demo
https://github.com/boxyhq/jackson-examples/tree/main/apps/supabase
NOTE: https://jackson-demo.boxyhq.com is a hosted demo instance of Jackson which can be readily used to test out the flow. A SAML config is preloaded for https://mocksaml.com which is a "Mock SAML IdP".

Hey this PR has been outdated for a long while now. I'll close it, but if you still wish to contribute please re-open it or submit a new one!
Regarding SAML, we're working on first-class support for SAML in GoTrue. Check out the saml branch if interested.

@hf Are there any plans for OIDC? If that is coming then we wouldn't need a custom integration. If you need any help with the SAML integration let us know, we did a ton of work on guarding against the most common SAML vulnerabilities.

Hey, yes OIDC is going to be coming but no clear timelines yet. We're stretched a bit too thin at this point, and want to nail down the SAML developer experience before moving to OIDC.
The current working theory is that OIDC is less complex than SAML to add to our codebase, so that's why we're working on SAML first.


remove ari return value from AutoGMM.fit_predict

Doesn't match with API well, should just get rid of this

@asaadeldin11 necessary for #306

I'll knock this out


Refetching bidirectional infinite query skipping first page

Describe the bug
I file this issue after some discussions on the tanstack discord about this problem.
I will try my best to explain it but the easiest way to understand is with an example i think:
Here is a simplified example of a bidirectional infinite query using cursor (id is the cursor here):
The 1st page is fetched then fetchPreviousPage() is used to fetch the 2nd page.
2nd fetched page:
{
 items: [
    { "name": "Project 0", "id": 114 },
    { "name": "Project 1", "id": 113 },
    { "name": "Project 2", "id": 82 },
    { "name": "Project 3", "id": 80 },
    { "name": "Project 4", "id": 67 }
  ],
  prevCursor: null,
  nextCursor: 4,
}

1st fetched page:
{
  items: [
    { name: "Project 0", id: 4 },
    { name: "Project 1", id: 8 },
    { name: "Project 2, id: 12 },
    { name: "Project 3", id: 41 },
    { name: "Project 4", id: 42 },
  ],
  prevCursor: 67,
  nextCursor: null,
}

When refetch happens, it will call the endpoint with direction forward and cursor 67. The problem here is that the first page is skipped entirely (because of direction forward).
Atm for refetch to work i should return as prevCursor the first item's id of the previous page so in this case 114. In this case on first refetch the endpoint would be called with direction forward and cursor 114 and will correctly fetch the first page and the others. But the problem with this method is that since the previous cursors are not predictable i would have to fetch the whole previous page just to return the first items id as cursor in each request. So it is not really optimal.
A solution suggested by @TkDodo on discord was on tanstack/query side "to store the original direction next to pages and pageParams, then pass that as direction to the first refetch". So the first refetch will have direction backward correctly fetching the first page and then the others.
Your minimal, reproducible example
https://stackblitz.com/edit/tanstack-query-bs7ooo?file=src%2Fpages%2Findex.js
Steps to reproduce

Go to https://stackblitz.com/edit/tanstack-query-bs7ooo?file=src%2Fpages%2Findex.js
Load older one time
Refetch the ["projects"] query using tanstack/query devtools
We can see that the first page is skipped

Expected behavior
The query is correctly refetch beginning from the first page.
How often does this bug happen?
Every time
Screenshots or Videos
No response
Platform
Any
Tanstack Query adapter
react-query
TanStack Query version
5.28.10 (latest)
TypeScript version
5.4.3 (but issue not related to typescript)
Additional context
No response

here is a version of your reproduction that works:
https://stackblitz.com/edit/tanstack-query-wh1s4s?file=src%2Fpages%2Findex.js
sorry that direction passed to queryFn doesn't really work - I think in hindsight, it wasn't a good idea to add it because everything can be done with pageParam in user-land.

Hello @TkDodo , i tried your reproduction and it works nice and resolve the issue. (and it works even in trpc too :D)
I think you're right its better to let the user handle it instead of adding more logic in the lib.
Thanks you very much for your help and your reproduction example.


How to get sand from the composter?

I try to get the sand/redsand from the composter,but I get the dirt.I am no sure is the sand only get at a time from a wandering trader?

You most likely have to be in a desertish biome to get sand or in a mesa biome to get redsand.

@QPCrummer is correct. It's based on the default surface block of the biome the composter is in. So in sandy biomes like deserts and beaches you'll get sand and in badlands type biomes you'll get red sand.


restart: add missing msync at close time

To make sure that the backing pages actually make it to the backing
device prior to shutdown, munmap must be preceded by an msync call.
Additionally, since the metadata file is used as a flag to check if
the shutdown was graceful, the data needs to be sync'd prior to that
file being written.

Thanks, I'll take a look; this isn't typically needed since you're supposed to run this out of a ramdisk or DAX mount, which has no buffer to flush. Or at least, I was under that impression from the documentation :)
Should still add this since people will invariably run it off of a disk and expect it to work, I guess.

Alright merged for next release. I had to change the unit tests to run out of /tmp so this is good to have to ensure they're reliable. So far as I recall the code paths for shared mem and mmap'ed tmpfs files is exactly the same, but this patch has been open since 2017 and I no longer have a clear memory of what I'd looked up... So either way, this is good.
Thanks again! I usually leave PR's open until the release cut.

A clarification (just for the record, since you're already accepting the change):  you need msync (or fsync) to make things persistent even with DAX.  For traditional file systems, msync will flush the page cache.  For DAX, there is no page cache but dirty data might still be sitting in the CPU caches.  msync detects the DAX case and uses flush instructions like CLWB on x86 to make sure the stores are persistent.

Makes sense, thanks! I completely missed that.

(I don't actually have any DAX hardware so all the restartable work has been in tmpfs, but the access-items-via-mmap was extensively tested on an optane machine... so that at least worked)

The fact that there's no page cache buffer to flush is an implementation detail of the underlying file system. POSIX (or more specifically, Linux kernel) still requires you to call an msync if you expect the data to be actually present in the file at a defined time.
Even if that weren't true, you still need to take care of ordering to ensure that you can distinguish between graceful and ungraceful shutdowns. If I understand correctly, your mechanism uses the metadata file consistency to decide if the cache should be resumed or started from scratch, and since your current code first writes the metadata and then lets the kernel flush the file whenever it wants, you might end up in a situation with a valid meta file and invalid data file.

out in 1.5.19!


Folder text font support

Since original LR2 doesn't have one, maybe this is possible on LVF.
This means that the folder bar text could use a separate font set rather than using the song one's.

This would allow skins to have different fonts for folder and song bars, giving the arcade-like feel.

some background info:
Back in pre-10s, if the skins needs to use a dedicated font for folder, it will be a "folder.png" in a dxa file with pre-made text and elements for various folder titles, these needs to be triggered with special characters as written in the lr2font file. There's even a special tag editor for skins with this feature.
If this could be implemented, there's no need to do these steps as a folderfont.dxa is enough to handle all the folder font stuff, unless you want different types of folder font (e.g. normal folder, custom folder, rivals, etc...), probably multiple folder fonts could be supported as well.


Manually implemented == for _UInt24 and _UInt56

Implemented  Equatable for _UInt24 and _UInt56 and marked as @inlinable
Motivation:
#1274
Modifications:
Manually implemented an Equatable protocol and marked the == as inlinable
Result:
better performance

@swift-nio-bot test this please

@swift-nio-bot test perf please


Dummy forked code review test

Dummy change to test forked CI improvements.
All Submissions:

[X] Have you signed our CLA?

Behaviour is not as expected, will need to rever the changes from #1267


Relocate environment variable injection to before the interpreter is run

As per https://github.com/pantsbuild/pex/issues/2224

@erikwilliamson thanks for working on this. Please add a test to prove this works. You likely can just pile in the original PR test: https://github.com/pantsbuild/pex/pull/1948/files#diff-2b86577053b9bb459d54416c397bf7d1fa598becf7a5cc9e856290fb0427881e
You can then tox -eformat-run,typecheck to run black + mypy and tox -epyXY-integration -- -ktest_inject_env_and_args to run your tests via pytest. Here XY is the Python major minor of a Python you have installed, for example tox -epy311-integration. You can use ./dtox instead of tox with the rest of the command line being the same to run the tests in a docker environment that has all the Pythons Pex supports pre-installed. The 1st time you run, using BASE_MODE=pull ./dtox will likely speed things up by pulling the base docker image instead of building it.

@jsirois I'm sorry that this is taking me so long. I'm having trouble getting any tests to run successfully, even from the main branch. I'm totally new to Tox, too which isn't speeding things up.
I'm getting the following when running dtox.sh:
erik@mini pex % BASE_MODE=pull ./dtox.sh -epy311-integration
1ff12c11995a5b21b7b2774ccc974664997c955b: Pulling from pantsbuild/pex/base
... truncated the output ...
#6 0.182 + addgroup --gid=20 staff
#6 0.216 addgroup: The group `staff' already exists.

And while I know what this means, I'm not sure what the appropriate fix is - should I create a separate user and a different group for it to be in on my dev machine?

@erikwilliamson I wanted to check in and make sure you had what you needed to run tox -epyXY-integration -- -ktest_inject_env_and_args (https://github.com/pantsbuild/pex/pull/2260#issuecomment-1743401346). No rush of course, but without being able to run that it might be hard to work on adding a test.

I'm not a part of the Pants slack. Since you now can run tests, if you can run tox -epyXY-integration -- -k your_new_test_name, even if that fails for perplexing reasons, it's probably time to add the test to this PR. Once you do that I'll approve the CI workflow and we can have a shared failure experience to talk about.

For the formatting shard, tox -eformat-run,typecheck is what you want to pass locally.

I'm getting this on OSX 14.1 - I can fire up a linux VM to make it go away in the meantime though
Typechecking 338 files using Python 3.11.6 against Python 3.12 ...
pex/compatibility.py: note: In function "cpu_count":
pex/compatibility.py:163:23: error: Module has no attribute
"sched_getaffinity"  [attr-defined]
cpu_set = os.sched_getaffinity(0)

@erikwilliamson if that's the only error, you should be good to go since it was only the format check that failed in CI (https://github.com/pantsbuild/pex/actions/runs/6776741887/job/18420675544?pr=2260#step:4:160) and not the type check.
... and I <3 macOS.

... and I <3 macOS.

soon I'll believe you 😂

@erikwilliamson this LGTM mod commented out tests. I'll let CI fly, but please circle back to get those un-commented / updated to work with this change.

Whoops - sorry - I missed committing them earlier. Incoming...

Alright @erikwilliamson this is now available in Pex 2.1.151:

https://pypi.org/project/pex/2.1.151/
https://github.com/pantsbuild/pex/releases/tag/v2.1.151

Thanks for your contribution.

Thanks so much for guiding me, @jsirois ! Your help and patience were greatly appreciated.


fixes multi architecture containers fail when loading with skopeo

Fixes #45
By adding the --all argument to skopeo it will pull all architecture images from the same container image. It will download and extract more data into the container-storage location.  We expect that skopeo includes an architecture flag for pulling only the right container image for our deployment.
Signed-off-by: Alberto Losada<EMAIL_ADDRESS>

/approve

/assign @donpenney @browsell

/retest


fix checker error message

At the moment the error message thrown when keys are in the wrong order provides the reverse error message to which it should be giving. This PR simply switches the format inputs of the provided error message (no unit tests affected). This gave me a few headaches until I worked through the logic of the code manually and noticed the bug in the error message 😄
Simplified Helmfile example:
releases: [...]
bases: [...]

Current error message provided when running a Helmfile command, e.g. helmfile diff:
in ./helmfile.yaml: top-level config key releases must be defined before bases in pre-install.yaml.gotmpl

@petelock good work. thanks so much.


Does rank table need to recalculate hash counts when merging pangenome sketches?

The abundance of a hash in a pangenome sketch is the amount of genomes that contain that hash per lineage.
When we get to creating the rank table, these sketches may be merged. The pangenome element the had is designated is derived from the abundance value for that hash per its lineage. Therefore, we should recalculate the count if more than one lineage is being placed in a rank table...

hot take: we have to trust that the creation of the sketches was done properly. But, if we allow flexibility in that step (good!) then we suffer from not being able to provide good checks later on (bad, but bearable). So this is a consequence of that flexibility.
The alternative solution here is therefore multifactorial:

provide good default advice, quickstarts, and workflows;
document more and better;

One possible solution:

using the csv output when making the database to get a total count for each lineage
normalizing the abundance
Artificially inflate the abundances to fit correctly
Celebrate

not a bad idea, but (if we do it) I would like to make it optional.
anyway, I am not convinced this is a major problem at the moment. I would prefer to figure out which use cases we're actually going to focus on and then realign CLI UX around that (which may well include this issue ;)).

100% agree with you! I am going to start applying this work to colorectal cancer meta genomes which could indicate areas of improvement.


Corsair Wrapper. question

Is there anyway using aurora that could allow a orion g910 to simulate a corsair, so you can do fun keyboard effects like these.
https://www.youtube.com/watch?v=GQi7uexxYjs

Those are profiles for CUE. Writing a wrapper for Corsair will not enable you to use those profiles. Likewise for Razer or Logitech. The utility is communicating with hardware directly.
The only reason to write a wrapper is for games or apps that use their lighting sdk to send lighting information to Aurora instead of their designed utility.
In terms of Corsair, I have only seen one game with lighting support. So writing a wrapper for it isn't of high priority.

Thank you for the reaponse! Is it possible to use CUE RGB profiles on my
logitech?
On Dec 3, 2016 5:22 PM, "Anton Pupkov"<EMAIL_ADDRESS>wrote:
Those are profiles for CUE. Writing a wrapper for Corsair will not enable
you to use those profiles. Likewise for Razer or Logitech. The utility is
communicating with hardware directly.
The only reason to write a wrapper is for games or apps that use their
lighting sdk to send lighting information to Aurora instead of their
designed utility.
In terms of Corsair, I have only seen one game with lighting support. So
writing a wrapper for it isn't of high priority.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/antonpup/Aurora/issues/232#issuecomment-264677551, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AT8oJ_1Pg_Uz2V06HTfsg8z5VT0i8XClks5rEhXwgaJpZM4LDdMN
.

At the moment, no. It was planned to reverse engineer profiles from CUE and Razer to work with Aurora. I ,unfortunately, will not be able to do that. I will try to provide a similar set of tools/effects that CUE has so people can either recreate those profiles in Aurora, or another programmer can create a utility to convert from CUE to Aurora profile.
I want Aurora to be as close to commercial software as I can make it. And I also am hoping that other people will join in to help this project grow.

Awesome! If you could get this to work similar to the CUE, I would put money down for it. I'll make sure to spread this forum and product to other logitech G910 users.


Timezone correct, modules won't follow it

I am running this docker on a Synology NAS.  I got it up and running with no issue.  I set the timezone variable and also linked /etc/localtime.  When I check the date/time of the container it is correct and matches the host system.  The clock module is also correct with the correct time (with or without the time zone config line for the module).  However, other modules such as a sports scoreboard, an "on this day" calendar, and even the holidays calendar seem to be running on UTC, not my actual timezone (UTC -6).  In otherwords, right now my clock, the container, and system shows it is 20:45 on 11/24, but the other modules have all switched to showing things as if it was 11/25.  No errors in the docker logs or system logs.  The docker logs also appear to be in UTC time as the generated logs are showing 11/25 already.  Here is my docker cli command.  What's causing modules to ignore the timezone?
docker run -d \
  --name=magicmirror \
  --restart no \
  -v /volume1/docker/magicmirror/config:/opt/magic_mirror/config \
  -v /volume1/docker/magicmirror/modules:/opt/magic_mirror/modules \
  -v /etc/localtime:/etc/localtime:ro \
  -e TZ=America/Chicago \
  -p 8081:8080 \
  bastilimbach/docker-magicmirror:v2.13.0

I'm seeing something similar in my calendar module - only it differs by calendar and sometimes even by event within a calendar.
I switched to the "develop" branch as someone on the MagicMirror repo mentioned a similar issue was fixed in the develop branch.  That develop branch as a standalone install works correctly, but when I use the container I have the mishmash of timezones in my calendars.

I'm seeing something similar in my calendar module - only it differs by calendar and sometimes even by event within a calendar.
I switched to the "develop" branch as someone on the MagicMirror repo mentioned a similar issue was fixed in the develop branch.  That develop branch as a standalone install works correctly, but when I use the container I have the mishmash of timezones in my calendars.

try to start the container and open a shell (sh, bash) and then use the date command to check if the date is set correctly.
docker run -it --rm
  -v /etc/localtime:/etc/localtime:ro \
  -e TZ=America/Chicago \
  bastilimbach/docker-magicmirror:v2.14.0 \
  bash

try to start the container and open a shell (sh, bash) and then use the date command to check if the date is set correctly.
docker run -it --rm
  -v /etc/localtime:/etc/localtime:ro \
  -e TZ=America/Chicago \
  bastilimbach/docker-magicmirror:v2.14.0 \
  bash

Yes - running date from a bash prompt inside the container returns the correct date.

Yes - running date from a bash prompt inside the container returns the correct date.

the date command returns the correct time date.
timezone environment variable is set and the localtime folder is mapped to the container.
I just noticed v2.14.0 was released 3 days ago. I’m running v2.13.0, so I’ll have to test this again later.

the date command returns the correct time date.
timezone environment variable is set and the localtime folder is mapped to the container.
I just noticed v2.14.0 was released 3 days ago. I’m running v2.13.0, so I’ll have to test this again later.

when the date and time is correctly set in the container, it must be a problem of MagicMirror not using it correctly.

when the date and time is correctly set in the container, it must be a problem of MagicMirror not using it correctly.