Remove  from

The value of scoreFormat is not describing a physical entity. Because of this scoreFormat shouldn’t be available at physDesc anymore. The occurrence in the mei.frbr expression is still fine. The metadata-ig discussed this issue and decided to make this suggestion.

At ODD Friday, there was consensus that it makes no sense to have <scoreFormat> within <physDesc>. However, it should be possible to have that kind of information even without the FRBR module, so not only within <expression>.  It would be good to think about this use-case, and luckily, @riedde volunteered 👍  :-)

This discussion has already taken place several times.  When the FRBR module isn't used, the next best place for <scoreFormat>, however it may annoy the FRBR zealots, is <physDesc>.

I agree that <scoreFormat> has to be available also when not using the FRBR module, but I don't agree that <physDesc> is the best place for that. In MEI 4.1.0 <physDesc is only contained by  or  and both elements are provided by the MEI.frbr module. Maybe I'm missing something but from my view it would be interesting to use  <physDesc> without MEI.frbr. I noticed that in MEI 3.0.0 <physDesc> was allowed in <source> which is still available in the header (independent from MEI.frbr), but in MEI 4.1.0. <source> may not contain <physDesc>.
However, I would be fine if <scoreFormat> is availabe in <source> or <manifestation> or <item> as some way of classification, but for me it is till no physical description. My suggestion is to set the element one level high, out of <physDesc>and also make it available in <source> that there is no constraint to use MEI.frbr

I suggest having a look at https://www.loc.gov/marc/bibliographic/bd3xx.html where score format is very clearly grouped with other kinds of physical description.  https://www.loc.gov/marc/bibliographic/bd348.html describes "Format of Notated Music" as "[t]he musical or physical layout (emphasis mine) of the content of a resource that is presented in the form of musical notation."
Putting <scoreFormat> in <manifestation> and/or <item> doesn't resolve the issue of how to record this info when the FRBR module isn't available, since both of these are only available when FRBR is turned on.  Allowing it in <source> subverts the intention of this element in v. 4.1.0; that is, to record only the high-level bibliographic details necessary to locate the source, not complete description.  Stated another way, if <scoreFormat> is allowed in <source>, then all the other details that were intentionally removed from <source> in v. 4 would have to be put back in as well and setting off a highly undesirable chain of discussions about the use of <source>.
So, while it may not be the optimal solution, allowing <physDesc> to contain <scoreFormat> follows tradition and minimizes other problems.

Okay, minimizing other problems is one thing i always prefer, but leaving it as it is does also not solve the problem that scoreFormat can not be used without MEI.frbr ...
Thank you fore the links, I also had a look there. It seems to me that this is some kind of clash of disciplines.

I apologize -- I just realized that my argument with respect to allowing physical description without FRBR is based on v. 3.
Still, I don't recommend removing <scoreFormat> from <physDesc> since the latter functions as a container for various kinds of data, not all of which are strictly descriptive of physical form.  For example, <physDesc> also allows accMat, captureMode, exhibHist, plateNum, titlePage, treatHist, and treatSched, which technically aren't descriptive of the physical qualities of the item.

Sometimes it's best to let sleeping dogs lie. :-)

Where did we land with this issue? Can it be closed with a "won't fix"?

I would like to keep this issue open until the next metadata-ig meeting (in june). After that I can tag an maybe close this issue.

OK

The metadata-ig is informed about this discussion and is fine if we close this issue with the tag "won't fix". We decided to take back this proposal and to keep <scoreFormat> as it occurs because of compatibility reasons. Further we are going to extend the description in the guidelines in section 3. Metadata in MEI to articulate the different ways of use/meaning.
@ahankinson would you close this issue, please? I don't have the user rights to do that.


npm update broke something relating to react-tools

I just ran npm update react-native and it broke my project. Got this error,
Cannot find package main file for package: /Users/blaine/dev/native/evueIOS/node_modules/react-native/node_modules/react-tools/src
It could be something just related to me but thought I'd post it up.

I found out that it was my requiring another component in my app,
'use strict';

var React = require('react-native');

var {
  AppRegistry,
  StyleSheet,
  NavigatorIOS,
  Text,
  View,
} = React;

var Dashboard = require('./app/components/dashboard');

var evueIOS = React.createClass({
  render: function() {
    return (
      <NavigatorIOS
        style={styles.container}
        tintColor='#FF6600'
        initialRoute={{
          title: 'Dashboard',
          component: Dashboard,
        }}/>
    );
  }
});

var styles = StyleSheet.create({
  container: {
    flex: 1,
    backgroundColor: '#F6F6EF',
  },
});

AppRegistry.registerComponent('evueIOS', () => evueIOS);

module.exports = evueIOS;

It's the var Dashboard = require('./app/components/dashboard'); line that breaks it.

Ok so I figured out it had to do with the dashboard file itself. Only thing I could say is better error reporting. It told me I had an issue with some random dependency graph thing but it was really an error with a require in the dashboard file. You can close this if you guys know you need to improve that stuff.

:+1: thanks for the follow up, perhaps the error was with something inside of the dashboard component that lead to a dependency graph problem?

It was super deep in the chain. It was in the dashboard which called another component which called another which called another which had a bad piece of code.
Definitely could use improved debugging for that in the long run. If this was a huge app that woulda been crazy hard to find.
and more specifically it was related to a non react native element. I was testing out a div. That may be a weird scenario but I bet other weird things could trigger that same type of error.
Thanks for the response :)

Interesting, it could be worth opening an issue if you want to re-create the problem in public repo so we can consider what might be a more descriptive/useful error message :smile:

I may get to that at some point.


Test Offline Composition Analysis

In GitLab by @NicoleSchwartz on Apr 6, 2020, 21:55
In order to verify we are confident in our MVC offline work we need to test it.
This is MVC only, we should make note about what we should do post MVC HERE to improve test coverage and under the guidance of quality create scripts/resources/whatever in order to have that implemented as part of their test environment for offline.
The following should be completed (and not by the dev who did them):
Container Scanning

[ ] test step X in demo script in GCP environment. Copy in any project and create any repository needed to accomplish this immediately record and ~p1 any ~bug found. Document what project was copied in as well as steps for any repo created and share with quality HERE
[ ] review demo script does it make sense / is OK
[ ] review user documentation, any edits/improvements (also be aware of effort to make consistent HERE)

License Compliance

[ ] test step X in demo script in GCP environment. Copy in any project and create any repository needed to accomplish this immediately record and ~p1 any ~bug found. Document what project was copied in as well as steps for any repo created and share with quality HERE
[ ] review demo script does it make sense / is OK
[ ] review user documentation, any edits/improvements (also be aware of effort to make consistent HERE)

Dependency Scanning

[ ] test step X in demo script in GCP environment. Copy in any project and create any repository needed to accomplish this immediately record and ~p1 any ~bug found. Document what project was copied in as well as steps for any repo created and share with quality HERE
[ ] review demo script does it make sense / is OK
[ ] review user documentation, any edits/improvements (also be aware of effort to make consistent HERE)

In GitLab by @NicoleSchwartz on Apr 6, 2020, 22:02
changed the description

In GitLab by @NicoleSchwartz on Apr 6, 2020, 22:08
marked this issue as related to #517

In GitLab by @NicoleSchwartz on Apr 6, 2020, 22:08
closed


Out-of-Session (Authentication credentials were not provided.)

I've tried using --cred "email@domain.com:pass", as well as creating a cookies.json file based on the cookie contents in Firefox. Both give the same error, and the cookies.json is deleted.
In the browser, after I log into learning.oreilly.com, I'm redirected to my.safaribooksonline.com.
Anything I'm doing wrong?

i am seeing this error as well . In the logs i see that it correctly logs in and even finds out how many chapters does the book have.
But then fails with this error
[#] API: [+] Use the `--cred` option in order to perform the auth login to Safari Books Online.


Indexer crashes

Indexer crashes with the lines below
I am using Gitea Version: 34695f4 on Debian Testing
2018/11/12 11:37:06 [.../runtime/asm_amd64.s:1333 goexit()] [E] updateRepoIndexer: exit status 128 - fatal: git cat-file: could not get object info
2018/11/12 11:37:06 [I] Done populating the repo indexer with existing repositories
2018/11/12 11:37:07 [.../runtime/asm_amd64.s:1333 goexit()] [E] updateRepoIndexer: exit status 128 - fatal: Not a valid object name 33af0e1f6c425959dd41b96752e61f50949e0118
57c601d489a0901efaa5ded23b724bd5fb7f5af2
2018/11/12 11:37:22 [.../runtime/asm_amd64.s:1333 goexit()] [E] updateRepoIndexer: exit status 128 - fatal: Not a valid object name d23a53c74af7601d45f90b182bcde035ef0d691c
6ddd2549edfd65ec21fe54efae21e963b83fba1e

Which version of Git are you using?

git --version
git version 2.19.1
Debian Buster X64

I have a similar problem: same error message, same status 128. And Gitea is then taking up 44% of my whole RAM!
This is after changing from:

git 2.18.0(-1)
gitea 1.5.1(-1)

to:

git 2.19.1(-1)
gitea 1.5.3(-3)

on Archlinux, with my Ansible configuration applied to app.ini.sample from upstream Gitea.
Please ask for details if you need more.

Same here on RHEL:

git version <IP_ADDRESS>
gitea 1.5.3

Same after updating from 1.5.1 to 1.6.0:

SLES 12
git version 2.12.3
gitea 1.6.0

Same, using 1.6.0, debian 9 64bit, git 2.17.1

same, using 1.6.1, rhel 7.5 X86_64bit, git 2.14.1
2018/12/17 15:06:09 [...routers/repo/http.go:391 serviceRPC()] [E] fail to serve RPC(upload-pack): exit status 128 - {[102 97 116 97 108 58 32 84 104 101 32 114 101 109 111 116 101 32 101 110 100 32 104 117 110 103 32 117 112 32 117 110 101 120 112 101 99 116 101 100 108 121 10] 0 [0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0] 0}
2018/12/17 17:29:40 [.../runtime/asm_amd64.s:1333 goexit()] [E] updateRepoIndexer: exit status 128 - fatal: git cat-file: could not get object info

As things stand, it is also useless with little repos, because you have to disable it to keep it from eating all your RAM :-/

indexing and searching are essential to code related work, any way to improve this in gitea, as far as I can tell, this is the only obvious weak area at the moment.

@laoshaw Yes, that needs more work.

Does someone know the current status of this issue?
Also, what are the consequences of switching the indexer off? I wish to understand if this issue is minor or major, as far as I am concerned at least…

@tYYGH If you switch the Repo Indexer off, you will not be able to search for code in Gitea anymore.

I am wondering about the indexer situation as well.

I will have a look but I remember a PR for a buffered git cat-file implementation.

@sapk @6543 It's probably fixed in #7711 and others.

@guillep2k Yes, you greatly improve indexer code and others have greatly contribute to git related performances.
I will close this issue then.
Please feel free to re-open an issue (and link this one) if the problem is still existing.


Write changelog in tag

The new tag's message should contain the changelog for the new version.

Currently clog-lib has no method to get the new changelog as a string, but it should be easy to add

Fixed by #36


in sdxl paper,train the base and refiner together?or separate？

where is the details?tks

configs/inference)
/sd_xl_base.yaml   and refiner.yaml?
so train them lonely?


dependency updates

#57  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @Enalmada and the rest of your teammates on  Graphite


set_translation not working but no error's and corrupt scene .scn

Godot version:
Godot stable 3.1.1 win 64bit
OS/device including version:
windows 8,1
Issue description:
Cant set_translation, no error's if you see in my project the set_translation has been used and if I use without variables only numbers within set_translation and I still get no set_translation to work properly. you need to press GUI button ingame to load Godot scene. The code where  set_translation is in func repeat_me(): in  POSMODEL.gd file (use test.tscn in the project folder to test set_translation with a 3d model).
And .scn file keeps getting corrupt sometimes after saving.
Steps to reproduce:
My laptop went to sleep when I turned it back on some of my scenes got corrupted but the ones working had skybox removed and material removed and I accidentally overwrite the scene with an older scene so I used old scene and added lighting and skybox color.
Minimal reproduction project:
https://drive.google.com/file/d/1cc5T_1P2csJo641fYe9FzRGsOd0hJwKN/view?usp=sharing

it


Specify a specific version for the rustup setup recipe

We have this Justfile recipe:
# Setup local development environment
setup:
  #!/bin/bash
  if [[ "$(cargo 2>&1)" == *"rustup could not choose a version of cargo to run"* ]]; then
    rustup default stable
  fi

But we should specify a specific version in the code, because otherwise if people run the recipe at different points in time they may be using different versions of the underlying dependency

here are the releases https://github.com/rust-lang/rust/blob/master/RELEASES.md


Pairing function does not return 1 for P=infinity, Q=infinity

If I understood correctly, the pairing function e must return the neutral group element 1 for

e(P, 0) for every P
e(0, Q) for every Q

which implies that e(0, 0) == 1 must be satisfied.
After https://github.com/miracl/amcl/commit/be9d80b89fe8359c3fab0e109f0f91d60b2c2527, the first two of the following tests work, the 3rd fails. Is this a bug?
  it("satisfies e(P,0) == 1", () => {
    const P = g1.mul(new ctx.BIG(5));
    const Q = new ctx.ECP2();
    expect(ctx.PAIR.fexp(ctx.PAIR.ate(Q, P)).isunity()).toEqual(true);
  });

  it("satisfies e(0,Q) == 1", () => {
    const P = new ctx.ECP();
    const Q = g2.mul(new ctx.BIG(8));
    expect(ctx.PAIR.fexp(ctx.PAIR.ate(Q, P)).isunity()).toEqual(true);
  });

  it("satisfies e(0,0) == 1", () => {
    const P = new ctx.ECP();
    const Q = new ctx.ECP2();
    expect(ctx.PAIR.fexp(ctx.PAIR.ate(Q, P)).isunity()).toEqual(true);
  });

Good point. The case e(O,O) evaluates very naturally as 0. But mathematically it seems it should be 1. This will require an explicit test for this case. I would love a pointer to a maths text which explicitly states that e(O,O)=1 (indeed for a type 1 pairing e(P,P) !=1 is actually an explicit condition for non-degeneracy).

I came across this property when implementing Groth-Sahai proofs. In https://eprint.iacr.org/2007/155, version 20160411:065033, page 25 in "Common reference string" and "Pairing product equations" it is assumed that e(0, 0) == 1 (in the top left component of the result of F).
In https://www.math.uwaterloo.ca/~ajmeneze/publications/pairings.pdf 2.1 it says (at least for symmeteric pairings):

The following properties of bilinear pairings can be easily verified. [...] For all S, T ∈ G1
(1) e(S,∞) = 1 and e(∞, S) = 1.

and I guess should also be true for S = ∞.

Yes, I will change it. It seems the simplest thing to do is to return 1 if the ECP point P is infinity.

Fixed

Thanks a lot, works fine now (tested via PAIR.js). For future visitors: this was fixed in https://github.com/miracl/amcl/commit/7c2262077f2348aa0e4901ba94b7cc4f1211b6fc


Left Nav covers takes up a ton of real estate. Add ability to move to top nav or hide side nav

Expected Behavior

Current Behavior

Screenshots (if appropriate):
Possible Solution

Steps to Reproduce (for bugs)

Context

Your Environment

Franz Version used:
Operating System and version:

Duplicate of #156


Bug Dialog in<EMAIL_ADDRESS>

Built a module to manage the loading templates for Modal Bootstrap. After upgrading my version of<EMAIL_ADDRESS>to close a Modal, I can not open it.
Simulation: (http://embed.plnkr.co/3fLH5OaVQrnzalj8831U/preview)
Open your console in the browser, click the "Open Modal" button, it opened perfectly and the island was writing an element I scored. After open, close the Modal and try to open it again, see that it was no longer displayed. Note that the console the writing element is different from the first time it was opened.
Note: Change the version of<EMAIL_ADDRESS>and see that the problem does not happen.

I think it, having a more concise reproduction would help.
(I.e. one with less moving parts/dependencies.)

bug in my app too

It seems in the plnkr, a file called bootstrap-modal.js is missing.

Okay @Narretz , this bootstrap-modal.js import was a modified version of Bootstrap, but could simulate the problem using the original version of them just forgot to remove the import, I'm sorry.
Towards a more concise playing, I do not know how to do, I cleared my code as much as I could without compromising the flow of my scenario. Right now, I need your help with more skills on the subject.
Simulation: http://embed.plnkr.co/3fLH5OaVQrnzalj8831U/preview
Thank you!

It's because of this commit: https://github.com/angular/angular.js/commit/6838c979451c109d959a15035177ccee715ccf19 It does seem to have side-effect after all, but we need to investigate more (you are welcome to look at it, too).

@lgalfaso Do you think you could take a look at this? It seems to happen because of the $q performance improvement you committted.

removing the lines of commit, works fine!

I've checked this again, and this is a bug in the dialog directive. This has only worked before by chance, because the directive is doing some really odd stuff.
First, the dialog directive is compiled. Then, after the content promise is resolved, it is compiled and appended to the dialog. But because the dialog is replaced and has a templateUrl, the content wasn't correctly appended to the dialog on the second try. What you should do is to append the content to the dialog, and then compile it. http://plnkr.co/edit/4OwrRINQplQ00zioSPOm?p=preview
The directive is also leaking dom nodes when the modal is closed, so you should investigate this.

@HenriqueLimas


Intermittent crash when invoking Ctrl + B

Confirmed on Windows.

Same as #1? Similarly to #1, it probably happens while the tree view is updating.


improve gen-helloworld exit code

Please provide a description of this PR:
improve gen-helloworld exit code

@my-git9: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name
Commit
Details
Required
Rerun command

integ-pilot-istiodremote_istio
fe6f77f700d6b06681e64e80f72cc296cf4c8be4
link
true
/test integ-pilot-istiodremote

Instructions for interacting with me using PR comments are available here.  If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

/test integ-pilot-istiodremote


fix(getPixelSpacingInformation): treat negative pixel spacing

Context
Currently negative values of pixel spacing aren't being properly treated at OHIF and this inverts the image. The solution is to force them positive.

Changes & Results
Before:

After:

Testing
Manually tested.

Checklist
PR

[X] My Pull Request title is descriptive, accurate and follows the
semantic-release format and guidelines.

Code

[X] My code has been well-documented (function documentation, inline comments,
etc.)

Public Documentation Updates

[X] The documentation page has been updated as necessary for any public API
additions or removals.

Tested Environment

[X] OS: MacOS 14.0 (23A344)
[X] Node version: 18.16.1
[X] Browser: Chrome  119.0.6045.105

can you try removing the whole ultrasound enhanced region logic here, and upgrade cs3d since that implements it properly

@pedrokohler can you try latest master and let me know if you need this fix or not

@pedrokohler can you try latest master and let me know if you need this fix or not

Yes, it looks like it's fixed.
Old behavior:

Current behavior:

I'm closing the PR


Update free-courses-bn.md

title update and link also
What does this PR do?
Add resource(s) | Remove resource(s) | Add info | Improve repo
For resources
Description
Why is this valuable (or not)?
How do we know it's really free?
For book lists, is it a book? For course lists, is it a course? etc.
Checklist:

[ ] Read our contributing guidelines.
[ ] Search for duplicates.
[ ] Include author(s) and platform where appropriate.
[ ] Put lists in alphabetical order, correct spacing.
[ ] Add needed indications (PDF, access notes, under construction).
[ ] Used an informative name for this pull request.

Follow-up

Check the status of GitHub Actions and resolve any reported warnings!

For youtube, we prefer "playlist" links and the name of the producer/creator. docs/CONTRIBUTING.md#platforms-and-access-notes
Please use alphabetical order; our linter can't check the bangle list.


perf: image loading and rerenders

:tada: This PR is included in version 1.17.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Sketch works just one time

Hi,
I have dealt a lot with devices connection. I have written a couple of programs and they work only one time. For instance, when I pull the example of basics it worked and find the 3 virtual devices, then when I restart or reload the software it does not connect anymore, even though the code has not changed.
any clue, or somebody with the same issue?

Hi,
are you using ESP32? There is a weird issue where the WiFi driver connects only every other time. Try resettinng the ESP once more and it will most likely work!


[WIP] Update factory_bot and timecop

@jrafanie is there a reason this is WIP?
are we waiting on testing this against other repos?

Yes, that's why I was in the content repo and looking at the validation error on automation_manager.  Shiny object.

@Fryguy @kbrock I think this is ready to go once https://github.com/ManageIQ/manageiq-consumption/pull/168 is merged

kicking

ok, all dependent PRs are merged


Typo "@publisher"→"@publisher"

https://docs.microsoft.com/en-us/sql/relational-databases/replication/non-sql/manage-oracle-tablespaces?view=sql-server-2017

@hyoshioka0128 : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Verified editorial correction. Thank you!


Passing the key file as string value

Hey! I've just made a small change so we can pass the key directly, not using the file. It'll make using the library much easier in cases when you store the key in DB, secrets on environment variables.
Hope you'll find it useful and thanks a lot for your work!

Also you've broken the report methods by adding required sort argument to _build_query_parameters  function, I've made it optional.

This is indeed a good addition!
I will have a look and merge it soon.
Thanks! (and thanks for the fix)

Great! When do you plan to publish the new version?

Great! When do you plan to publish the new version?

Done!
https://pypi.org/project/appstoreconnect/0.4.1/


Added a dark mode feature in blogchain.

Project Title: Blogchain
Project Description: Added a dark mode feature which toggles between dark and light and placed it next to "connect" button.
Technologies Used: typescript react react-icons tailwind

Can someone please guide me and help me here. This is my first PR. I'm brand new to this.


Allow easier casting of serializable enum to a different bit width

Currently a serializable enum can only be cast to its base type. So if we want to cast it to a different bit width, it has to happen in 2 steps, like the following:
(bit<new_W>) (bit<base_W>) serializable_enum

This feels unnecessarily verbose.
In a similar spirit to #992, I wonder if it would be good to allow casting a serializable enum to a different bit width in a single step like (bit<new_W>) serializable_enum?

There is a reason for having the cast be verbose, which is that on some architectures sign-extension is actually very expensive. So forcing the people to write the second cast makes it clear that there is some computation involved.

That reason I understand.
I wonder if the (bit<base_W>) serializable_enum casting indicates any computation cost though? My understanding is that this cast is mostly for frontend type checking, but no real work for backend.
If this is true, then (bit<new_W>) (bit<base_W>) serializable_enum should have the same computation overhead as (bit<new_W>) bit_W_val. Then does this justify simplifying this to (bit<new_W>) serializable_enum?

And I see the implicit cast rules are being discussed in #1223. Maybe this is a relevant case to that discussion.


Solve compile errors cause by typed_scalar_variable.hpp

When compiling with Visual Studio 2019 errors occur in typed_scalar_variable.hpp since the min and max member functions of bounded_scalar_variable.
This can be solved by undefining the old min and max macros via:
#ifdef max
#undef max
#endif
#ifdef min
#undef min
#endif

Care to make a PR? I assume that when this is applied directly to the header, we don't need this definition here anymore: https://github.com/NTNU-IHB/FMI4cpp/blob/d51b3ecc9521a52f3502b691f3de0dc8bf8ad43e/CMakeLists.txt#L30
In another project I was involved with, a similar issue was resolved by applying in the cpp file:
#if defined(_WIN32) && !defined(NOMINMAX)
#    define NOMINMAX
#endif

However, I'm not sure adding this to the header is a good idea. What if the client project relies on these macros?
Would it be better to just apply it in your own project?

Closing due to lack of feedback from issue reporter


[SPARK-23400] [SQL] Add a constructors for ScalaUDF

What changes were proposed in this pull request?
In this upcoming 2.3 release, we changed the interface of ScalaUDF. Unfortunately, some Spark packages (e.g., spark-deep-learning) are using our internal class ScalaUDF. In the release 2.3, we added new parameters into this class. The users hit the binary compatibility issues and got the exception:
> java.lang.NoSuchMethodError: org.apache.spark.sql.catalyst.expressions.ScalaUDF.<init>(Ljava/lang/Object;Lorg/apache/spark/sql/types/DataType;Lscala/collection/Seq;Lscala/collection/Seq;Lscala/Option;)V

This PR is to improve the backward compatibility. However, we definitely should not encourage the external packages to use our internal classes. This might make us hard to maintain/develop the codes in Spark.
How was this patch tested?
N/A

cc @cloud-fan @hvanhovell @zsxwing

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/824/
Test PASSed.

Test build #87352 has started for PR 20591 at commit 2b6be52.

Test build #87352 has finished for PR 20591 at commit 2b6be52.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87352/
Test PASSed.

The JIRA ID is wrong...

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/831/
Test PASSed.

Merged build finished. Test PASSed.

Test build #87363 has started for PR 20591 at commit 08b39d0.

Test build #87363 has finished for PR 20591 at commit 08b39d0.

This patch fails due to an unknown error code, -9.
This patch merges cleanly.
This patch adds no public classes.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87363/
Test FAILed.

Merged build finished. Test FAILed.

retest this please

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/844/
Test PASSed.

Test build #87380 has started for PR 20591 at commit 08b39d0.

Test build #87380 has finished for PR 20591 at commit 08b39d0.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87380/
Test FAILed.

retest this please

Test build #87390 has started for PR 20591 at commit 08b39d0.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/851/
Test PASSed.

Merged build finished. Test PASSed.

Test build #87390 has finished for PR 20591 at commit 08b39d0.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87390/
Test PASSed.


Can checkPermissions be public instead of private?

Discussed in https://github.com/AsyncSwift/AsyncLocationKit/discussions/17

Originally posted by lmillett October 25, 2022
In my app I would like to check what location permissions have already been authorized before I ask them to grant me location permission. That way I'm not forced to ask for permissions before they have even used the app. I can delay it to a later point when they do an operation that really requires that authorization.
I have that change made locally to my package and it seems to work as I would like it to.
Happy to submit that change if others agree.

https://github.com/AsyncSwift/AsyncLocationKit/pull/19


How does one obtain training data suitable for fine-tuning Aquila models?

Hello,I have WuDaoCorpora Text  Dataset，I'll need to preprocess and format it to match what Aquila's training scripts expect as input.
Are there any docs provided on how to transform that kind of data? Is it covered in FlagData? thanks

Aquila2 models are trained on a big Corpus including WuDaoCorpora Text Dataset.
Aquila2 models are trained on https://github.com/FlagOpen/FlagScale forked from Megatron-LM.
Data preprocessing tools can be found in https://github.com/FlagOpen/FlagScale/blob/main/README_original.md#data-preprocessing.

Aquila2 模型在包括 WuDaoCorpora 文本数据集在内的大型语料库上进行训练。
Aquila2 模型在从 Megatron-LM 分叉的https://github.com/FlagOpen/FlagScale上进行训练。
数据预处理工具可以在https://github.com/FlagOpen/FlagScale/blob/main/README_original.md#data-preprocessing中找到。

thank you


leo-editor: 5.7.3 -> 6.0, add Qt wrapping

Motivation for this change
Bump version to 6.0 and fix a crash on startup due to #65399.
Things done

[x] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS)
Built on platform(s)

[x] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[ ] Tested compilation of all pkgs that depend on this change using nix-shell -p nix-review --run "nix-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[ ] Determined the impact on package closure size (by running nix path-info -S before and after)
[x] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Notify maintainers
cc @leonardoce @RamKromberg

OP doesn't respond to review, closing.


Divine Super Strength (with no Divine Super Attack) wont stop spamming

I am using only a divine super strength but the plugin seems to base the "melee boost threshold" on my attack level. I don't want to use super attack potions. Is there a way to configure this so it doesn't constantly spam even though I am potted

update, this is same issue in #13 opened on Jan 16 by Whisperhelp
i commented on that as well, but this could be fixed by adding a checkbox whether you are training attack/str/defense for it to only check that stat

Fixed by the latest update which allows you to select which boost to check for melee


Rename project to "Storage Discovery Service"?

How about Azure Storage Finder

After deciding on a name (and abbreviation, if necessary):

[ ] Receive approval from the open-source community at Microsoft for the project name.
[ ] Replace names of namespaces in code
[ ] Change name of project in package.json
[ ] Change name of repo on GitHub


packetized path requires buffers be 2^n

This constrains the size of the buffer unnecessarily, could be particularly bad on eth

dupe of #14427


Classification: Handle non-numeric labels

To add feature for handling non-numeric labels for classification

Issue has been fixed and will be released in update 1.0.2


[Feature Request] Highlight sections with children / Expand All

Hi, thank you for creating an incredibly useful extension. I would like to suggest the option (or default behaviour) to have a SECTION anchor in the navigation panel only show the expansion arrow if it has other anchors inside. I have a file with about 20 sections, but only one or two at a time have TODO or FIXME anchors inside. At the moment I can't see which one without clicking each section to open it.
An alternative or complementary feature would be the option to expand all sections with 1 click.
Thank you!

I immediately look for "Expand All" button when I start using it. It is much needed when you have many sections and tags. gabriele-cannizzaro's suggestion is solid and I appreciate if such feature available. Thank creator.

Would love to add this feature, unfortunately it doesn't appear to be possible at this time (See https://github.com/microsoft/vscode/issues/88682)
Will implement this once the VSCode Extension API allows for it.

Will close this issue for now for housekeeping sake since VSCode unfortunately still does not support this


Feature/add basic arithmetics

A rebased version of https://github.com/kelseyhightower/confd/pull/363 by @aquam8.
Original PR looks orphaned.

Just an FYI that this project is considered unmaintained for the time being. I'm in communication with kelsey to transfer maintainership to myself or to someone else so this project can carry on, but the original PR is still fine; it's just stale.

@bacongobbler sounds pretty sad... Any chance that this, or original PR is going to be merged?

eventually, yes. If not you're more than welcome to fork and maintain a separate confd repo. That's the beauty of open source ;)

hi, i need also this PR ;)

Duplicate of #363


Adds balancing functionality

Currently exports function balance_reaction which enables us to balance simple chemical reactions.
For example -
> balance_reaction("SiCl4 + H2O → H4SiO4 + HCl")
> "SiCl4 + 4H2O → H4SiO4 + 4HCl"

@anandijain

Also, I will switch CI to Github Actions now as you said.

Codecov Report
Patch coverage has no change and project coverage change: -6.23 :warning:

Comparison is base (5e0d1d6) 14.28% compared to head (3aca604) 8.06%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
Additional details and impacted files
@@            Coverage Diff            @@
##           master      #3      +/-   ##
=========================================
- Coverage   14.28%   8.06%   -6.23%
=========================================
  Files           2       3       +1
  Lines          70     124      +54
=========================================
  Hits           10      10
- Misses         60     114      +54

Impacted Files
Coverage Δ

src/testbalance.jl
0.00% <0.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

I don't understand why the tests are failing for the "balance_reaction" testset. I tried all the testcases individually and all of them give the right output. Am I missing something?
@anandijain

Also, locally the tests seem to pass successfully?

I think this fixes everything.
@anandijain


Added data-name to distinguish facet

Questions
Answers

Description?
Added data-name to distinguish facet for improving tests on modules

Type?
improvement

BC breaks?
no

Deprecations?
no

Fixed ticket?
N/A

How to test?
N/A

No need QA. It's already validated by UI Tests.


Including asynchronous sequences

Hi!
Really loved your implementation, worked like a charm. This is not really an issue, but a question. If I want to give asynchronous sequences to the Phased LSTM layer, I should just change the step definition in the class right? Like the way you mentioned in the comments.
So my input shape would be (?, seq_len, 1 + nb_features) (first index of axis 2 would be the time difference bw the current and previous sample). Then slice it, adding the first index to t_tm1 instead of just 1,  and doing the LSTM calculations in the normal manner with x[1 :]

Hi,
Yes how I thought of doing it, and put that in the TODO comments. Feel free to fork and I can merge to the main branch! I just haven't found the time.
One thing to take care is the difference in matrix sizes between the build and call function.

I have a feeling just slicing the input won't work. This might break in case of stacked PLSTMs? In case return_sequences argument is True, we should include the time diff in the first index of the output (h) as well?
What Im thinking, we can make this change only to the output, and not in the states list. Where the function 'step' returns
''' return h, [h, c, t] '''
We can return something like concat(x[0], h),  [h, c, t]. However Im not very familiar with the control flow in keras, will this cause anything to break?

This may be possible by using the functional API and having the PLSTM object take in an auxiliary variable representing the time.

@kush789 Any attempt to do this? I try to assign h_tm1= x[0] in the def step(self, x, states) but it didn't work. I think the  shape of x is (batch_size,input_dim) so I tried h_tm1= x[:,0] but failed also.

If the first dimention is the time DELTA, then wouldn't this work ?
t = t_tm1 +  inputs[:,0].dimshuffle(0, 'x')
This takes the first dimension of the input and makes it broadcastable over every hidden unit (at least thats what i intend to do).
Obviously the limitation is that

the plstm has to be the first layer in the network
the time delta keeps being a feature (which might not be bad)

I tried on my implementation but the results were not better than then synchronous plstm (but it could be because of the problem).

Yea I guess that could work. For point n2. you could multiply by a fixed mask which masks that first column later on for other matrix operations, kind of like drop-out for all the time-column?

This is really great but I'm a little lost. Have there been any upgrades and/or is anyone aware of concrete examples? Cheers!

I am also lost, is the implementation already compatible with asynchronous time series?
How does it now when the time series is synchronous and when is asynchronous?
Thanks, keep up the good work!

Is there might and example around how to handle async time series?

This is great work.
I also wanted to handle asynchronous time series. Has anyone been able to successfully adapt this keras implementation of phased LSTM to  asynchronous time series? I would be very grateful to anyone who can help me here.


chore: bump network node to 0.57.0-alpha.0

Description:

Related issue(s):
Fixes #
Notes for reviewer:

Checklist

[ ] Documented (Code comments, README, etc.)
[ ] Tested (unit, integration, etc.)

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 61.15%. Comparing base (66eb69a) to head (795aafd).

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #878   +/-   ##
=======================================
  Coverage   61.15%   61.15%
=======================================
  Files          29       29
  Lines        1179     1179
  Branches      147      147
=======================================
  Hits          721      721
  Misses        437      437
  Partials       21       21


[SSD-ResNet34] Is there any trained model for tensorflow?

We are trying to opt performance of SSD-ResNet34 inference 1200x1200 on tensorflow.
We did some explore and need check the accuracy.
So is there any trained model?
And if not, will there be any in future?

resolved now. please see the latest readme.


disconnected from server

Hi All,
I'm using openfire as my XMPP server.
but sometimes my jitsi client can't connect to server anymore.
and the error message from manager.my.domain.name :
" You are using an invalid client, and therefore will be disconnected.  Please ask your system administrator for client choices ".
Previously, it was ok and everything is working well.
anyone have the same issue ? and how to fix this ?
Thanks.

Jitsi can connect perfectly fine to Openfire 3.10.x and 4.0.2. Maybe your sysadmin limited the allowed clients with the Client Control plugin.

Hi Ibauersachs,
thank you for your explanation.
I will crosscheck this to my sysadmin.

I have the facing similar type of problem.
When a remote user connects then it shows error "Unfortunately, something went wrong."
https://webrtc.ajdevdemos.com/Hard


slosh needs ability to run some tests in Rust

In a lisp ideally as much of the language utilities as possible are written in the host language.
However, this concept is in tension with the idea that you shouldn't be able to have a project compile, and run tests if it's in a broken state.
Therefore. I would like a way to test the builtins written in rust when cargo test is run. This doesn't mean functions written in slosh with examples in slosh should be tested by cargo test. But it does mean that if cargo test passed and slosh tests fail, there isn't something "fundamentally" broken about the language that's causing slosh tests to fail. If w/e slosh test runner is written fails the idea is there is as much of a guarantee as possible that the problem is in lisp code, not in rust code.
tldr;
I think this translates to.... make an integration test that calls the slosh test script.

resolved in PR #111


Keep explicit support for non-lspconfig setup

Hi @jose-elias-alvarez, thanks for your work on typescript.nvim (and nvim-lsp-ts-utils before)!
I have a feature request.
I'm not using lspconfig. Instead I do vim.lsp.start inside a FileType autocommand myself (https://github.com/marcelbeumer/nvim-config/blob/e449f80d1e1a4e92ab4008d6ec392a9fe4345c29/lua/conf/lsp/server/tsserver.lua).
By reading through the source I've managed to using typescript.nvim by doing the same as your lsp.lua does:
-- once
require("typescript/config").setupConfig({})

vim.api.nvim_create_autocmd("FileType", {
-- ...
      vim.lsp.start({
        -- ...
        handlers = vim.tbl_extend("force", util.get_handlers(), {
          ["_typescript.rename"] = require("typescript/handlers").renameHandler,
        }),
        -- ..
        on_attach = function(client, bufnr)
          -- ...

          if not require("typescript/config").config.disable_commands then
            require("typescript/commands").setupCommands(bufnr)
          end
        end,

This seems to work fine but of course the risk is that things break later as I'm poking in typescript.nvim internals.
Would it be possible to keep explicit support for such a non-lspconfig setup, by adding instructions to the README, and then making sure things keep working? And in case of breaking changes update the README and preferably mark commit as breaking change?
Thanks in advance!

Sure, I'm in support of this (I tried to do something similar in #30). I'd be open to a PR that either documents the process or even some kind of helper to set this up with a little less boilerplate, if you're interested.

Great! Yes, I'll follow up!


Update kube-tools image

This updates all deps in the kube-tools image to the latest stable release.

@zimnx ptal


3.0 Shader Language: render_mode specular_* all look the same

IDK, may be they aren't implemented yet, but may be it is also a bug.

Please follow the issue template.

well. it does not look like a driver issue.

well. it does not look like a driver issue.

Maybe you can let developers judge that. :)

this is properly implemented now, closing.


Update SonarCloud components to the latest available

Description of the change

resolve #197

Type of change

[ ] Bug fix (non-breaking change that fixes an issue)
[ ] New feature (non-breaking change that adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] Maintenance
[ ] New release

Related issues

Shortcut stories and GitHub issues (delete irrelevant)

Chore #197

Checklists
Development

[ ] Lint rules pass locally
[ ] The code changed/added as part of this pull request has been covered with tests
[ ] All tests related to the changed code pass in development

Code review

[ ] This pull request has a descriptive title and information useful to a reviewer. There may be a screenshot or screencast attached
[ ] "Ready for review" label attached to the PR and reviewers assigned
[ ] Issue from task tracker has a link to this pull request
[ ] Changes have been reviewed by at least one other engineer

@matux , thank you!


Enable Layout Preview support

Android Studio supports the widget. No reason to disable it in the preview.

See also: http://b.android.com/198437

Thanks a lot for looking this up. That was legacy code from Eclipse era, doesn't make sense now.


Call stack context menu option sends internal URL

This is what I get for a script with a sourceReference and path:

@roblourens and what would you expect to get in that case? Only the path?

Yeah, I think so. But then I don't know what to expect if there is a sourceReference, but no path. Maybe just the sourceReference. I'd also be ok with just getting the sourceReference whenever it's set, whether or not there's a path, since we have a pattern of the sourceReference taking precedence over the path.
Getting debug://internal feels like I'm seeing an implementation detail, but I could totally work with that too if it's never going to change.

@roblourens I changed it for internal modules to return path if present otherwise return source reference. Fell free to edit here https://github.com/Microsoft/vscode/blob/master/src/vs/workbench/parts/debug/electron-browser/debugViewer.ts#L295


Indicate Gradle's continued progress on build summary line

Subset work from issue https://github.com/gradle/gradle/issues/1609.
Expected Behavior
The build summary line will contain the elapse time since the start of the build phase:
<========-----> 62% INITIALIZING [3.4s]
<========-----> 62% CONFIGURING [12s]
<========-----> 62% EXECUTING [3.2m]

Current Behavior
The elapsed time isn't shown.

Here are two possibilities:

As describe in the description of the issue: https://asciinema.org/a/4dopy383rq0b7j06icokc9zmj
Following a scale of 3 digits: https://asciinema.org/a/77mwfpy18j7lkz7vgwh47b9x4


Restore command is hanging after logged as success

I have noticed that the sqlcmd command is hanging on the restore, although accoridng to the logs (on both server and the client containers) the restore is complete.
RESTORE DATABASE successfully processed 58496 pages in 1.332 seconds (343.088 MB/sec).

After the above message is logged, sqlcmd is still running for 10min or longer depending on the machine paramaters.
I have followed documentaion for restore and still seeing the same issue, is that expected?
After further investigation it seems to me that the database is fully restored and operational after the message is logged, so I'm not sure what exactly is it doing and how to stop it.
Waiting this long for restoring a tiny database is not what we expected and we are looking for a solution. Any insight would appriciated.

I had the same issue - it's like the command never says it's done.  Doing an exec to shell and killing the restore process would continue and the database would work fine.
I found using the mssql-tools version 18 resolves the issue and tweaked my dockerfile.
`FROM mcr.microsoft.com/mssql/server:2022-latest
USER root
RUN apt-get update &&
ACCEPT_EULA=Y apt-get install mssql-tools18 unixodbc-dev -y
USER mssql`
The sqlcmd path for tools 18 is /opt/mssql-tools18/bin/sqlcmd
And you'll most likely need to pass -C to your sqlcmd to use 'Trust Server Certificate'.

@ZacUSNYR thank you for sharing this, I can confirm that using mssql-tools version 18 resolves the issue. Many thanks!


[WelcomeUX] Request: Option to remove directory from "Recent" section if it doesn't exist

VSCode Version: 1.10.2
OS Version: MacOS 10.12.3

Suggestion:

Welcome page has list of recent items. If a item has been removed from the file system. When clicking on the item in welcome page, the dialog box pops up as it does currently warning you that the path does not exist.
However I'm suggesting that a second button be added to that dialog box called "Remove" to remove that single item from recent list.

Would be a nice and simplified way to remove remove directories from the welcome page 😄

It is removed after you click on it, the Welcome page doesn't refresh, you have to close and reopen it to get the updated list.


Update for Read me

Freelance Per Hour - A free to join jobs board specifically for Freelancers, full/part time and freelnace work.

Wow this looks like a great one. Merging.


Pop up comment menu by right clicking on last-played stone

Implements the request in issue #172.

LGTM, this feature is something I never I missed!


HTTP Error 400: FIRST TIME USER PLEASE DONT BAN

Firstly, for someone who doesn't know anything about coding, the youtube dl environment is extremely difficult to understand, you guys sound like you are talking another language and there is no helpful tutorial, so it's very frustrating. It is very new user unfriendly. BUT PLEASE HELP ME! I BEG YOU! I'VE BEEN SPENDING HOUR LOOKING THROUGH EVERY POST MADE ON HERE REGARDING MY ISSUE!!
Basically my error is
youtube-dl -u<EMAIL_ADDRESS>https://www.youtube.com-whatever-video
Type account password and press return [Return]:
NOTE: When I type my password, the screen doesn't show anything being typed. is this normal?
[youtube] Downloading login page
[youtube] Looking up account info
[youtube] Logging in
Warning: Unable to log in: HTTP Error 400: Bad Request I KEEP ON GETITNG THIS ERROR SO FRUSTRATING
So how do I fix this??

By the way this is a private video I'm trying to download!


query error from hudi external table when hudi table created in spark-shell

Steps to reproduce the behavior (Required)

create hudi table in spark-shell:

import scala.collection.JavaConversions._
import org.apache.spark.sql.DataFrame
import org.apache.spark.sql.SaveMode._
import org.apache.spark.sql.types._
import org.apache.spark.sql.types.DataType
import org.apache.spark.sql.Row
import java.sql._
import org.apache.hudi.common.table.HoodieTableConfig._
import org.apache.hudi.config.HoodieWriteConfig._
import org.apache.hudi.config.HoodieStorageConfig._

val rows = Seq(Row(1,true,1,10000L,1.001F,1.0001,Decimal(12345678901234567890.123456789012345678),Date.valueOf("2020-01-01"),Timestamp.valueOf("2020-01-01 00:00:01"),"Top 10 Unsolved Mysteries of Paleontological Dinosaurs, Did You Know?",List(1,2,3,4),"hello".getBytes("utf-8")),Row(2,true,2,20000L,2.002F,2.0002,Decimal(20.02),Date.valueOf("2020-02-01"),Timestamp.valueOf("2020-02-01 02:00:01"),"Xi Jinping, general secretary of the Communist Party of China Central Committee, called on Tuesday for unrelenting efforts in exercising full and rigorous governance over the Party, saying that the CPC will continue to show zero tolerance for corruption.",List(2,3,4,5),"nihao".getBytes("utf-8")),Row(3,true,3,30000L,3.003F,3.0003,Decimal(34230.02),Date.valueOf("2020-03-01"),Timestamp.valueOf("2020-03-01 03:00:01"),"Nation raises caution on overseas packages",List(3,3,3,4),"hi".getBytes("utf-8")),Row(4,true,4,40000L,4.004F,4.0004,Decimal(33453534523520.02435235),Date.valueOf("2020-04-01"),Timestamp.valueOf("2020-04-01 04:00:01"),"Shanghai, Shenzhen register most newly listed firms in 2021",List(4,4,4,4),"hello,world".getBytes("utf-8")),Row(5,true,5,50000L,5.555F,5.0005,Decimal(33453555534523520.555502435235),Date.valueOf("2020-05-01"),Timestamp.valueOf("2020-05-01 05:00:01"),"A total of 4,685 companies have been listed on the A-share market in China as of Dec 31, 2021, with 46 percent of them based in Beijing, Shanghai, Shenzhen, Hangzhou, Suzhou, Guangzhou, Ningbo, Nanjing, Wuxi, and Chengdu, said a report of National Business Daily on Wednesday.",List(5,50,500,5000),"hello,555".getBytes("utf-8")),Row(6,true,6,60000L,6.006F,6.0006,Decimal(66633453534523520.666602435235),Date.valueOf("2020-06-01"),Timestamp.valueOf("2020-06-01 04:00:01"),"The development of enterprises, as well as the push of local governments, has boosted the listings, the report said. For example, in early 2018, Central China''s Hubei province launched a plan to double its listed companies by including the listing of enterprises into the government''s annual performance assessment.",List(6,60,600,6004),"666hello".getBytes("utf-8")),Row(7,true,7,70000L,7.7774F,7.0777,Decimal(777733453534523520.77702435235),Date.valueOf("2020-07-01"),Timestamp.valueOf("2020-07-01 07:00:01"),"Most listed companies in the top 10 cities come from industries such as information technology, electronics, mechanical equipment, medical biology, and electric power equipment, with information technology bearing most listed companies.",List(7,7,7,70),"777".getBytes("utf-8")),Row(8,true,8,80000L,8.888F,8.08888,Decimal(88833453534523520.888802435235),Date.valueOf("2020-08-01"),Timestamp.valueOf("2020-08-01 08:00:01"),"Citi report finds MNC mood in China buoyant",List(8,84,884,88884),"8888world".getBytes("utf-8")),Row(9,true,9,99990L,9.9999F,9.99999,Decimal(9999933453534523520.999902435235),Date.valueOf("2020-09-01"),Timestamp.valueOf("2020-09-01 09:00:09"),"Xi: China, Russia major champions of multilateralism, global justice",List(99,9,999,9999),"9999,world".getBytes("utf-8")),Row(10,false,10,10100000L,10.1001F,10.00010,Decimal(1033453534523520.102435235),Date.valueOf("2020-10-01"),Timestamp.valueOf("2020-10-01 10:10:10"),"Volkswagen deliveries hit by chip shortages",List(10,10,1010,101010),"hello,10".getBytes("utf-8")),Row(11,false,11,1110000L,11.0011F,11.1100011,Decimal(11133453534523520.11102435235),Date.valueOf("2020-11-01"),Timestamp.valueOf("2020-11-01 11:11:01"),"Light installations featuring the tiger, the Chinese zodiac animal for the upcoming lunar year, will be set up in the main plaza.",List(11,111,1111,11111),"hello,111111".getBytes("utf-8")),Row(12,false,12,120000L,12.0012F,12.00012,Decimal(121233453534523520.121202435235),Date.valueOf("2020-12-01"),Timestamp.valueOf("2020-12-01 12:12:12"),"The annual lantern show at Yuyuan Garden, a historic tourist site in Shanghai, will kick off on Tuesday and run through Feb 28.",List(12,1212,121212,121212),"h12d".getBytes("utf-8")),Row(13,null,null,null,null,null,null,null,null,null,null,"null".getBytes("utf-8")),Row(14,null,null,null,null,null,null,null,null," ",List(14,1414,141414,14141414),"1414".getBytes("utf-8")))

val schema =
StructType(
    StructField("uuid", IntegerType, nullable = false).withComment("comment uuid") ::
    StructField("col_boolean", BooleanType, nullable = true).withComment("comment col_boolean") ::
    StructField("col_int", IntegerType, nullable = true).withComment("comment col_int") ::
    StructField("col_long", LongType, nullable = true).withComment("comment col_long") ::
    StructField("col_float", FloatType, nullable = true).withComment("comment col_float") ::
    StructField("col_double", DoubleType, nullable = true).withComment("comment col_double") ::
    StructField("col_decimal", DecimalType(38,18), nullable = true).withComment("comment col_decimal") ::
    StructField("col_date", DateType, nullable = true).withComment("comment col_date") ::
    StructField("col_timestamp", TimestampType, nullable = true).withComment("comment col_timestamp") ::
    StructField("col_string", StringType, nullable = true).withComment("comment col_string") ::
    StructField("col_array", ArrayType(IntegerType, true) , nullable = true).withComment("comment col_array") ::
    StructField("col_binary", BinaryType , nullable = true).withComment("comment col_binary") :: Nil)
val df: DataFrame = spark.createDataFrame(rows, schema)

df.write.format("hudi").
  option("hoodie.table.name", "hudi_parquet_gzip_spark_shell").
  option("hoodie.datasource.write.precombine.field", "uuid").
  option("hoodie.datasource.write.recordkey.field", "uuid").
  option("hoodie.datasource.write.table.type", "COPY_ON_WRITE").
  option("hoodie.table.base.file.format", "PARQUET").
  option("hoodie.parquet.compression.codec", "GZIP").
  mode(Overwrite).
  saveAsTable("hudi_db.hudi_parquet_gzip_spark_shell")
spark.sql("select * from  hudi_db.hudi_parquet_gzip_spark_shell").show(false)

select hudi table in spark-sql ok:

spark-sql> select * from hudi_db.hudi_parquet_gzip_spark_shell order by uuid;
20220324163859449<PHONE_NUMBER>3859449_0_11	1		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	1	true	1	10000	1.0011.0001<PHONE_NUMBER>1234567000.000000000000000000	2020-01-01	2020-01-01 00:00:01	Top 10 Unsolved Mysteries of Paleontological Dinosaurs, Did You Know?	[1,2,3,4]	hello
20220324163859449<PHONE_NUMBER>3859449_0_12	2		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	2	true	2	20000	2.0022.0002	20.020000000000000000	2020-02-01	2020-02-01 02:00:01	Xi Jinping, general secretary of the Communist Party of China Central Committee, called on Tuesday for unrelenting efforts in exercising full and rigorous governance over the Party, saying that the CPC will continue to show zero tolerance for corruption.	[2,3,4,5]	nihao
20220324163859449<PHONE_NUMBER>3859449_0_3	3		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	3	true	3	30000	3.0033.0003	34230.020000000000000000	2020-03-01	2020-03-01 03:00:01	Nation raises caution on overseas packages	[3,3,3,4]	hi
20220324163859449<PHONE_NUMBER>3859449_0_5	4		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	4	true	4	40000	4.0044.0004<PHONE_NUMBER>3520.023000000000000000	2020-04-01	2020-04-01 04:00:01	Shanghai, Shenzhen register most newly listed firms in 2021	[4,4,4,4]	hello,world
20220324163859449<PHONE_NUMBER>3859449_0_7	5		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	5	true	5	50000	5.5555.0005<PHONE_NUMBER>4523520.000000000000000000	2020-05-01	2020-05-01 05:00:01	A total of 4,685 companies have been listed on the A-share market in China as of Dec 31, 2021, with 46 percent of them based in Beijing, Shanghai, Shenzhen, Hangzhou, Suzhou, Guangzhou, Ningbo, Nanjing, Wuxi, and Chengdu, said a report of National Business Daily on Wednesday.	[5,50,500,5000]	hello,555
20220324163859449<PHONE_NUMBER>3859449_0_1	6		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	6	true	6	60000	6.0066.0006<PHONE_NUMBER>4523520.000000000000000000	2020-06-01	2020-06-01 04:00:01	The development of enterprises, as well as the push of local governments, has boosted the listings, the report said. For example, in early 2018, Central China''s Hubei province launched a plan to double its listed companies by including the listing of enterprises into the government''s annual performance assessment.	[6,60,600,6004]	666hello
20220324163859449<PHONE_NUMBER>3859449_0_10	7		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	7	true	7	70000	7.7774	7.0777<PHONE_NUMBER>34523520.000000000000000000	2020-07-01	2020-07-01 07:00:01	Most listed companies in the top 10 cities come from industries such as information technology, electronics, mechanical equipment, medical biology, and electric power equipment, with information technology bearing most listed companies.	[7,7,7,70]	777
20220324163859449<PHONE_NUMBER>3859449_0_2	8		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	8	true	8	80000	8.8888.08888<PHONE_NUMBER>4523520.000000000000000000	2020-08-01	2020-08-01 08:00:01	Citi report finds MNC mood in China buoyant	[8,84,884,88884]	8888world
20220324163859449<PHONE_NUMBER>3859449_0_13	9		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	9	true	9	99990	9.9999	9.99999<PHONE_NUMBER>534523000.000000000000000000	2020-09-01	2020-09-01 09:00:09	Xi: China, Russia major champions of multilateralism, global justice	[99,9,999,9999]	9999,world
20220324163859449<PHONE_NUMBER>3859449_0_14	10		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	10	false	10	10100000	10.1001	10.0001<PHONE_NUMBER>523520.100000000000000000	2020-10-01	2020-10-01 10:10:10	Volkswagen deliveries hit by chip shortages	[10,10,1010,101010]	hello,10
20220324163859449<PHONE_NUMBER>3859449_0_4	11		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	11	false	11	1110000	11.0011	11.1100011<PHONE_NUMBER>4523520.000000000000000000	2020-11-01	2020-11-01 11:11:01	Light installations featuring the tiger, the Chinese zodiac animal for the upcoming lunar year, will be set up in the main plaza.	[11,111,1111,11111]	hello,111111
20220324163859449<PHONE_NUMBER>3859449_0_6	12		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	12	false	12	120000	12.0012	12.00012<PHONE_NUMBER>34523520.000000000000000000	2020-12-01	2020-12-01 12:12:12	The annual lantern show at Yuyuan Garden, a historic tourist site in Shanghai, will kick off on Tuesday and run through Feb 28.	[12,1212,121212,121212]	h12d
20220324163859449<PHONE_NUMBER>3859449_0_8	13		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	13	NULL	NULL	NULL	NULLNULL	NULL	NULL	NULL	NULL	NULL	null
20220324163859449<PHONE_NUMBER>3859449_0_9	14		8363b295-d18e-4ae1-9766-039dc7675f34-0_0-33-1617_20220324163859449.parquet	14	NULL	NULL	NULL	NULLNULL	NULL	NULL	NULL	 	[14,1414,141414,14141414]	1414
Time taken: 1.139 seconds, Fetched 14 row(s)

desc formatted hudi table:

spark-sql> desc formatted hudi_db.hudi_parquet_gzip_spark_shell;
uuid	int	comment uuid
col_boolean	boolean	comment col_boolean
col_int	int	comment col_int
col_long	bigint	comment col_long
col_float	float	comment col_float
col_double	double	comment col_double
col_decimal	decimal(38,18)	comment col_decimal
col_date	date	comment col_date
col_timestamp	timestamp	comment col_timestamp
col_string	string	comment col_string
col_array	array<int>	comment col_array
col_binary	binary	comment col_binary

# Detailed Table Information
Database	hudi_db
Table	hudi_parquet_gzip_spark_shell
Owner	root
Created Time	Thu Mar 24 16:39:32 CST 2022
Last Access	UNKNOWN
Created By	Spark 3.1.2
Type	MANAGED
Provider	hudi
Statistics	439454 bytes
Location	hdfs://emr-header-1.cluster-49155:9000/user/hive/warehouse/hudi_db.db/hudi_parquet_gzip_spark_shell
Serde Library	org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
InputFormat	org.apache.hadoop.mapred.SequenceFileInputFormat
OutputFormat	org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
Storage Properties	[hoodie.datasource.write.precombine.field=uuid, hoodie.table.base.file.format=PARQUET, hoodie.parquet.compression.codec=GZIP, hoodie.datasource.write.recordkey.field=uuid, hoodie.table.name=hudi_parquet_gzip_spark_shell, hoodie.datasource.write.table.type=COPY_ON_WRITE]
Time taken: 0.092 seconds, Fetched 28 row(s)

create hudi external table and select :

create external table ex_hudi_tbl_parquet_gzip (
 uuid int
 ,col_boolean boolean
 ,col_int int
 ,col_long bigint
 ,col_float float
 ,col_double double
 ,col_decimal decimal(38,18)
 ,col_date date
 ,col_string string
 ,col_array array<int>
 ,col_binary varchar(200))
ENGINE=hudi
properties (
"resource" = "hudi_emr_tn",
"table" = "hudi_parquet_gzip_spark_shell",
"database" = "hudi_db");

mysql> select * from ex_hudi_tbl_parquet_gzip;
ERROR 1064 (HY000): com.starrocks.common.DdlException: get partition detail failed: com.starrocks.common.DdlException: get hive partition meta data failed: unsupported file format [org.apache.hadoop.mapred.SequenceFileInputFormat]

Expected behavior (Required)
query return the right result
Real behavior (Required)
query return error
StarRocks version (Required)

You can get the StarRocks version by executing SQL select current_version()

mysql> select current_version();
+------------------------+
| current_version()      |
+------------------------+
| QA_TEST_MASTER ac2c40e |
+------------------------+
1 row in set (0.00 sec)

i will fix it


Fix Mac OS compilation

on my MacbookPro (Mac OS 13 and 14) it did not match
It looks outdated may be for Carbon Mac
On Tue, Oct 3, 2023 at 4:13 PM arvanus @.***> wrote:

@.**** commented on this pull request.
In src/config/Config.h
https://github.com/mariuz/flamerobin/pull/328#discussion_r1344084879:

@@ -44,7 +44,7 @@ class wxFileConfig;

//! Do not instantiate objects of this class. Use config() function (see below).
-#if defined(UNIX) && !defined(WXMAC_OSX)
isn't WXMAC_OSX directive used anymore?
Thank you
—
Reply to this email directly, view it on GitHub
https://github.com/mariuz/flamerobin/pull/328#pullrequestreview-1655183648,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADITO7S4D5AG445VF7572VLX5QFNXAVCNFSM6AAAAAA5Q65PROVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMYTMNJVGE4DGNRUHA
.
You are receiving this because you authored the thread.Message ID:
@.***>

So could you adjust to keep this older directive too?

Don't know if we have users using this OS

With the release of macOS 10.15 Catalina, the Carbon API was officially
discontinued and removed, leaving Cocoa as the sole primary API for
developing macOS applications. Apple Inc.
Current Mac OS version is 14.0
On Tue, Oct 3, 2023 at 4:46 PM arvanus @.***> wrote:

Don't know if we have users using this OS
—
Reply to this email directly, view it on GitHub
https://github.com/mariuz/flamerobin/pull/328#issuecomment-1745013237,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADITO7SVNGJMOMSIBSRHCSDX5QJJ3AVCNFSM6AAAAAA5Q65PROVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONBVGAYTGMRTG4
.
You are receiving this because you authored the thread.Message ID:
@.***>


Function call error

Issue description
Using functionary models with function calling enabled throws error frequently
Expected Behavior
I expect the functionary model to respond normally to queries when function calling is enabled.
Actual Behavior
Often, even without doing anything requiring the use of a function, I get the error:
LlamaFunctionCallValidationError: Function name "all" is not in the supplied functions object
at FunctionCallGrammar.parseFunctionCall (file:///C:/Users/chris/Desktop/chat/node_modules/node-llama-cpp/dist/evaluator/LlamaChat/utils/FunctionCallGrammar.js:35:19)
at LlamaChat.generateResponse (file:///C:/Users/chris/Desktop/chat/node_modules/node-llama-cpp/dist/evaluator/LlamaChat/LlamaChat.js:365:59)
at async LlamaChatSession. (file:///C:/Users/chris/Desktop/chat/node_modules/node-llama-cpp/dist/evaluator/LlamaChatSession/LlamaChatSession.js:108:91)
at async withLock (file:///C:/Users/chris/Desktop/chat/node_modules/lifecycle-utils/dist/withLock.js:36:16)
at async LlamaChatSession.promptWithMeta (file:///C:/Users/chris/Desktop/chat/node_modules/node-llama-cpp/dist/evaluator/LlamaChatSession/LlamaChatSession.js:88:16)
at async LlamaChatSession.prompt (file:///C:/Users/chris/Desktop/chat/node_modules/node-llama-cpp/dist/evaluator/LlamaChatSession/LlamaChatSession.js:72:34)
at async file:///C:/Users/chris/Desktop/chat/test.js:24:13 {
functions: {
random: {
description: 'Generates a random number',
params: undefined,
handler: [Function: handler]
}
},
chatWrapper: FunctionaryChatWrapper {
settings: {
functions: {
call: {
optionalPrefixSpace: true,
prefix: '\n<|from|>assistant\n<|recipient|>',
paramsPrefix: '\n<|content|>',
suffix: '\n'
},
result: {
prefix: '<|from|>{{functionName}}\n<|recipient|>all\n<|content|>',
suffix: '\n'
}
}
},
wrapperName: 'Functionary'
},
callText: '\n<|from|>assistant\n<|recipient|>all\n<|content|>\n\n\n\n\n'
}
Steps to reproduce
import { getLlama, LlamaChatSession, defineChatSessionFunction } from 'node-llama-cpp';
const llama = await getLlama();
const model = await llama.loadModel({
modelPath: 'functionary-7b-v2.1.q4_0.gguf'
});
const context = await model.createContext();
const session = new LlamaChatSession({
contextSequence: context.getSequence()
});
const options = {
functions: {
random: defineChatSessionFunction({
description: "Generates a random number",
handler () {
return Math.random();
}
})
}
};
// This works
console.log(await session.prompt('Who is Chuck Norris?', options));
// This throws an error
console.log(await session.prompt('How to list files in a directory on Windows', options));
My Environment
Windows 10
Ryzen 5600X
Node.js v21.7.2
node-llama-cpp v3.0.0-beta.15
https://huggingface.co/meetkai/functionary-7b-v2.1-GGUF
Additional Context
I know almost nothing about LLMs so I don't really understand what is happening under the hood, and I may be doing something wrong, but I do know how to poke around, so I checked out the functions listed in the stack trace, along with the functionary chat wrapper, and this is what I found:
There is a stop pattern in FunctionaryChatWrapper which should be stopping function evaluation mode that looks like this: "\n<|from|>assistant\n<|recipient|>all\n<|content|>".
The problem is that the first token that comes in on the response is 28705 (not shown in callText, but verified by logging in the generateResponse() loop), which according to the tokenizer.json on HuggingFace for this model is the character "▁" (Lower One Eighth Block). The first character expected is 13 (\n). Therefore this pattern is not being recognized, and function evaluation mode is not being stopped.
I've found two quick workarounds:

Skip the offending token in the loop in generateResponse()
for await (const token of evaluationIterator) {
if (token === 28705 && generatedTokens === 0)
continue;
…
}

Add the necessary stop pattern in FunctionaryChatWrapper.js to ignoreStartText and disengageInitiallyEngaged like so: [
LlamaText("\n<|from|>assistant\n<|recipient|>all\n<|content|>"),
LlamaText(new SpecialTokensText("\n<|from|>assistant\n<|recipient|>all\n<|content|>")),
LlamaText("\n\n<|from|>assistant\n<|recipient|>all\n<|content|>"),
LlamaText(new SpecialTokensText("\n\n<|from|>assistant\n<|recipient|>all\n<|content|>")),
LlamaText("▁\n<|from|>assistant\n<|recipient|>all\n<|content|>"),
LlamaText(new SpecialTokensText("▁\n<|from|>assistant\n<|recipient|>all\n<|content|>"))
]

Relevant Features Used

[ ] Metal support
[ ] CUDA support
[ ] Grammar

Are you willing to resolve this issue by submitting a Pull Request?
No, I don’t have the time and I’m okay to wait for the community / maintainers to resolve this issue.

I found the issue and will release a fix in the next few days.
At the moment, you can use a newer Functionary model version that doesn't have this issue


Add item defaults argument

This PR adds item defaults argument
This should be merged after https://github.com/sublimelsp/LSP/pull/2194 is merged

ping (:

ping :)

merged :see_no_evil:


Fix fontVariant style

Currently, when passing fontVariant to a Text component, nothing happens (on web it adds font-variant attribute in the node).
It happens because this style property is not whitelisted as a valid style prop.
Adding it to the whitelist resolves the issue

Amazing - Thanks!


Add Unread Action Indicator

@marcaaron @roryabraham
Details
Created a "last unread" indicator on the Reports View. It appears on the top of the last unread action and fades out after a set time.
It doesn't show up when the report is active and receives a new message.
About scrollToIndex:
As mentioned on the issue page, I couldn't find a trivial solution to this, since scrollToIndex isn't precise at all with items with dynamic height. I still want to try to calculate the height and use it with scrollToOffset(), but I thought it would be better to create a PR with the rest of the code first.
@shawnborton
Animation info:

Timeout time: 3000 ms;
Duration: 500 ms;
Easing: Easing.ease;

Just for reference if you want me to try some other values out.
Notes:

I actually did not want to use position: absolute, and it was working fine everywhere just using height: 0. But it seems like ios <Text /> doesn't like it very much, since it was not showing up (the line was showing, the text wasn't). It was working everywhere else;
There is a behavior that I really dislike right now. On small screens, when the Sidebar is open, and a new message is received on the active report, it is set as read, and the indicator doesn't show up (if the user re-enters the report). I actually wrote some code around it with withWindowDimensions, and adding the IS_SIDEBAR_SHOWN onyx prop, but decided to remove it. I believe the best solution would be to start changing the code deeper down, to make sure an action is not set as read if isSmallScreen and IS_SIDEBAR_SHOWN === true. It would still need some refactoring on the ReportActionsView code, but I believe it is the best approach;
Maybe anticipating a question here: The renderItem() component is wrapped inside a <View /> instead of a <React.Fragment /> for compatibility between the native and web/desktop <InvertedFlatList />. If we don't do it, the indicator actually shows up on the bottom of the message instead of on the top when on native.

Fixed Issues
Fixes #1498
Tests

Make sure the user/group that is sending a new message is not active;
Receive a new message;
Open the report, it should show the indicator on the top of the last unread message;
Verify the indicator fades out after a few seconds;
If another message is sent while the report is active, verify the indicator doesn't show up again.

Tested On

[x] Web
[x] Mobile Web
[x] Desktop
[x] iOS
[x] Android

Screenshots
Observation: After I got all the images, I realized the NEW text was not bold as on the reference, as well as the spacing was maybe too high.
Because it takes a while to take new images, and it is very simple, I just changed the Mobile-Web image after making the changes. I hope it is ok.
So, please, the text IS BOLD. Sorry about that.
Web

Mobile Web

Desktop

iOS

Android

@shawnborton
New results:

Looks great, thanks for the quick work!

@roryabraham
I'm having some unexpected problems when trying to receive just the active report from the store, as you suggested.
I pushed a commit with the only intention of maybe someone helping me with the debug, I know it has a lot of console.logs but they will all be gone soon.
Problem:

This is the console.log I'm using to debug.
console.log('isActive', this.props.reportID, 'fromWhere', this.props.report);
As we can see in these logs (hopefully we can see after some zoom, haha), when a message is sent and I select the report with this new message, the report retrieved from the Onyx store with currentlyViewedReportID does not get updated.
It's probably a problem with the ONYXKEYS.CURRENTLY_VIEWED_REPORTID declaration.

Just realized that the key function on withOnyx takes the prop as input, and we can just destructure the reportID instead of composing another withOnyx on top to get the currentlyViewedReportID.
This solves the problem.
export default withOnyx({
    report: {
        key: ({reportID}) => `${ONYXKEYS.COLLECTION.REPORT}${reportID}`,
    },
    reportActions: {
        key: ({reportID}) => `${ONYXKEYS.COLLECTION.REPORT_ACTIONS}${reportID}`,
        canEvict: props => !props.isActiveReport,
    },
    session: {
        key: ONYXKEYS.SESSION,
    },
})(ReportActionsView);

@roryabraham all yours


apiserver develops a dangling pod w/o name

@davidopp After creating and deleting a bunch of unique-named pause pods, the master ended up with a zombie? pod entry:

% gcloud preview container pods --cluster=${PROJECT} list
POD                 IP                  CONTAINER(S)        IMAGE(S)            HOST                                                               LABELS              STATUS
k8s-prod5-node-1.c.mohr-instance-manager.internal/<IP_ADDRESS>                 Unknown

Here's the 1 node's view:

node-1% docker ps
CONTAINER ID        IMAGE                   COMMAND               CREATED             STATUS              PORTS                      NAMES
9558807f5bd4        kubernetes/pause:go     "/pause"              About an hour ago   Up About an hour                               k8s_pause-pod-a3c58ab1.fd6cd67a_pause-pod-a3c58ab1.default.etcd_2896301e-a7f7-11e4-a2ec-42010af0de1f_70214b24
f4a4f659dc37        kubernetes/pause:go     "/pause"              About an hour ago   Up About an hour    <IP_ADDRESS>:15670->15670/tcp   k8s_net.e468acc9_pause-pod-a3c58ab1.default.etcd_2896301e-a7f7-11e4-a2ec-42010af0de1f_286dfd30
3eb6b397cbfe        google/cadvisor:0.8.0   "/usr/bin/cadvisor"   About an hour ago   Up About an hour                               k8s_cadvisor.54c805f9_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_a7d38033
4e76f64b66ff        kubernetes/pause:go     "/pause"              About an hour ago   Up About an hour    <IP_ADDRESS>:4194->8080/tcp     k8s_net.1509ae25_cadvisor-agent.default.file_cadvisormanifes12uqn2ohido76855gdecd9roadm7l0_706122ee

And etcd's db dump on the master VM:
% curl -s -L http://<IP_ADDRESS>:4001/v2/keys/registry/pods/default | python -m json.tool
{
"action": "get",
"node": {
"createdIndex": 26,
"dir": true,
"key": "/registry/pods/default",
"modifiedIndex": 26,
"nodes": [
{
"createdIndex": 2266,
"key": "/registry/pods/default/pause-pod-3da11ec1",
"modifiedIndex": 2266,
"value": "{"kind":"Pod","creationTimestamp":null,"apiVersion":"v1beta1","desiredState":{"manifest":{"version":"v1beta2","id":"","volumes":null,"containers":null,"restartPolicy":{}}},"currentState":{"manifest":{"version":"","id":"","volumes":null,"containers":null,"restartPolicy":{}},"host":"k8s-prod5-node-1.c.mohr-instance-manager.internal"}}"
}
]
}
}
Part of long-running masters: #3936

FWIW, apparently not just a one-off.  There are now 3 such entries after more pod creation/deletion.

I saw a user complain about this about 2 weeks ago.  So, it is probably not
a newly introduced problem.
On Thu, Jan 29, 2015 at 3:21 PM, Alex Mohr<EMAIL_ADDRESS>wrote:

FWIW, apparently not just a one-off. There are now 3 such entries after
more pod creation/deletion.
—
Reply to this email directly or view it on GitHub
https://github.com/GoogleCloudPlatform/kubernetes/issues/3950#issuecomment-72124869
.

Yeah, I've seen this occasionally.  We should dig in and sort out what the issue is.  @alex-mohr sounds like you have a decent repro?

Repro would presumably happen via script in #3936?

I haven't been able to reproduce this issue, so I'd like to get some dumb questions out first :)
Here is what I did:

Create a cluster with one node.
gcloud preview container clusters create onenode --num-nodes 1 --machine-type n1-standard-1
Launch 3 processes running the script from #3936

So far I haven't seen any dangling pods, but most of the pause-pods are stuck at pending state and only one is running at any given time. This doesn't seem right because multiple pods should be able to be scheduled on the node at the same time. Did I miss something?

Thanks for taking a look!
Your cluster create looks the same.
The script from #3936 uses a fixed --port=3009, so running 3 unchanged copies will result in 3 pods all competing for that port on the host, resulting in at most 1 being scheduled at a time with the others pending.  You'd need to use different ports for each.

FWIW, I updated my script for more parallelization: http://pastebin.com/7ZBcXX83
It picks random ports and launches N=20 pause pods at a time.
I setup a fresh cluster from 0.10.0 with 3 nodes and re-ran that pastebin script.  After 15 iterations, it got stuck because there was an error creating 1 pod:
ERROR: F0205 13:55:36.913799    7921 create.go:78] 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0]
After aborting, there were ~15 zombie pods this time:
gcloud preview container pods --cluster=prod10a list
POD                 IP                  CONTAINER(S)        IMAGE(S)                           HOST                                                                 LABELS              STATUS
k8s-prod10a-node-2.c.mohr-instance-manager.internal/<IP_ADDRESS>                 Unknown
k8s-prod10a-node-2.c.mohr-instance-manager.internal/<IP_ADDRESS>                 Unknown
[etc]

Oops, yes, you were right about the port number.
I modified the script and used 5 processes with 30 iteration each. I've still not encountered the dangling pod problem, even though there seem to be some other issues.

Deleting a pod sometimes fails. Not sure if it's user's responsibility to retry, but it could be.
After running for a while, scheduling (or status update) became extremely slow. The pods were stuck at pending for > 3 minutes before changing to running.

@alex-mohr, how many concurrent processes were you running and how long did they run for you to produce the dangling pods?

I missed your new comment before posting mine. I will try the new script and report back. Thanks!

@yujuhong 2 processes this time and it took a couple of minutes.

FYI, I was able to reproduce the issue after a longer run. I will start digging around and see what the root cause is.

This is a long-standing problem. See, for instance, #1892.

Here is an update with some more information but much progress:

I reproduced the issue on the GCE cluster and changed the logging level to 7.
As mentioned in #3939, kube-apiserver.log encounters etcd errors periodically when creating pods E0209 18:40:45.937988    4964 errors.go:52] apiserver received an error that is not an api.Status: 501: All the given peers are not reachable (Tried to connect to each peer twice and failed) [0]
The phantom pods were created, scheduled, run, and killed as observed from the scheduler and the apiserver log. After the pod has been killed, it somehow turned into a phantom pod.
Pods frequently failed (exit code 2) and were restarted/recreated. When I turned off the automatic restart, many pods ended up in the failed state before any phantom pod appeared.
I have seen a pod being scheduled after the API server supposed killed the pod.

I suspect this is an etcd issue. As mentioned in the previous comment, pod was still being scheduled after the pod has supposedly been deleted. Here is a snippet of such a pod:
kube-scheduler.log:I0210 01:16:41.316617    5233 factory.go:136] glog.v2 --> About to try and schedule pod pause-pod-1616b21
kube-scheduler.log:I0210 01:16:41.316668    5233 scheduler.go:71] Attempting to schedule: &{{ } {pause-pod-1616b21  default /api/v1beta1/pods/pause-pod-1616b21 78111d6c-b0c2-11e4-a4b9-42010af0b14c 4043 2015-02-10 01:16:41 +0000 UTC map[name:pause-pod-1616b21] map[]} {[] [{pause-container kubernetes/pause []  [{ 12490 12490 TCP }] [] {map[]} [] <nil> <nil> /dev/termination-log false IfNotPresent {[] []}}] {0xaec2a0 <nil> <nil>} ClusterFirst map[] } {Pending     map[]}}
kube-scheduler.log:I0210 01:16:41.317215    5233 priorities.go:67] pause-pod-1616b21 -> kubernetes-minion-1.c.cloud-containers-yjhong.internal: Least Requested Priority, AbsoluteRequested: (0, 0) / (1000,<PHONE_NUMBER>) Score: (10, 10)
kube-scheduler.log:I0210 01:16:41.317244    5233 priorities.go:67] pause-pod-1616b21 -> kubernetes-minion-2.c.cloud-containers-yjhong.internal: Least Requested Priority, AbsoluteRequested: (0, 0) / (1000,<PHONE_NUMBER>) Score: (10, 10)
kube-scheduler.log:I0210 01:16:41.317622    5233 factory.go:274] Attempting to bind pause-pod-1616b21 to kubernetes-minion-1.c.cloud-containers-yjhong.internal
kube-scheduler.log:I0210 01:18:01.785769    5233 factory.go:136] glog.v2 --> About to try and schedule pod pause-pod-1616b21
kube-scheduler.log:I0210 01:18:01.785796    5233 scheduler.go:71] Attempting to schedule: &{{ } {pause-pod-1616b21  default /api/v1beta1/pods/pause-pod-1616b21?namespace=default 78111d6c-b0c2-11e4-a4b9-42010af0b14c 4022 2015-02-10 01:16:41 +0000 UTC map[name:pause-pod-1616b21] map[]} {[] [{pause-container kubernetes/pause []  [{ 12490 12490 TCP }] [] {map[]} [] <nil> <nil> /dev/termination-log false IfNotPresent {[] []}}] {0xaec2a0 <nil> <nil>} ClusterFirst map[] } {Running   <IP_ADDRESS> <IP_ADDRESS> map[POD:{{<nil> 0xc2082c3ae0 <nil>} 0 <IP_ADDRESS> kubernetes/pause:latest docker://6c4579af347b649857e915521132f15a06186d73faa62145e3eeeb6be0e97c27 docker://67034a7b2350dd1dd56605691dfd8667431a5affb3dde4ce40ba4bd33529a58b} pause-container:{{<nil> 0xc2082c3ca0 <nil>} 0  kubernetes/pause docker://6c4579af347b649857e915521132f15a06186d73faa62145e3eeeb6be0e97c27 docker://ef2ccf0757a397928b09feff5f0dbe4de865ac5c4a450eb1552b28f356a405a9}]}}
kube-scheduler.log:I0210 01:18:01.786140    5233 priorities.go:67] pause-pod-1616b21 -> kubernetes-minion-2.c.cloud-containers-yjhong.internal: Least Requested Priority, AbsoluteRequested: (0, 0) / (1000,<PHONE_NUMBER>) Score: (10, 10)
kube-scheduler.log:I0210 01:18:01.786187    5233 priorities.go:67] pause-pod-1616b21 -> kubernetes-minion-1.c.cloud-containers-yjhong.internal: Least Requested Priority, AbsoluteRequested: (0, 0) / (1000,<PHONE_NUMBER>) Score: (10, 10)
kube-scheduler.log:I0210 01:18:01.786267    5233 factory.go:274] Attempting to bind pause-pod-1616b21 to kubernetes-minion-2.c.cloud-containers-yjhong.internal
kube-apiserver.log:I0210 01:20:56.586529    5045 handlers.go:108] GET /api/v1beta1/pods/pause-pod-1616b21?namespace=default: (2.512143ms) 200
kube-apiserver.log:I0210 01:20:56.798084    5045 handlers.go:108] DELETE /api/v1beta1/pods/pause-pod-1616b21?namespace=default: (168.413613ms) 200
kube-scheduler.log:I0210 01:32:01.628871    5233 factory.go:136] glog.v2 --> About to try and schedule pod pause-pod-1616b21
kube-scheduler.log:I0210 01:32:01.628893    5233 scheduler.go:71] Attempting to schedule: &{{ } {pause-pod-1616b21  default /api/v1beta1/pods/pause-pod-1616b21?namespace=default 78111d6c-b0c2-11e4-a4b9-42010af0b14c 4022 2015-02-10 01:16:41 +0000 UTC map[name:pause-pod-1616b21] map[]} {[] [{pause-container kubernetes/pause []  [{ 12490 12490 TCP }] [] {map[]} [] <nil> <nil> /dev/termination-log false IfNotPresent {[] []}}] {0xaec2a0 <nil> <nil>} ClusterFirst map[] } {Unknown     map[]}}
kube-scheduler.log:I0210 01:32:01.629157    5233 priorities.go:67] pause-pod-1616b21 -> kubernetes-minion-1.c.cloud-containers-yjhong.internal: Least Requested Priority, AbsoluteRequested: (0, 0) / (1000,<PHONE_NUMBER>) Score: (10, 10)
kube-scheduler.log:I0210 01:32:01.629259    5233 priorities.go:67] pause-pod-1616b21 -> kubernetes-minion-2.c.cloud-containers-yjhong.internal: Least Requested Priority, AbsoluteRequested: (0, 0) / (1000,<PHONE_NUMBER>) Score: (10, 10)
kube-scheduler.log:I0210 01:32:01.629317    5233 factory.go:274] Attempting to bind pause-pod-1616b21 to kubernetes-minion-2.c.cloud-containers-yjhong.internal

Note that the delete request returned OK (200).
DELETE /api/v1beta1/pods/pause-pod-1616b21?namespace=default: (168.413613ms) 200
However, the key lives and scheduler even attempted to schedule it again (while the pod was in the unknown status).
The content of the key/pod in etcd showed that most of the content has been cleared.
etcdctl --peers=<IP_ADDRESS>:4001 get registry/pods/default/pause-pod-1616b21
{"kind":"Pod","creationTimestamp":null,"apiVersion":"v1beta1","desiredState":{"manifest":{"version":"v1beta2","id":"","volumes":null,"containers":null,"restartPolicy":{}}},"currentState":{"manifest":{"version":"","id":"","volumes":null,"containers":null,"restartPolicy":{}},"host":"kubernetes-minion-2.c.cloud-containers-yjhong.internal"}}

I may add a check after the deletion to make sure that the key was deleted when etcd claimed to have done so.

Okay, I think I've narrowed it down to a race condition between deleting and scheduling a pod. The series of events happened in the following order according to the timestamps in the logs.

The script sends a request to create Pod X
Pod X is created, scheduled, and run on one of the minions.
The script sends a request to delete Pod X
The pod entry (registry/pods/default/X) in the etcd is deleted.
The atomic update to BoundPods fails because Pod X is nowhere to be found (cause unknown).
Scheduler tries to schedule the Pod X again (I suspect the scheduler caches the pods so the entries were stale?)
Scheduler wants to bind Pod X to a new host. One of the binding steps involves calling setPodHostTo() to perform an atomic update on X. Because Pod X does not exist, a new key entry with mostly empty content is created.

I confirmed that the pod deletion in step (4) was successful by adding code to retrieve the deleted entry immediately after the deletion. For step (7), the implicit creation is done in AtomicUpdate() in etcd_tools.go (comment: // First time this key has been used, try creating new value.).
What remains unknown is that (a) why scheduler was looking at stale pod entries and (b) why Pod X was not in the BoundPods at the time of the deletion. The former seems like the major issue, while the later a minor one.

cc @dchen1107

Cool, thanks for investigation, and result confirms the hyperthesis we had yesterday. cc/ @davidopp about the scheduler.

It is strange that the scheduler wanted to schedule the pod again. The pod had been running for a while at that time and the pod entry couldn't be that stale (?). I am going to make a wild guess and say that this may be related to #4188, in which the comments suggest that a running pod may flip to pending intermittently. I am ready to be struck down again though... :|

At the least, the binding should not happen if the pod entry does not exist. I will write up a PR for that.

I found a huge bug in update and delete pods, where bindings of same named pods in different namespaces have the wrong bound pod update applied.  That may overlap with this fix, I'm going to send that in after lunch.

PR #4326 is supposed to fix the main symptom -- phantom/dangling pods, which are placeholder pod keys created after the pod has been deleted. The flipping between pending/running status is discussed and to be fixed in #4188.
The BoundPod update failure needs more investigation. In my tests, all pods use the same namespace, so they should not be affected by the bug @smarterclayton posted above.

https://github.com/GoogleCloudPlatform/kubernetes/pull/4329 fixes the cross namespace issue.
----- Original Message -----

PR #4326 is supposed to fix the main symptom -- phantom/dangling pods, which
are placeholder pod keys created after the pod has been deleted. The
flipping between pending/running status is discussed and to be fixed in
#4188.
The BoundPod update failure needs more investigation. In my tests, all pods
use the same namespace, so they should not be affected by the bug
@smarterclayton posted above.

Reply to this email directly or view it on GitHub:
https://github.com/GoogleCloudPlatform/kubernetes/issues/3950#issuecomment-73943692

I am going to close this issue for now, since the main symptom is gone as far as I know. Please re-open it if you can reproduce the issue.


WinUI XmlnsDefinition

How should the XmlnsDefinition be used in WinUI?
In WPF it can be used like an assembly attribute
[assembly: XmlnsDefinition("http://XXXXX/winfx/2006/xaml", "XXXX")]
But in WinUI is not an attribute. Am I missing something?

@MikeHillberg - can you help with this?

WinUI doesn't have an equivalent to the XmlnsDefinition attribute. It'd a great proposal on the repo though.

Thanks for the comment. Will it be added by you?

I'd be happy to open an Issue if you haven't. (I didn't open one already because some people like to open it themselves for tracking purposes.)

Please go ahead. I appreciate it.

I couldn't find an issue for this. Did one ever get created? Please add a link if it did. :)


Reduce PDF size

Compared to the mkdocs-pdf-export-plugin I've noticed that the mkdocs-with-pdf plugin generates much larger PDF files. In my test project (which consists of over 170 pages in size A4) this resulted in a file that was about 3 times the size.
Is there any way to control the PDF output size? Maybe by allowing to reduce the image size (different compression settings) via a configuration parameter?

Same here.
PDF size generated with VS Code Extension: 4.2 MB
PDF size generated with mkdocs-with-pdf: 16.9 MB
Would be great to have the possibility to reduce the file size.

Do you include images multiple times (like logos in the header / footer)? Depending on how they are handled, they might be included multiple times in the resulting PDF which could result in this size difference.


Docker Swarm Deployment

Describe the bug 🪲
Docker Swarm deployment per the documentation (https://open-amt-cloud-toolkit.github.io/docs/2.8/Tutorials/Scaling/docker-swarm/) no longer results in a successful deployment.  It appears the generated swarm.yml file is no longer in a format supported by current Docker engine versions.
To Reproduce 🪜
Tested with Docker Desktop.
Ensure you have the latest docker engine and docker compose installed (both are part of Docker Desktop).  Follow the steps detailed in the above link.  The step deploying the stack ("docker stack deploy...") will result in... "unsupported Compose file version: 1.0"
Expected behavior
A successful swarm deployment which can be used to manage devices.

Docker swarm is no longer a production recommendation