NTRs: Crime classes

For new term requests, please provide the following information:
Preferred term label
aggravated assault
Synonyms
none
Textual definition
Physically abusive behavior in which the aggressor does or attempts to do the following: inflict severe bodily harm on another person with the use of a weapon or by means that are likely to lead to the victim’s death.
Suggested parent term
physically abusive behavior
Attribution
Matthew Diller, William R. Hogan

Preferred term label
arson
Synonyms
none
Textual definition
Abusive behavior in which the aggressor does or attempts to do the following: burn an architectural structure, vehicle, or a material entity owned by another person.

Suggested parent term
physically abusive behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
simple assault
Synonyms
minor assault
Textual definition
Physically abusive behavior in which the aggressor does or attempts to do the following: willfully use physical force against another person without their consent.
Suggested parent term
physically abusive behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
robbery
Synonyms
none
Textual definition
Abusive behavior in which the aggressor does or attempts to do the following: take possession of an entity that belongs to another person by force, threat of force, or violence.
Suggested parent term
abusive behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
vandalism
Synonyms
none
Textual definition
Abusive behavior in which the aggressor does or attempts to do the following: willfully destroy, damage, or deface public or private property without the consent of the owner.

Suggested parent term
sexually abusive behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
is offense of
Synonyms
none
Textual definition
Relation between a behavior and a document that prescribes how people are expected to behave.
Suggested parent term
topObjectProperty
Attribution
Matthew Diller, William R. Hogan
Preferred term label
has suspected perpetrator
Synonyms
none
Textual definition
Relation between a person and a behavior that is an offense of a legal document, such as a law or ordinance, that prescribes how people are expected to behave.
Suggested parent term
topObjectProperty
Attribution
Matthew Diller, William R. Hogan
Preferred term label
curfew ordinance
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that certain people must not leave their home during a given time period.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
breaking curfew
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a local curfew ordinance.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
loitering ordinance
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot idly stand around certain parts of that region without an apparent purpose.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
loitering
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a local loitering ordinance.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about disorderly conduct
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot engage in behavior that disturbs the public peace.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
disorderly conduct
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about disorderly conduct.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
illicit drug regulation
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot possess, consume, or sell some drug.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about gambling
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot participate in a process in which bets are made, either as a person making a bet or a person facilitating the betting (e.g., the card dealer); promote betting activities; influence the outcome of a sporting event or contest in an attempt to win a bet; sell, manufacture, purchase, or possess certain gambling equipment; or possess or transmit information about betting.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
illicit drug use
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates an illicit drug regulation by consuming a drug that has been made illegal.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
sale of illicit drugs
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates an illicit drug regulation by selling or seemingly intending to sell a drug that has been made illegal.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about public intoxication
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot drink in public or appear intoxicated while in public.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
public drunkenness
Synonyms
public intoxication
Textual definition
Behavior in which the suspected perpetrator violates a regulation about public intoxication.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about driving under the influence
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people at or above a specified blood alcohol content level or who have consumed an illicit drug cannot operate a vehicle.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
driving under the influence
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about driving under the influence.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about embezzlement
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot misappropriate or misapplication of money or property that has been entrusted to their care, custody, or control.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
embezzlement
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about embezzlement.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
neglectfully abusive behavior
Synonyms
none
Textual definition
Abusive behavior in which the aggressor does or attempts to do the following: fails to provide for a dependent’s basic needs, such as adequate supervision, food and water, clothing, or housing, through carelessness, indifference, or unwillingness.
Suggested parent term
abusive behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about neglect of a dependent
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot engage in certain neglectfully abusive behavior.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
lesser offense against the family and children
Synonyms
criminal neglect
Textual definition
Behavior in which the suspected perpetrator violates a regulation about neglect of a dependent.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about forgery
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot attempt to alter, copy, or imitate an entity without the consent of the person who owns it with the intention of deceiving or defrauding people.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
forgery
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about forgery.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about fraud
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot attempt to deceive people into giving them something of value or to surrender to them a claimant role they are the bearer of.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
fraud
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about fraud.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
illicit gambling
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about gambling.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
alcohol law
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot manufacture, possess, consume, sell, or transport certain alcoholic beverages, who they are allowed to sell them to, or when they are allowed to sell them.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
violation of alcohol laws
Synonyms
violation of liquor laws
Textual definition
Behavior in which the suspected perpetrator violates an alcohol law.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
manslaughter by negligence law
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes what behaviors that result in another person’s death should be considered negligent.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
manslaughter
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a manslaughter by negligence law.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about motor vehicle theft
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot take a motor vehicle from the possession of another person without that person’s consent.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
motor vehicle theft
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about motor vehicle theft.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about misdemeanor sex offenses
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot expose their genitals, breasts, anus, or buttocks in public, such as through public urination, deliberate “flashing,” or public nudity; or touch another person’s genitals, breasts, anus, or buttocks without their consent.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
misdemeanor sex offense
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about misdemeanor sex offenses.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
possession of drug
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates an illicit drug regulation by possessing a drug that has been made illegal.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about sex work
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot promote or participate in sexual activities in exchange for some entities of value, including soliciting customers or transporting people for such activities, or owning or operating a facility where such activities occur.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
sex work
Synonyms
none
Textual definition
Behavior in which the perpetrator violates a regulation about sex work.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about juvenile runaways
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that juveniles who have run away from home can be detained by police if their parents report them missing.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
runaway
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about juvenile runaways.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about stolen property
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot possess, sell, or buy an entity that has been stolen from another person in an act of larceny, motor vehicle theft, robbery, or theft.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
stolen property
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about stolen property.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about larceny
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot take certain entities from the possession of another person without that person’s consent.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
larceny
Synonyms
theft
Textual definition
Behavior in which the suspected perpetrator violates a regulation about larceny.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about vagrancy
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator or judge, applies to some geographical region, and prescribes that people cannot remain idle in that region or move around in that region without a visible means of support.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
vagrancy
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about vagrancy.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan
Preferred term label
regulation about the carrying or possessing of weapons
Synonyms
none
Textual definition
A document part for a document that is signed by some legislator, applies to some geographical region, and prescribes that people cannot manufacture, sell, transport, possess, or carry certain material entities that can be used as a weapon.
Suggested parent term
document part
Attribution
Matthew Diller, William R. Hogan
Preferred term label
violation of regulation about the carrying or possessing of weapons
Synonyms
none
Textual definition
Behavior in which the suspected perpetrator violates a regulation about the carrying or possessing of weapons.
Suggested parent term
behavior
Attribution
Matthew Diller, William R. Hogan

re. SDOH instruments: "perpetrator" and "victim" ("patient" being somewhat interchangeable with "victim") are used to refer to the persons involved in interpersonal events related to intake and/or patient IPV (intimate partner violence) history

Additionally, "prostitution" and related classes should be changed to "sex work" with "prostitution" as an antiquated synonym

Based on @dexink 's recommendations, I changed all uses of 'prostitution' to 'sex work and 'offender' to 'suspected perpetrator'.

I am not sure about "suspected perpetrator" as label is highly context specific.
I'm currently looking into overlap of proposed terms with other published ontologies, and will report back.

maybe "suspected perpetrator" would be a child of "patient-provided information"? (in the context of the data collection instruments/surveys)

also, "sex work" should be changed to "illicit sex work" as some sex work is legal

Found a resource on GitHub specifically for legal ontologies, in addition to the terms with overlap in ontologies listed in OntoBee and BioPortal: https://github.com/Liquid-Legal-Institute/Legal-Ontologies

Spoke to Bill about some of this; @dillerm, we are getting dangerously close to "shadow classes" with many of these. We may want to reduce all of this to a limited set of classes, e.g., one "ordinance" or "law" class and one behavior class for violating ordinances/laws.

Ok. In the meantime, I will add these to HERO.

A paper I stumbled on that may be helpful (currently or in the future) as it relates to crime classes and medical topics: https://dialnet.unirioja.es/servlet/articulo?codigo=9111486


Add support for local variables

There are some "helper variables" in physics/temperature_conversion.nbt that currently leak through the prelude, like offset_celsius and scale_fahrenheit.   These variables feel like "implementation details" that should be contained only to the nbt file they are defined in.
Perhaps there could be a concept of local variables?

Thank you for reporting this.
Yes, this is unfortunate. I see several ways to address this:

Add a way to have module-local constants/functions, like you proposed. We would probably need a new keyword like private for this (let private offset_celsius = …) or use a decorator like we have for unit declarations (@private)?
Do the opposite: have everything private by default and introduce a way to export entities from a module (pub/public/@public/export)
Add something similar to module scopes or namespaces, where we could have mod details { let offset_celsius = …; } and then use it internally with details::offset_celsius. That namespace would not be hidden, but it would not be imported by default when doing use physics::temperature_conversion. Only if someone would do use physics::temperature_conversion::details.
Add function-level local variables, maybe with a Haskell-style syntax:fn from_celsius(t_celsius: Scalar) -> Temperature =
  (t_celsius + offset_celsius) kelvin
  where offset_celsius = 273.15

This would not really help in this case (as we want that constant to be present in multiple functions), but would certainly be helpful in a lot of scenarios

It's currently not clear to me yet which way we should take forward.

I think if I had a magic wand that would give me one of these solutions for free, I probably would choose option 1 or 3.   I would probably not vote for option 2 because I think the majority of nbt code will want to export most everything (like how the current prelude is today).
(Another short-term option might be to hide all variables that start with an underscore _ from tab-completion and the output of "ls".  I think this would be pretty cheap to implement, but not very satisfying and not my preferred approach)

(Another short-term option might be to hide all variables that start with an underscore _ from tab-completion and the output of "ls". I think this would be pretty cheap to implement, but not very satisfying and not my preferred approach)

I work a lot with Dart, and this is the approach it takes; I have to say that while it's pretty nice to be able to see whether an identifier is private at its use site, I agree that I wouldn't prefer it, and I think it just doesn't fit with the overall feel of the Numbat language.

Can I cast a vote for adding support for local (function scope) variables first? It probably would be cleaner and easier to implement. As for the syntax, would you be open to have support for let a = 10 as well? I know this opens a separate discussion on whether to allow to multi statement functions, which as far as I understand is not allowed.

For those interested, I had a play around with implementing let <ident>[: <type>] = <expr> of <value> expressions here

@simmsb thanks for sharing your progress. I think the example you have in your branch
fn foo(x: Scalar) -> Scalar =
  let y = x * 2 of
  let z: Scalar = y + x of
  x * y * z

would be easier to read in this format:
fn foo(x: Scalar) -> Scalar =
  let y = x * 2;
  let z: Scalar = y + x;
  x * y * z

How hard is it to pretend that ; is the same as of? ;)

Concerning the syntax, I would personally favor the let … in … syntax for let-expressions that seems common in other programming languages (Haskell) and the literature.
But what I would like even more is the … where … syntax that is also used in functional programming languages, because it puts the important things first and reads a bit more naturally. It also extends more nicely to a multi-definition version:
fn foo(x: Scalar) -> Scalar = x * y * z
  where
    y = x * 2
    z: Scalar = y + x

And I also want to extend that to local functions. Since let is currently only used for constants, and fn for functions, it seems more "symmetrical" to just use where for local definitions, which would allow us to skip both let and fn, which are not needed for disambiguation in this context, since we know that we are parsing a definition, and not a function-call expression (that is the reason for having introducer-keywords like let and fn in the first place).
fn maximum<D: Dim>(xs: List<D>) -> D = foldl(max, -inf, xs)
  where
    max(x, y) = if x > y then x else y

For those interested, I had a play around with implementing let <ident>[: <type>] = <expr> of <value> expressions here

Cool! Local variables are my personal top priority request. It's really inconvenient to write Numbat code without them and also leads to inefficiencies (dual evaluation due to duplication of subexpressions). I have a lot of TODOs in the Numbat standard library that we could resolve once we have local bindings.
@simmsb Did that experiment run into a dead end or is that something we could pick up for an implementation of local bindings?

Did that experiment run into a dead end or is that something we could pick up for an implementation of local bindings?
It's definitely something that could be picked up, the implementation is fully functional.

For everyone in this thread: there is significant progress on this topic in #519.
Here's something that took me a bit too long to realize. let … in … and … where … are not interchangeable. They are not even the same kind of construct. let … in … is an expression. But … where … can not appear alone, it is tied to the function definition. And always introduces identifiers "globally", for the full function scope.
This is not just me being pedantic. let … in … is strictly more powerful, especially without lazy evaluation. Consider
fn filter<A>(p: Fn[(A) -> Bool], xs: List<A>) -> List<A> =
  if is_empty(xs)
    then []
    else if p(head(xs))
      then cons(head(xs), filter(p, tail(xs)))
      else filter(p, tail(xs))

We can not simply move head(xs) to a local variable definition using where:
fn filter<A>(p: Fn[(A) -> Bool], xs: List<A>) -> List<A> =
  if is_empty(xs)
    then []
    else if p(x)
      then cons(x, filter(p, tail(xs)))
      else filter(p, tail(xs))
  where
    x = head(xs)

because x = head(xs) is evaluated (eagerly) and leads to a "empty list" error in the xs = [] case.
On the other hand, it is possible to write this using let … in …, if the scope is limited accordingly:
fn filter<A>(p: Fn[(A) -> Bool], xs: List<A>) -> List<A> =
  if is_empty(xs)
    then []
    else
      let x = head(xs) in
        if p(x)
          then cons(x, filter(p, tail(xs)))
          else filter(p, tail(xs))

This does not mean that I'm against where suddenly. I still like it.
Maybe we'll implement both of them, after all.
See also: https://github.com/elm/compiler/issues/621 for a long discussion about the topic


chore(main): release 1.1.9

:robot: I have created a release beep boop
1.1.9 (2023-09-16)
Bug Fixes 🐛

deps: update dependency @actions/core to v1.10.1 (1f8760f)

Miscellaneous 🧹

deps: update actions/checkout action to v4 (c2c92cb)
deps: update dependency @types/node to v18.17.17 (8f940cb)
deps: update dependency @vercel/ncc to ^0.38.0 (6b60d60)
deps: update dependency eslint to v8.49.0 (236a250)
deps: update dependency eslint-plugin-jest to v27.4.0 (361570e)
deps: update dependency jest to v29.7.0 (6e10f93)
deps: update typescript-eslint monorepo to v6.6.0 (c7968e3)
deps: update typescript-eslint monorepo to v6.7.0 (13955cd)
sync the dependency update to the /dist dir (3de0a79)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/paulschuberth/regex-extract-action/releases/tag/v1.1.9 :sunflower:


simple-table 能否支持0基索引

当data绑定到url时，能否指定pi请求参数值为“当前页码-1”。毕竟某些服务器采取了0基索引。

不支持。

Actually, I would second that request. It would make sense to introduce a single param to count pages from either 0 or 1. A lot of backend frameworks will assume that no param or 0 is the starting page and it should be fairly simple to make this dependant on config on the frontend framework side as this 1 as a starting page is actually unusual one...

@uded  @pholance
https://ng-alain.com/components/simple-table#simple-table  pls refer to [zeroIndexedOnPage] argument.


Display complete info for an ontology class, including synonym types and axiom annotations

Currently the amigo term info page is only showing a subset of information about a term. We lack some properties such as synonyms (the 4 synonym types are flattened into a single synonym field), and we lack axiom annotations (for example, definition xrefs and synonym xrefs). We also lack axiom constructs such as equivalent classes.
To achieve this, the plan is:

[X] Define obograph JSON format: https://github.com/geneontology/amigo/issues/58
[X] Extend owltools to be able to return an obograph json blob for any class  - https://github.com/owlcollab/owltools/issues/160
[ ] Extend ont-config.yaml to populate this blob when loading ontology_class documents  - https://github.com/owlcollab/owltools/issues/160
[ ] Write javascript code that can render blob as html

The actual info could be rendered in a number of different ways, I think the OLS gets this just right. It shows the important info front and center, and makes the advanced info (e.g equivalence axioms available to the side).
Not sure if there is any js code we could reuse @simonjupp?

IIRC, we have some stuff already for rendering col 16 artifacts from the owltools loader.

I think that may be fairly hardwired to annotation extensions.
What I have in mind for rendering could be done entirely by logic-free mustache templates. The only question is on the rendering of xrefs and other hyperlinkable entities (see parallel monarch ticket), the desire behavior may depend on the context in which the component is deployed. Could be done with call backs, but I would be inclined to keep it simple: perhaps the embedding app can enrich the json with hyperlinks, and the render code can be dumb.

The amigo c16 code is more to highlight that we're starting to get a lot of special little blobs that are requiring handling and it would be good to start narrowing it down a bit.
Some things will be a a little annoying to do in AmiGO templates, but nothing that we haven't done before (mustache render, then injection).

FYI for the more complex OWL axiom rendering OLS generates HTML snippets server side using an OWL HTML renderer developed by Nick Drummond many years ago https://github.com/co-ode-owl-plugins/ontology-browser/tree/master/owlhtml/src/main/java/org/coode/html/renderer


Refactor WinsockAsync.cs to better conform to Interop guidelines.

@davidsh, @stephentoub PTAL.

LGTM on https://github.com/pgavlin/corefx/commit/a18dac6d0b8cd20c1c282f9bec79135adc5a8efc


Sphinx 5.0 support

https://www.sphinx-doc.org/en/master/changes.html

Looks like I already implemented this a while back?


Initial Python Interface for cufile Async IO

Hi there,
Thanks for this great repository! I want to use the cuFile async IO in my research project and noticed this kvikio repo. However, the initial support has been done in #259 and tracked in #204, but the Python interface hasn't been done yet. So I exported the write_async and read_async to the CuFile Python class and added test case. This will be very helpful for my project where I want to do the PyTorch training computation and simultaneously load tensors from the SSDs. I created this PR because hopefully, it could be helpful for your repository as well as keeping the Python interface current.
Please let me know your thoughts. Thank you.
Best Regards,
Kun

In this implementation, cuda stream's pointer is passed into the Python interface, which can be retrieved from the stream object in pycuda, cuda-python, torch. The stream objects in the three packages are interoperable as well. You may check the following gist on how to create a stream object based on another from another package and retrieve the address from these objects.
https://gist.github.com/K-Wu/178703e4803716d61c94df8938c3da9b

/ok to test

The failing tests in conda-python-tests are caused by torch being not installed. How shall I fix it? Maybe adding some flags to indicate this test requires GPU and pytorch?

The failing tests in conda-python-tests are caused by torch being not installed. How shall I fix it? Maybe adding some flags to indicate this test requires Nvidia GPU and pytorch? Instead of pytorch, pycuda or cuda-python can also do the job.

If we need pytorch to create a new stream, I suggest that we use stream = cupy.cuda.Stream() and stream.ptr. KvikIO depend on cupy already.

@madsbk Hi Mads, thanks for this very quick response and detailed review! I will address your comments tonight.
Best Regards,
Kun

/ok to test

Hi @madsbk, thanks for the review! Please let me know if further actions need to be done.
Also, shall I update the branch by clicking the "Update branch" button? It seems this repo used squash merge to deal with PRs so it seems okay. I know some people prefer rebase when pulling the main branch.

/ok to test

/ok to test

/ok to test

Done addressing the comments

@madsbk Hi Mads, thank you for your further reviews and edits!

Thanks @K-Wu

/merge


How to change the placeholder color on the fields (not the floating label)?

Use placeholderTextColor, which is a react-native TextInput prop.
There was a PR for this back in Feb that used tintColor as a fallback if placeholderTextColor wasn't set, but it was never accepted for some reason.

Awesome thanks.


Service Workers

Implement all that stuff.
It will fix the flashing of the initial and user local dependent UI states by rendering a page from the local cache on the reload.

Ok, out of the Este scope for now.


Question about Batch Size and Class

I have a question related to inference. I saw your provided script inference per class with a 256 batch size.
Q. Do you think the per-frame inference (ex, five instances with different classes, 5 batch sizes) affects the performance? Would the smaller batch size and different classes in the batch influence the performance?
Are the inference structures (per class inference) all only for efficient inference?

Inference performance is unaffected by smaller batch sizes or class diversity in the batch because our method utilizes a single model to infer all classes without requiring prior knowledge of the object's category. Per-class inference is primarily used for efficiency and visualization.


Create Release from different branch

I want to create a release based of the non master branch, in my case its called 'production'
I have an artifact that it succesfully uploads to the release but the source code that it adds and the release notes dont match as they are based of master which is not yet up to date with production.
Because when a release should be made it goes from Development > production > master.
This way I make sure that master always contains the code thats running in production.
It might be already possible but then I just cant figure out how to do this

Its n

for me, it failed even if target_commitish is used. in the following code, needs.change_build_info.outputs.commit_hash is commit id, it's value like 5a804af0d5661f021df4c98793a540010654d91d.
@tomkeuper how to use target_commitish correctly?
  release:
    needs: change_build_info
    runs-on: ubuntu-latest
    steps:
      - name: checkout repo again
        uses: actions/checkout@master
        with:
          ref: ${{ needs.change_build_info.outputs.commit_hash }}

      - name: print value
        id: print
        run: |
          echo "github.ref=${{ github.ref }}"
          echo "github.sha=${{ github.sha }}"
          echo "commit_hash=${{ needs.change_build_info.outputs.commit_hash }}"
          head -n 21 build/APKBUILD

      - name: publish release assets
        uses: softprops/action-gh-release@master
        with:
          generate_release_notes: true
          target_commitish: ${{ needs.change_build_info.outputs.commit_hash }}

You dont put the commit hash in that field, you should use the branch name. Take a look at my task: https://github.com/tomkeuper/BedWars2023/blob/8f49381130e7243f70dfee353ad5e970399d3aa6/.github/workflows/deploy.yml#L52


cepstrum VQ train

When I change the dataset and wanna train a new model, should I change the ceps_codebooks.c at first？
I didn't change the ceps_bodebooks.c at all, and only got nnet_data.* from the lpcnet*.h5 file.
I doubt this is why the final output voice was blurry and fuzzy.
If so, how should I use ceps_vq_train.c to get my own codebooks ?

When I change the dataset and wanna train a new model, should I change the ceps_codebooks.c at first？
I didn't change the ceps_bodebooks.c at all, and only got nnet_data.* from the lpcnet*.h5 file.
I doubt this is why the final output voice was blurry and fuzzy.
If so, how should I use ceps_vq_train.c to get my own codebooks ?

Brother, have you solved this problem? I am also converting the sampling rate to be processed. I want to switch to 8KHz to process speech, but I don't know how to get my experience with codebooks


Update README.md

Added extra examples for ES6 notation

I'm confused about your statements about not being able to assign actions to a variable in ES6.
I wrote 2 files just today where I did just that: assigned the actions to a variable while exporting them as a module. Also, the example you gave wasn't ES6, it was CommonJS. It seems like you're documenting some quirk you didn't expect from CommonJS as if it's something specific to Reflux.
Here's a file I wrote just today that is ES6 and assigns the actions to a variable while exporting:
export var DragActions = Reflux.createActions([
	'beginDrag',
	'enterDropSpot',
	'leaveDropSpot',
	'droppedOnDropSpot',
	'droppedOffDropSpot',
])

As for the example of multiple stores, the docs do already state what you state, though they don't give an example. So there's nothing wrong with adding an example. But personally I think we can lose the explanation of the fact that you create Arrays via square brackets instead of curly. That's below the scope of these docs.


Google Storage download retry predicate additional exception

The current code is looking for snakemake.exceptions.CheckSumMismatchException when deciding whether or not to retry a download:
https://github.com/snakemake/snakemake/blob/223bcc52d058e9704e69dac65c101ea1b18f3361/snakemake/remote/GS.py#L42-L48
However, I am seeing a suspiciously large number of failures like this in my pipeline:
Traceback (most recent call last):
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/__init__.py", line 687, in snakemake
    success = workflow.execute(
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/workflow.py", line 1005, in execute
    success = scheduler.schedule()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/scheduler.py", line 489, in schedule
    self.run(runjobs)
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/scheduler.py", line 500, in run
    executor.run_jobs(
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/executors/__init__.py", line 131, in run_jobs
    self.run(
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/executors/__init__.py", line 447, in run
    future = self.run_single_job(job)
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/executors/__init__.py", line 491, in run_single_job
    self.cached_or_run, job, run_wrapper, *self.job_args_and_prepare(job)
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/executors/__init__.py", line 452, in job_args_and_prepare
    job.prepare()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/jobs.py", line 710, in prepare
    self.download_remote_input()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/jobs.py", line 682, in download_remote_input
    f.download_from_remote()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/io.py", line 584, in download_from_remote
    self.remote_object.download()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/api_core/retry.py", line 281, in retry_wrapped_func
    return retry_target(
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/api_core/retry.py", line 184, in retry_target
    return target()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/remote/GS.py", line 226, in download
    return download_blob(self.blob, self.local_file())
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/api_core/retry.py", line 281, in retry_wrapped_func
    return retry_target(
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/api_core/retry.py", line 184, in retry_target
    return target()
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/snakemake/remote/GS.py", line 69, in download_blob
    blob.download_to_file(parser)
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/cloud/storage/blob.py", line 1041, in download_to_file
    self._do_download(
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/cloud/storage/blob.py", line 900, in _do_download
    response = download.consume(transport, timeout=timeout)
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/resumable_media/requests/download.py", line 171, in consume
    self._write_to_stream(result)
  File "/opt/conda/envs/snakemake/lib/python3.9/site-packages/google/resumable_media/requests/download.py", line 120, in _write_to_stream
    raise common.DataCorruption(response, msg)
google.resumable_media.common.DataCorruption: Checksum mismatch while downloading:

  https://storage.googleapis.com/download/storage/v1/b/rs-ukb/o/raw%2Fgt-imputation%2Fukb_imp_chr9_v3.bgen?generation=1602861266282729&alt=media

The X-Goog-Hash header indicated an MD5 checksum of:

  J3RmHIDzGmBKkklx/ImWtg==

but the actual MD5 checksum of the downloaded contents was:

  XHqx7gai/Eij53rF8bMrKg==

It looks like this google.resumable_media.common.DataCorruption is not being wrapped as a snakemake.exceptions.CheckSumMismatchException or some other design flaw exists that keeps these requests from being retried.
Note: if_transient_error does not appear to apply to this error either

@vsoch may I ask you to have a look at this?

That's interesting, the error is triggered much earlier in the function (where we wouldn't expect it) than where we manually check the checksum and throw the expected (snakemake) mismatch error, here https://github.com/snakemake/snakemake/blob/223bcc52d058e9704e69dac65c101ea1b18f3361/snakemake/remote/GS.py#L69. One troubling thing is that the function appears deprecated https://googleapis.dev/python/storage/latest/_modules/google/cloud/storage/blob.html#Blob.download_to_file. I found a similar report but it's very old: https://stackoverflow.com/questions/46804668/gcs-datacorruption-checksum-mismatch-while-downloading.
There are a few ways to go about debugging this. The first would be to give me a way to reproduce the error - @eric-czech is the storage / workflow public so I could run and reproduce? That would be the easiest way for me to debug.
if that's not possible, then what we would want to do is try a few things. The way I would go about this is by cloning the repository, installing a development version of snakemake:
pip install -e .[google-cloud]

And then with a smaller or dummy version of your pipeline, inserting an interactive statement in the download function, e.g.,
import IPython
IPython.embed

around here. Then what needs to be done is reproducing the error, namely running the first two lines that cause the retry to be triggered in the first place: https://github.com/snakemake/snakemake/blob/223bcc52d058e9704e69dac65c101ea1b18f3361/snakemake/remote/GS.py#L67-L69
Then what we would want to try are the following:

First try the function blob.download_to_filename as that doesn't seem to be deprecated.
If that doesn't work, try disabling the check for the download_from_file command (it looks like you can set checksum to None) and then run the rest of the function to see if the crc32c matches. It could be that just disabling this first check (and keeping our second, working check) does the trick.
If that doesn't work, try downloads using the same method between different file types and sizes, in case it's related to that.

What we don't want to do is just add the exception to be retried, because there might be something wrong with using this function in the first place. So TLDR: if you can give me something to reproduce the error, I can do all of the above. If not, it will be up to you @eric-czech to try these things, and we can walk through the above debugging together.

The first would be to give me a way to reproduce the error - @eric-czech is the storage / workflow public so I could run and reproduce?

Technically yes (https://github.com/related-sciences/ukb-gwas-pipeline-nealelab), but this only occurs when downloading large files in fairly expensive workflows.  I'm not sure how to reproduce it since the same snakemake step will work 9 times out of 10.

Then what needs to be done is reproducing the error

I've resorted to retrying whole tasks when they fail like this which happens to be a good workaround here since these failures happen early.  Sorry, but I don't plan on setting up a development environment and trying to debug this myself.
I thought it would be pretty straightforward to trace google.resumable_media.common.DataCorruption from the bottom of that stack and see why it isn't caught like the other checksum errors that are supposed to trigger a retry.  Maybe I missed something?

I thought it would be pretty straightforward to trace google.resumable_media.common.DataCorruption from the bottom of that stack and see why it isn't caught like the other checksum errors that are supposed to trigger a retry. Maybe I missed something?

Yes, we could easily put that particular exception into the retry, but I think it's important to understand why it's happening - just having it be an exception would be akin to applying a bandaid that hides the problem without fixing it. If the function is deprecated, possibly we need to update it to download_to_filename. If it's related to the files being too big / of a particular type (for example I saw issues that raised this exception because of an improperly set content header) then we would need to fix that.
@johanneskoester how do you suggest that we proceed? I don't know how to work on this if I can't reproduce it, and the submitting user doesn't want to.

If the function is deprecated, possibly we need to update it to download_to_filename

👍

If it's related to the files being too big / of a particular type (for example I saw issues that raised this exception because of an improperly set content header)

FWIW, these files are between 40 and 200 GB in size.  I've seen no obvious correlation between these errors and the sizes within that range though.

What doesn't make sense is that it would try to calculate a checksum during the streamed download. Reading this:

checksum (str) – (Optional) The type of checksum to compute to verify the integrity of the object. If the upload is completed in a single request, the checksum will be entirely precomputed and the remote server will handle verification and error handling. If the upload is too large and must be transmitted in multiple requests, the checksum will be incrementally computed and the client will handle verification and error handling, raising google.resumable_media.common.DataCorruption on a mismatch and attempting to delete the corrupted file. Supported values are “md5”, “crc32c” and None. The default is None.

I think what is probably happening is that the checksum is being computed at increments, and there is something buggy going on there. I think we could try to just do download_to_file with checksum = None, and then download_to_filename (not deprecated) also with checksum = None to essentially disable this extra check. @eric-czech since I can't reproduce the error, how can I help to make this easy for you to test?

@johanneskoester or @eric-czech do you have any huge objects that you could share, and we can put into snakemake-testing and I can try to reproduce the checksum issue? That might be the easiest way to go about doing this!

do you have any huge objects that you could share, and we can put into snakemake-testing and I can try to reproduce the checksum issue?

Hm, here are a couple large files accessible without requester pays:
gs://gcp-public-data--gnomad/release/3.1/vcf/genomes/gnomad.genomes.v3.1.hgdp_1kg_subset.chr1.vcf.bgz # 272GB
gs://gcp-public-data--gnomad/release/3.1/vcf/genomes/gnomad.genomes.v3.1.hgdp_1kg_subset.chr22.vcf.bgz # 58GB

The size of the files would steadily decrease as you change the N in "chrN" to anything between 1 and 22.
I can't share the exact files I was using unfortunately but these are very similar.

trying with these files sounds like a good plan. Thank you for looking into this @eric-czech and @vsoch.

Okay, here is a record of what I'm doing so it might be reproduced in the future. I first created an instance on the snakemake-testing account (I didn't have enough storage locally to test this!) with ubuntu 18.04 and anaconda3 for the conda environment. I added the conda environment to my path, installed ipython, and then cloned snakamake:
git clone https://github.com/snakemake/snakemake
cd snakemake
pip install -e .[google-cloud]

And then started an interactive ipython session. I basically needed to create an anonymous client to download the file (the authenticated one gave me permissions errors)
from snakemake.remote.GS import *
client = storage.Client.create_anonymous_client()

and then create a handle to the bucket and blob provided above (I chose the larger of the two)
bucket = client.bucket('gcp-public-data--gnomad')
blob = bucket.blob('release/3.1/vcf/genomes/gnomad.genomes.v3.1.hgdp_1kg_subset.chr1.vcf.bgz')

blob
# <Blob: gcp-public-data--gnomad, release/3.1/vcf/genomes/gnomad.genomes.v3.1.hgdp_1kg_subset.chr1.vcf.bgz, None>

And then use the same method to download the file - this is where the error was being triggered:
filename = '/tmp/blob.vcf.bgz'

with open(filename, "wb") as blob_file:
    parser = Crc32cCalculator(blob_file)
    blob.download_to_file(parser)
os.sync()

and I'm letting this run to see if it triggers the error. Hopefully I won't get disconnected from the terminal, it's a fairly large / long download.

okay I've done this twice now, and unable to trigger any error. Does your server have a bad internet connection? I'm not sure I can reproduce that on Google cloud :)

@eric-czech I'd really like you to try this just setting checksum=None for the function. If you don't want to add this variable to your snakemake install, if I create a branch for you with the variable added would you be willing to test it?

okay I've done this twice now, and unable to trigger any error. Does your server have a bad internet connection?

Not really, I'm using standard reserved instances in GCP's premium network tier.  I'd be surprised if you were able to get it to happen in only trying it twice.  I had downloads like this running in kubernetes clusters and I get the sense that the failure rate is somewhere between 1/10 and 1/100.  It's definitely not easy to reproduce but with a big enough cluster and enough files, it happens often enough to be a minor problem.

@eric-czech I'd really like you to try this just setting checksum=None for the function. If you don't want to add this variable to your snakemake install, if I create a branch for you with the variable added would you be willing to test it?

I won't be able to, sorry.  Unfortunately I won't need to run that same workflow for a while since using "--restart-times" as the nuclear option was a fine workaround.  Otherwise, I had be happy to patch that in and see what happens.

Ok, well then I think it’s probably best to pick up on this when you return to running the workflow again, or another user reports the error.

@vsoch we could also ask google for debugging this. Did I understand right that you rather expect the bug to be within the google storage API?

Yes the exception comes from blob.download_to_file().

ok. @moschetti may I ask you to have a look at this? We think that we have triggered a bug in the google storage Python API, however, it occurs rarely (between 1/10 to 1/100 of long downloads). Hence, we and the reporter @eric-czech are unable to test this without wasting lots of credits. Maybe this is a known issue, or the storage API team could try to test this directly?

I'll follow up on this

I'll follow up on this

@hnawar can you have a look into this? Is it maybe reasonable to just add that exception here? My question would however be why all these cases are not considered to be transient errors anyway? Seems cumbersome to keep track of new exceptions to occur and on which one would want to just retry.


Add predicate gist:describes?

In the course of removing inverses - see issue #506 - we opted to keep isAbout and remove isDescribedBy. However, these are semantically not inverses. To repeat the example on the related PR #813:
On further thought, describes is the proper inverse of isDescribedBy; isAbout means something a bit different. Consider: the anatomy of my foot is described by Gray's Anatomy. We can say that the book describes the bone structure of my foot, but not that it is about my foot. One solution is to replace isDescribedBy with describes (for brevity) and keep isAbout as well.
The proposal here is to bring back isDescribedBy (or describes) with a clearly different meaning than aboutness. The open question is whether there is sufficient value to such a predicate to warrant its inclusion in gist.

I agree that aboutness and description come apart, though maybe in a different way.
Description is usually taken to be a purely linguistic thing. (From Oxford dictionary: "[A] spoken or written representation or account of a person, object, or event.") A document or book can describe Abe Lincoln by attributing properties to him (that he was honest, for example). Such a text would be about Abe Lincoln. The movie Lincoln w/ Daniel Day Lewis is also about Abe Lincoln, but it doesn't describe Lincoln; it depicts him, like his portrait in the National Portrait Gallery.
Aboutness is a more general representational thing--movies, paintings, mental states (like dreams), and books can all be about things. Descriptions--while they are usually about something, too--are linguistic representations.
I think this could help us distinguish describes from isAbout if we decide there is value in adding it.

The film example is good. I don't think of a painting as being about its subject; it represents it. In that sense "has subject" might cover the about cases in a unifying way (haven't thought this through, there may well be counterexamples). Text can both describe and/or be about, with a lot of overlap but some differences, as in my example above.

I think this could help us distinguish describes from isAbout if we decide there is value in adding it.

We already have gist:description, if we add anything new, it should be clearly delineated.

gist:description is a datatype property. The question is whether we want another object property.

Exactly. If we add something similar to this ('describes' and 'description' share the same root word), we should have a clear understanding of why we need both.

Discussion:

Possibly a subproperty of gist:isAbout?
Two dimensions: primarily about vs "just" some connection, plus some format issue (text vs ?)
Is there enough distinction to be useful to include in gist?

Dylan will work on creating a potential PR to review.

Is there a clear justification for having this property? That would seem to come before a PR implementing the idea.

Right, I think the idea was just to give us something more concrete to look at, but that is a fair point. Here are a couple reasons in favor of having an object property like isDescribedBy or describes in gist:
1 - Bundles of properties: Here is a use case I've seen on a couple client projects. There is a string of text that bundles together a set of properties, which are usually represented as codes. Suppose a shipment is related to a string of text: 'P&G:GA:2022'. 'P&G' means the shipper is Proctor & Gamble, 'GA' means the origin of the shipment was Georgia, and '2022' indicates the date of the shipment. Though a shipment may have all of these properties, it is clear that there is not enough packed into the string to identify one particular shipment. If the shipment is not identified by the string, then a natural alternative is to say that it is merely described by the string.
A couple real world examples I've seen:

Charge codes, which are strings of text carrying information about a time charge. The text on its own isn't enough to identify a single time charge, but it does describe the time charge as having various properties. A client-specific object property isDescribedBy has been used for this purpose.
'Ambiguous descriptors' of symbols at Platts: Strings of text that describe symbols but don't uniquely identify them. I believe a datatype property hasDescription was used in this context.

2 - In favor of having an object property, specifically: As Michael mentioned, we do have the datatype property gist:description, so we should consider whether that might handle the use cases above. While I think a datatype property might handle the symbol descriptors case, it wouldn't handle the charge code case. Similar to how IDs are treated as IRIs in gist (to say who they've been allocated by, etc.), it would also be useful to have description objects that can have various properties of their own. The charge code above is one example of this--it's helpful to represent the charge codes as objects because one way of representing them might be superseded by another.

@uscholdm you missed the discussion, but if you'll read the comments I added you'll see that there was no decision made but that there seemed enough support that it was worth considering. Dylan offered to work on making the case for it to be added as they have real use cases of how they would like to use it.

If the shipment is not identified by the string, then a natural alternative is to say that it is merely described by the string.

That is exactly what gist:description is for.

'Ambiguous descriptors' of symbols : Strings of text that describe symbols but don't uniquely identify them. I believe a datatype property hasDescription was used in this context.

That might have been before gist:description came about, not sure about that.
@dylan-sa acknowledges that gist:description will suffice for these examples.  I don't quite understand the example arguing for the need for an object property, so it's a bit subtle, or I'm missing something obvious.  In any event, if only one of the several examples that come to mind seem to call for an object property, that is likley not sufficient justification for putting it into gist.

@uscholdm you missed the discussion, but if you'll read the comments I added you'll see that there was no decision made but that there seemed enough support that it was worth considering. Dylan offered to work on making the case for it to be added as they have real use cases of how they would like to use it.

Thank you for that clarification.

PROPOSAL:

Do not add a new object property that connects a description and the thing described.
Close the issue

RATIONALE:

gist:description already does that as a data property.
There is no clear consensus that there is a broad need for an object property for this.

If a client application requires such an object property, it should probably be called hasDescription with range including gist:Text


Change to DEBUG (from INFO) 'Not re-registering MeterRegistry ...'

What does this PR do?
Change to DEBUG (from INFO) 'Not re-registering MeterRegistry ...' message as it is too verbose

:green_heart: Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-12-06T16:16:20.663+0000

Duration: 61 min 6 sec

Test stats :test_tube:

Test
Results

Failed
0

Passed
3236

Skipped
41

Total
3277

:green_heart: Flaky test report
Tests succeeded.
:robot: GitHub comments
Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.

run benchmark tests : Run the benchmark tests.

run jdk compatibility tests : Run the JDK Compatibility tests.

run integration tests : Run the Agent Integration tests.

run end-to-end tests : Run the APM-ITs.

run windows tests : Build & tests on windows.

run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@JonasKunz  @jackshirazi  Hey i am using apm-agent-attach/1.35.0, latest version of apm-agent-attach, still getting above logs undefinetely

@JonasKunz @jackshirazi any idea when this fix will be released?   We are currently blocked on upgrading until that time - presumably we will be seeing a 1.35.1 release soon that includes this fix.

Targeting this month

this couldnt make it to 1.36.0? 😥


Offer a DaemonSet configuration alongside a Deployment

Currently we offer Ambassador default configuration as a Deployment rather than a DaemonSet this is probably the wrong setup for a high-performance mission critical piece of infrastructure such as Ambassador where running the Envoy proxy itself is likely to be the number one concern on the cluster because you don't want to take any resources away from Envoy request handling.
There is no way to write rules for a Kubernetes Deployment such that the scheduler ensures only a single pod is running per node. This is totally possible however with a DaemonSet and it is one of the primary reasons for it to exist. See also: https://stackoverflow.com/questions/41644755/whats-the-purpose-of-kubernetes-daemonset-when-replication-controllers-have-nod?rq=1
The envisioned use case for this configuration is:

Given a Kubernetes cluster
Some nodes are labelled in such a way they only run Ambassador.
A user wants to ensure that:

These nodes are only used for Ambassador
A single Ambassador is deployed per Node and thus has 100% of system resources available to it.

I am working on it. Aiming to create PR soon

Done in #847 -- thanks, @DipeshMitthalal!


[TritonMLIR] Disallow 0D tensor

This PR fixes #779.

Now load/store accepts scalar values.

Previously, they do not allow scalar values so they must be cast to 0D tensors.

tt.reduce (= tt.min/max/sum) now returns a scalar value if 1D array is reduced.

Previously, tt.reduce returns a 0d-tensor.

0D tensor is not allowed in the frontend.  Specifically, block_type may not be 0D.

Previously, tl.zeros([], dtype=tl.float32) was allowed.

Add tests to check these.

Example
@triton.jit
def reduce_type_check(ptr):
    v_32 = tl.load(ptr + tl.arange(0, 32))
    v_scalar = tl.min(v_32, axis=0)
    tl.store(ptr, v_scalar)

Triton-IR
module {
  func @reduce_type_check_0(%arg0: !tt.ptr<f32>) {
    %0 = tt.make_range {end = 32 : i32, start = 0 : i32} : tensor<32xi32>
    %1 = tt.splat %arg0 : (!tt.ptr<f32>) -> tensor<32x!tt.ptr<f32>>
    %2 = tt.addptr %1, %0 : tensor<32x!tt.ptr<f32>>
    %3 = tt.load %2 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<32xf32>
    %4 = tt.reduce %3 {axis = 0 : i32, redOp = 6 : i32} : tensor<32xf32> -> f32
    tt.store %arg0, %4 : f32
    return
  }
}

TritonGPU-IR
#blocked = #triton_gpu.blocked<{sizePerThread = [1], threadsPerWarp = [8], warpsPerCTA = [4], order = [0]}>
module attributes {"triton_gpu.num-warps" = 4 : i32} {
  func @reduce_type_check_0(%arg0: !tt.ptr<f32>) {
    %0 = tt.make_range {end = 32 : i32, start = 0 : i32} : tensor<32xi32, #blocked>
    %1 = tt.splat %arg0 : (!tt.ptr<f32>) -> tensor<32x!tt.ptr<f32>, #blocked>
    %2 = tt.addptr %1, %0 : tensor<32x!tt.ptr<f32>, #blocked>
    %3 = tt.load %2 {cache = 1 : i32, evict = 1 : i32, isVolatile = false} : tensor<32xf32, #blocked>
    %4 = tt.reduce %3 {axis = 0 : i32, redOp = 6 : i32} : tensor<32xf32, #blocked> -> f32
    tt.store %arg0, %4 : f32
    return
  }
}

Thanks! @shintaro-iwasaki

%4 = tt.reduce %3 {axis = 0 : i32, redOp = 6 : i32} : tensor<32xf32> -> f32

hmmm.. I don't think we should use scalar to replace 0D tensor since they are quite different in semantics. For example, a scalar is never able to have a layout, and would have no chance to do bufferization unless we specially deals with that. I also tend to feel that 0D tensor is more accurate in semantics, and it's highly possible that there are some other interfaces and existing building blocks distinguish between scalar and 0D tensor (including the TritonGPUToLLVM unless we specially deals with that). And plus that, other dialects (like mhlo and tosa) also choose 0D tensor in similar cases.

@goostavz Thanks for your comments. I believe your concern is right. 0D tensors should be semantically better, but the problem only arises when we use 1D reduction operations in practice -- unless we explicitly create/pass 0D-tensors.
I am happy to fix this issue by either using 0D tensor or making 1D reduction return a scalar value, but 0D tensor, though it's minor, affects the productivity of other work (e.g., the existing coalesce pass does not work with 0D-tensor store/load as far as I tried). Perhaps we should revisit this issue if we encounter a problem as we do this time; #663 is the PR for Triton-MLIR that generates a 0D tensor from 1D reduction.

Following the conversation inhttps://triton-lang.slack.com/archives/C042VBSQWNS/p1666075297753549, I think it's find to merge, and come back to it later. I do agree that in the long term we want to disallow scalars instead (except as arguments of control flow ops). And when we do that, this PR will be useful as it lifts the codebase away from a state were things were half 0D, half scalars :)


Switch to TypeScript 2.1 and use object spread instead of assign

Finally! https://blogs.msdn.microsoft.com/typescript/2016/12/07/announcing-typescript-2-1/

I just updated to TS 2.1, so someone could start working on this! Any volunteers?

I can handle!

This is done now. 🙂

TS 2.1 isn't supported by Angular2 yet. I guess we have to wait for support to land there before we can use it :)

You can still use the new version of AC though!


Exclude logback.xml in jar packaging

The logback.xml file should not be packaged into the jar artifacts, as it will pollute or override settings of projects using ff4j (this happened to us).

Your are right. thank you for your modification, we should release some 1.6.1 next week.


Incorrect translation status after machine translation (outdated pages)

Describe the Bug

Translation status of "outdated" pages does not transit correctly after machine translation.
Steps to Reproduce
Sadly I cannot reproduce this bug so far 😿
Expected Behavior

After machine translation the status changes from "outdated" (alert-triangle icon) to "machine translation" (robot icon)
Actual Behavior

After machine translation the status changes from "outdated" (alert-triangle icon) to "currently in translation" (clock icon)
Additional Information

Similar bug is reported #2318

Traceback

For example, Stadt Regensburg reported that the status of the sides (without previous translations) are saved as "Drafts" after a machine translation bulk action. For example:
The page https://admin.integreat-app.de/regensburg/pages/de/277/edit/
the translation in English was saved as Draft after the bulk action.


Altium tutorial

Tutorial Layout for Altium.

@ethanmpeterson I think this should go into the onboarding-projects in #19, too.

@ethanmpeterson I think this should go into the onboarding-projects folder in #19, too.

Good idea, base this PR off the branch in #19. Place the tutorial PCB project in onboarding/Q21.

Added the project description to the Q21/ readme, with some blank rows to add more projects in case some are unfamiliar with markdown tables.


[REQUEST] Message.mentions should be a list of Users

What is the feature you're proposing?
Message.mentions currently is a dict, while it says in its documentation it should be a List[User].
Additional Information

[ ] My feature request is related to an existing Issue.

Issue (if referenceable):

Closing in favor of #513


"Hop size" and "overlap size" are used interchangeably

Hi, thank you for your  SOLAFS implementation.
While looking through the code, I noticed that the hop time variable in the main function is multiplied by the audio sample rate and then passed as the 'overlap size' argument of the solafs function.
But, aren't hop size and overlap size complementary values? I.e. overlap size = window size - hop size. So I think either 'hop' should be renamed to 'overlap' in the main function, or the above conversion should be done.
Happy to make the changes and submit a pull request if you agree with my reasoning. Thanks.

You’re completely right.  I think the right argument to the solafs should
be hop, I find overlap a confusing way to parameterize it.  But it looks
like overlap is useful in the function, so I guess we should immediately
convert hop to overlap at the top of the function.  If you submit a pull
request, I’d be very glad to incorporate it.
By the way, I have absolutely no memory of writing this code!
DAn.
On Wed, Mar 3, 2021 at 19:00 Max<EMAIL_ADDRESS>wrote:

Hi, thank you for your SOLAFS implementation.
While looking through the code, I noticed that the hop time variable in
the main function is multiplied by the audio sample rate and then passed as
the 'overlap size' argument of the solafs function.
But, aren't hop size and overlap size complementary values? I.e. overlap
size = window size - hop size. So I think either 'hop' should be renamed to
'overlap' in the main function, or the above conversion should be done.
Happy to make the changes and submit a pull request if you agree with my
reasoning. Thanks.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/dpwe/solafs/issues/2, or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAEGZUMMZJTQXL7HBQWYZ4LTB3EQBANCNFSM4YSGM5KA
.


Roll engine a89cf80d4de5..66087301cd9a (2 commits)

https://github.com/flutter/engine/compare/a89cf80d4de5...66087301cd9a
git log a89cf80d4de5dbd93d72958cd1f0b26eb6a0b3e2..66087301cd9a18ad2c2087412c71f552a2ec76c2 --no-merges --oneline
66087301c Roll tonic and update #includes (flutter/engine#8950)
a89531561 Roll src/third_party/skia c2aea5938d0d..4167215daf0e (5 commits) (flutter/engine#8961)
The AutoRoll server is located here: https://autoroll.skia.org/r/flutter-engine-flutter-autoroll
Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md
If the roll is causing failures, please contact the current sheriff (jsimmons@google.com), and stop
the roller if necessary.

Auto-roller completed checks. About to merge.


Publish after Duplication stores previous instead of old value

Describe the bug
Context is the need to have a unique ID the enduser cannot change (because this woul break all references/relations between objects). As basis I used the solution proposed in https://jozefm.dev/articles/2019/06/18/gridsome-netlify-cms-collection-relations/.
It turned out that duplication is tricky because this feature copies the ID field as well - but you can handle that by ensuring, that an update is blocked if already an ID is provided (during duplication the ID (this.props.value) gets undefined so a new ID is generated and updated is allowed).
=> As a result a new ID is displayed in the UI (so far expected behavior) BUT when clicking publish somehow the "old"/previous ID kicks in again and the object is stored with the previous ID instead of the ID shown in the UI :(
Code.
`const IdControl = window.createClass({
getInitialState: function() {    return {};  },
componentDidMount: function() {
    // If this widget doesn't have an ID yet we create one using the UUID package
    if (!this.props.value) {
        this.props.onChange(uuid())
    }
},
shouldComponentUpdate(nextProps, nextState){
	debugger;
	if (nextProps.value !== this.props.value && this.props.value !== undefined) {
                    //Case: already (new) ID defined -> block change to "old" ID
		nextProps.value = this.props.value; //reset value
		return false;
	}else{
		return true;
	}
},
componentDidUpdate: function() {
	debugger; //just checking if it is called
},
render: function() {
    return window.h('p', null , this.props.value);
}

});`
Expected behavior
Publish after duplication should use the values shown in the UI. But maybe I created an inconsitent object? => How to override the old ID?
Applicable Versions:
netlify-cms-app 2.11.13
netlify-cms-core 2.16.0
netlify-cms 2.10.16
Additional Context
In general this is related to https://github.com/netlify/netlify-cms/issues/2829 - there the need for unqiue fields is described.

Sorry - I found the solution. Changing values directly was just a bad idea, I had to invoke onChange again in order to change the value back to new ID:
`const IdControl = window.createClass({
getInitialState: function() {    return {};  },

componentDidMount: function() {
    // If this widget doesn't have an ID yet we create one using the UUID package
    if (!this.props.value) {
        this.props.onChange(uuid());
    }
},
shouldComponentUpdate(nextProps, nextState){
	debugger;
	if (nextProps.value !== this.props.value && this.props.value !== undefined) {
		this.props.onChange(this.props.value); //change value back to new ID
		return false;
	}else{
		return true;
	}
},
render: function() {
    return window.h('p', null , this.props.value);
}

});`


Add specs for Date#yday and DateTime#yday

This is done by converting the existing specs for Time#yday into a shared spec that can be used by the other two classes. An additional spec to cover leap years has been added.

Thank you!


Updated Custom Queries to Reflect Explore

🚀 Deployed on https://63499da6333ec9060f2d75f8--cozy-fox-0defec.netlify.app


‘actions/setup-java@v1’ removes everything from $PATH

Hello,
I was advised to post my issue here from my GitHub Support Community post.
I've had a lot of weird issues at each stage of my pipeline and all of them seemed to have been resolved by setting the $PATH variable to /bin etc within the step or by hard coding /bin/chmod and /bin/ssh rather than using chmod and ssh for example.
I have tracked down the issue to the actions/setup-java@v1 step replacing the contents of $PATH with the path of the JDK.
I call it like this:
      - name: Set up JDK 13
        uses: actions/setup-java@v1
        with:
          java-version: 13

Before that step, echo $PATH outputs: /usr/share/rust/.cargo/bin:/home/runner/.config/composer/vendor/bin:/home/runner/.dotnet/tools:/snap/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/home/linuxbrew/.linuxbrew/bin:/home/linuxbrew/.linuxbrew/sbin
Whereas after that step, echo $PATH outputs:
/opt/hostedtoolcache/jdk/13.0.3/x64/bin:***
Hope this helps and let me know if you need anymore information!
The workflow file that reproduces this is here.
Thank you,
Kathan

I am planning to use this action and was wondering if this is still an issue?

Hello everyone. I tested example above and PATH is present after setup-java action was completed. Is it still an issue for you ?

Hello everyone. I tested example above and PATH is present after setup-java action was completed. Is it still an issue for you ?

Hello @cheemcheem. Just a gentle ping.

Hello everyone, I'm closing the issue since it's not reproducible. If you have any concerns feel free to reopen the issue.


Add ___errno() for Solaris

r? @alexcrichton
(rust_highfive has picked a reviewer for you, use r? to override)

@bors: r+

:pushpin: Commit 4c1d1f8 has been approved by alexcrichton

:hourglass: Testing commit 4c1d1f809d8adc08f87ee7061fc346ae95dfd9d4 with merge 787420a7a363275e20f15744a5681795c9ae9045...

:sunny: Test successful - status-appveyor, status-travis
Approved by: alexcrichton
Pushing 787420a7a363275e20f15744a5681795c9ae9045 to master...


AWS Bedrock - Converse

Added in functionality for any other models in AWS Bedrock to be queried. This currently works with text, although tools are not yet implemented (as they currently are for Anthropic models in anthropic_client.py)

@DaveDeCaprio All good with the changes?

@DaveDeCaprio All good with the changes?

Sorry, I've been out for a bit.  WIll look today.


Cow: Watch omangoldprices.com

Cow requests the watch of the watch_keyword omangoldprices\.com. See the MS search here and the Stack Exchange search in text, in URLs, and in code.

omangoldprices\.com has been seen in 1 true positive, 0 false positives, and 0 NAAs.


[Enterprise Bot Template][TS] Use i18n to manage resources localization

Description

Implement i18n.
Modify all dialogs responses implementation to use i18n.
Delete all .resx files and all related references (like resx dependency).
Add /locales folder with new .json localized files.

Related Issue

Fixes #540 - [Enterprise Bot Template][TS] Use i18n to manage resources localization
Testing Steps

Open a new terminal in AI/templates/Enterprise-Template/src/typescript.
Run msbuild using the instruction in DEPLOYMENT.md.
Run npm install to install dependencies.
Run npm run start to run the bot.
Open Bot Framework Emulator and load the corresponding .bot file.
Change the Emulator locale to es.
Send a message to the bot. The response should be in Spanish.
Change the Emulator locale to en.
Send a message to the bot. The response should be in English.

Checklist

[x] I have commented my code, particularly in hard-to-understand areas
[x] I have added or updated the appropriate unit tests
[x] I have updated related documentation

If this contains changes that needs to be replicated between the Enterprise Template <-> Virtual Assistant

~[ ] A duplicate issue is filed to track future  work.~

If you have updated responses or .lu files:

~[ ] All languages have been updated~
~[ ] You have tested deployment with your new models~

Hello @enzocanoo,
how did you ensure dependency of localization per user / request. I am worried if I will have lots of users, that localization will mix because of global setting of localization code.
Note from npm:
"Global assumes you share a common state of localization in any time and any part of your app. This is usually fine in cli-style scripts. When serving responses to http requests you'll need to make sure that scope is NOT shared globally but attached to your request object." (https://www.npmjs.com/package/i18n)
Thank you for an assurance.
Best Regards,
Martin


python org-babel with :session header

What did you expect to happen?
Have org-babel with python and :session header work and output result. Seems like the default org-babel python script that's run with the :session header doesn't always get interpreted properly.
What actually happened?
Had an indentation error (see below), and nothing was output.
Additional details:
Confirmed org-babel works as expected in vanilla Emacs and with doom, but without the org module. Also this seems to only be an issue when I include :session header. Sometimes if I execute the org-babel block again, it will work (i.e. org-babel outputs, and no indentation/parsing issue in *Python* buffer).
Best resources I could find so far:

https://code.orgmode.org/jackkamm/org-mode/commit/c2fff65f36141b78d91af9d6264d0f936ee5a3a1
https://emacs.stackexchange.com/questions/41336/src-python-in-org-mode-indentationerror-unexpected-indent

init.el:
(doom! :input
       ;;chinese
       ;;japanese

       :completion
       company           ; the ultimate code completion backend
       ;;helm              ; the *other* search engine for love and life
       ;;ido               ; the other *other* search engine...
       ivy               ; a search engine for love and life

       :ui
       deft              ; notational velocity for Emacs
       doom              ; what makes DOOM look the way it does
       doom-dashboard    ; a nifty splash screen for Emacs
       ;;doom-quit         ; DOOM quit-message prompts when you quit Emacs
       fill-column       ; a `fill-column' indicator
       hl-todo           ; highlight TODO/FIXME/NOTE/DEPRECATED/HACK/REVIEW
       ;;hydra
       ;;indent-guides     ; highlighted indent columns
       minimap           ; show a map of the code on the side
       modeline          ; snazzy, Atom-inspired modeline, plus API
       ;;nav-flash         ; blink cursor line after big motions
       ;;neotree           ; a project drawer, like NERDTree for vim
       ophints           ; highlight the region an operation acts on
       (popup +defaults)   ; tame sudden yet inevitable temporary windows
       ;;pretty-code       ; ligatures or substitute text with pretty symbols
       ;;tabs              ; an tab bar for Emacs
       ;;treemacs          ; a project drawer, like neotree but cooler
       ;;unicode           ; extended unicode support for various languages
       vc-gutter         ; vcs diff in the fringe
       vi-tilde-fringe   ; fringe tildes to mark beyond EOB
       ;;window-select     ; visually switch windows
       workspaces        ; tab emulation, persistence & separate workspaces
       ;;zen               ; distraction-free coding or writing

       :editor
       (evil +everywhere); come to the dark side, we have cookies
       file-templates    ; auto-snippets for empty files
       fold              ; (nigh) universal code folding
       ;;(format +onsave)  ; automated prettiness
       ;;god               ; run Emacs commands without modifier keys
       ;;lispy             ; vim for lisp, for people who don't like vim
       ;;multiple-cursors  ; editing in many places at once
       ;;objed             ; text object editing for the innocent
       ;;parinfer          ; turn lisp into python, sort of
       ;;rotate-text       ; cycle region at point between text candidates
       snippets          ; my elves. They type so I don't have to
       ;;word-wrap         ; soft wrapping with language-aware indent

       :emacs
       dired             ; making dired pretty [functional]
       electric          ; smarter, keyword-based electric-indent
       ibuffer           ; interactive buffer management
       undo              ; persistent, smarter undo for your inevitable mistakes
       vc                ; version-control and Emacs, sitting in a tree

       :term
       ;;eshell            ; the elisp shell that works everywhere
       ;;shell             ; simple shell REPL for Emacs
       ;;term              ; basic terminal emulator for Emacs
       ;;vterm             ; the best terminal emulation in Emacs

       :checkers
       syntax            ; tasing you for every semicolon you forget
       spell             ; tasing you for misspelling mispelling
       ;;grammar           ; tasing grammar mistake every you make

       :tools
       ;;ansible
       ;;debugger          ; FIXME stepping through code, to help you add bugs
       ;;direnv
       ;;docker
       ;;editorconfig      ; let someone else argue about tabs vs spaces
       ;;ein               ; tame Jupyter notebooks with emacs
       (eval +overlay)     ; run code, run (also, repls)
       ;;gist              ; interacting with github gists
       lookup              ; navigate your code and its documentation
       ;;lsp
       ;;macos             ; MacOS-specific commands
       magit             ; a git porcelain for Emacs
       ;;make              ; run make tasks from Emacs
       ;;pass              ; password manager for nerds
       ;;pdf               ; pdf enhancements
       ;;prodigy           ; FIXME managing external services & code builders
       ;;rgb               ; creating color strings
       ;;taskrunner        ; taskrunner for all your projects
       ;;terraform         ; infrastructure as code
       ;;tmux              ; an API for interacting with tmux
       ;;upload            ; map local to remote projects via ssh/ftp

       :lang
       ;;agda              ; types of types of types of types...
       ;;cc                ; C/C++/Obj-C madness
       ;;clojure           ; java with a lisp
       ;;common-lisp       ; if you've seen one lisp, you've seen them all
       ;;coq               ; proofs-as-programs
       ;;crystal           ; ruby at the speed of c
       ;;csharp            ; unity, .NET, and mono shenanigans
       ;;data              ; config/data formats
       ;;(dart +flutter)   ; paint ui and not much else
       ;;elixir            ; erlang done right
       ;;elm               ; care for a cup of TEA?
       emacs-lisp        ; drown in parentheses
       ;;erlang            ; an elegant language for a more civilized age
       ;;ess               ; emacs speaks statistics
       ;;faust             ; dsp, but you get to keep your soul
       ;;fsharp           ; ML stands for Microsoft's Language
       ;;fstar             ; (dependent) types and (monadic) effects and Z3
       ;;(go +lsp)         ; the hipster dialect
       ;;(haskell +dante)  ; a language that's lazier than I am
       ;;hy                ; readability of scheme w/ speed of python
       ;;idris             ;
       ;;json              ; At least it ain't XML
       ;;(java +meghanada) ; the poster child for carpal tunnel syndrome
       ;;javascript        ; all(hope(abandon(ye(who(enter(here))))))
       ;;julia             ; a better, faster MATLAB
       ;;kotlin            ; a better, slicker Java(Script)
       ;;latex             ; writing papers in Emacs has never been so fun
       ;;lean
       ;;factor
       ;;ledger            ; an accounting system in Emacs
       ;;lua               ; one-based indices? one-based indices
       markdown          ; writing docs for people to ignore
       ;;nim               ; python + lisp at the speed of c
       ;;nix               ; I hereby declare "nix geht mehr!"
       ;;ocaml             ; an objective camel
       (org              ; organize your plain life in plain text
        +roam)
       ;;perl              ; write code no one else can comprehend
       ;;php               ; perl's insecure younger brother
       ;;plantuml          ; diagrams for confusing people more
       ;;purescript        ; javascript, but functional
       (python            ; beautiful is better than ugly
        +lsp)
       ;;qt                ; the 'cutest' gui framework ever
       ;;racket            ; a DSL for DSLs
       ;;rest              ; Emacs as a REST client
       ;;rst               ; ReST in peace
       ;;(ruby +rails)     ; 1.step {|i| p "Ruby is #{i.even? ? 'love' : 'life'}"}
       ;;rust              ; Fe2O3.unwrap().unwrap().unwrap().unwrap()
       ;;scala             ; java, but good
       ;;scheme            ; a fully conniving family of lisps
       sh                ; she sells {ba,z,fi}sh shells on the C xor
       ;;sml
       ;;solidity          ; do you need a blockchain? No.
       ;;swift             ; who asked for emoji variables?
       ;;terra             ; Earth and Moon in alignment for performance.
       ;;web               ; the tubes
       ;;yaml              ; JSON, but readable

       :email
       ;;(mu4e +gmail)
       ;;notmuch
       ;;(wanderlust +gmail)

       :app
       ;;calendar
       ;;irc               ; how neckbeards socialize
       ;;(rss +org)        ; emacs as an RSS reader
       ;;twitter           ; twitter client https://twitter.com/vnought

       :config
       literate
       (default +bindings +smartparens))

config.el (although have tried with the below excluded too):
(setq python-shell-interpreter "python3")

*Python* buffer:
import ast
Python 3.7.6 (default, Dec 30 2019, 19:38:28)
[Clang 11.0.0 (clang-1<IP_ADDRESS>)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
try:
>>> >>> ...   File "<stdin>", line 2
    import codecs, os;__pyfile = codecs.open('''/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/pybvFjOf''', encoding='''utf-8''');__code = __pyfile.read().encode('''utf-8''');__pyfile.close();os.remove('''/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/pybvFjOf''');exec(compile(__code, '''/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/pybvFjOf''', 'exec'));
         ^
IndentationError: expected an indented block
>>>     with open('/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/babel-8x5dXm/python-RVrgqc') as f:
  File "<stdin>", line 1
    with open('/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/babel-8x5dXm/python-RVrgqc') as f:
    ^
IndentationError: unexpected indent
        __org_babel_python_ast = ast.parse(f.read())
>>>     __org_babel_python_final = __org_babel_python_ast.body[-1]
  File "<stdin>", line 1
    __org_babel_python_ast = ast.parse(f.read())
    ^
IndentationError: unexpected indent
    if isinstance(__org_babel_python_final, ast.Expr):
>>>         __org_babel_python_ast.body = __org_babel_python_ast.body[:-1]
  File "<stdin>", line 1
    __org_babel_python_final = __org_babel_python_ast.body[-1]
    ^
IndentationError: unexpected indent
        exec(compile(__org_babel_python_ast, '<string>', 'exec'))
>>>         __org_babel_python_final = eval(compile(ast.Expression(
  File "<stdin>", line 1
    if isinstance(__org_babel_python_final, ast.Expr):
    ^
IndentationError: unexpected indent
            __org_babel_python_final.value), '<string>', 'eval'))
>>>     else:
  File "<stdin>", line 1
    __org_babel_python_ast.body = __org_babel_python_ast.body[:-1]
    ^
IndentationError: unexpected indent
        exec(compile(__org_babel_python_ast, '<string>', 'exec'))
>>>         __org_babel_python_final = None
  File "<stdin>", line 1
    exec(compile(__org_babel_python_ast, '<string>', 'exec'))
    ^
IndentationError: unexpected indent
except Exception:
>>>     from traceback import format_exc
  File "<stdin>", line 1
    __org_babel_python_final = eval(compile(ast.Expression(
    ^
IndentationError: unexpected indent
    __org_babel_python_final = format_exc()
>>>     raise
  File "<stdin>", line 1
    __org_babel_python_final.value), '<string>', 'eval'))
    ^
IndentationError: unexpected indent

>>> open('/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/babel-8x5dXm/python-JoOoC9', 'w').write(str(__org_babel_python_final))
  File "<stdin>", line 1
    else:
    ^
IndentationError: unexpected indent

>>>
  File "<stdin>", line 1
    exec(compile(__org_babel_python_ast, '<string>', 'exec'))
    ^
IndentationError: unexpected indent
'org_babel_python_eoe'
>>>   File "<stdin>", line 1
    __org_babel_python_final = None
    ^
IndentationError: unexpected indent
>>>   File "<stdin>", line 1
    except Exception:
         ^
SyntaxError: invalid syntax
>>>   File "<stdin>", line 1
    from traceback import format_exc
    ^
IndentationError: unexpected indent
>>>   File "<stdin>", line 1
    __org_babel_python_final = format_exc()
    ^
IndentationError: unexpected indent
>>>   File "<stdin>", line 1
    raise
    ^
IndentationError: unexpected indent
>>> >>> Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
NameError: name '__org_babel_python_final' is not defined
>>> >>> >>> 'org_babel_python_eoe'
>>>

Then after a few tries, the python code will be interpreted fine:
>>> import ast
>>> try:
...     with open('/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/babel-s9dZu3/python-XufMTg') as f:
...         __org_babel_python_ast = ast.parse(f.read())
...     __org_babel_python_final = __org_babel_python_ast.body[-1]
...     if isinstance(__org_babel_python_final, ast.Expr):
...         __org_babel_python_ast.body = __org_babel_python_ast.body[:-1]
...         exec(compile(__org_babel_python_ast, '<string>', 'exec'))
...         __org_babel_python_final = eval(compile(ast.Expression(
...             __org_babel_python_final.value), '<string>', 'eval'))
...     else:
...         exec(compile(__org_babel_python_ast, '<string>', 'exec'))
...         __org_babel_python_final = None
... except Exception:
...     from traceback import format_exc
...     __org_babel_python_final = format_exc()
...     raise
...
open('/var/folders/13/x5h4fyvj3c715d6pnbd68ypm0000gn/T/babel-s9dZu3/python-Hy9Zle', 'w').write(str(__org_babel_python_final))

Steps to reproduce:

Install vanilla emacs
Confirm org-babel works in vanilla emacs. Minimal repro:
2a. In scratch buffer, change to org-mode (M-x org-mode)
2b. Paste below two source blocks:

#+begin_src emacs-lisp
(org-babel-do-load-languages
 'org-babel-load-languages
 '((python . t)))
#+end_src

#+begin_src python :session :results raw
5
#+end_src

2c. Execute blocks and confirm output:
#+results:
5

Install doom
Enable org in doom config
Follow 2a to 2c to see no results and aforementioned traceback in *Python* buffer.

System information:

```
emacs   version    27.0.91
        features   NOTIFY KQUEUE ACL GNUTLS LIBXML2 ZLIB TOOLKIT_SCROLL_BARS MODULES THREADS PDUMPER GMP
        build      May 20, 2020
        buildopts  (--enable-locallisppath=/usr/local/share/emacs/site-lisp --infodir=/usr/local/Cellar/emacs-mac/HEAD-b71b8b1/share/info/emacs --prefix=/usr/local/Cellar/emacs-mac/HEAD-b71b8b1 --with-mac --enable-mac-app=/usr/local/Cellar/emacs-mac/HEAD-b71b8b1 --with-gnutls --with-modules)
        windowsys  mac
        daemonp    server-running
doom    version    2.0.9
        build      grafted, HEAD -> develop, origin/develop, origin/HEAD 94fc6f7 2020-05-20 01:10:15 -0400
        dir        ~/.dotfiles/emacs/.config/doom/
system  type       darwin
        config     x86_64-apple-darwin18.7.0
        shell      /bin/zsh
        uname      Darwin 18.7.0 Darwin Kernel Version 18.7.0: Mon Feb 10 21:08:45 PST 2020; root:xnu-4903.278.28~1/RELEASE_X86_64 x86_64
        path       (~/.virtualenvs/py3/bin /usr/local/bin /usr/bin /bin /usr/sbin /sbin /Library/TeX/texbin ~/.config/emacs/bin)
config  envfile    envvar-file
        elc-files  0
        modules    (:completion company ivy :ui deft doom doom-dashboard fill-column hl-todo minimap modeline ophints (popup +defaults) vc-gutter vi-tilde-fringe workspaces :editor (evil +everywhere) file-templates fold snippets :emacs dired electric ibuffer undo vc :checkers syntax spell :tools (eval +overlay) lookup magit :lang emacs-lisp markdown (org +roam) (python +lsp) sh :config literate (default +bindings +smartparens))
        packages   (n/a)
        unpin      (n/a)
        elpa       (n/a)
```

I think add this to my config this may have solved it for me (setq org-babel-python-command "python3") seen in https://tecosaur.github.io/emacs-config/config.html#babel,code--1

I have the same error. I've tried @flowersw proposal and still got the same result. Is this something related to org_babel_python_eoe? Here is my doom configuration link

@wangkev Is this still an issue? I cannot reproduce it. Please make sure you are on the latest version of Doom and on Emacs 27.1+, not 27.0.50 or earlier.
To change the interpreter python blocks in org-mode use change org-babel-python-command instead. Doom sets it to python-shell-interpreter, but it's possible you're setting it in such a way that it gets set too early; check its value with M-x helpful-variable RET org-babel-python-command).

I haven't tried to use the session tag since raising the issue, but re-tested just now and do not have the same error anymore (granted on a different machine). Using emacs 27.1 and doom 2.0.9.
Happy to close this issue, or can leave it open for others who appear to have the same issue?

It must've been fixed at some point then. Thanks for letting me know!


live_tester in training problem

https://github.com/swook/GazeML/blob/7087b9eb49a5749d84016a2079a91e85d7984511/src/core/model.py#L90
Hi, the work is really good. When running the DPG code, I encountered some problems. As you can see in the link, the model initialized live_tester during model initialization, however, the use_batch_statistics_at_test was set to True, which lead to  during testing in do_full_test function, the use_batch_statistics was set to True. So, my question is , why set the is_training in batch_norm function to True during test? I have tried to set it to false and during the training, I found the test result was very bad.

Yes, for the model to work you must use mini-batch statistics at test time. I believe this is because the distribution of pixel values are greatly different but only in terms of scale and bias.
This is not a hack per se, as you will find that many deep learning papers use mini-batch stats. at test time in contrast to the original batch norm paper's suggestions.


ISSUE #3252 : Field may be final in HttpSummaryMetrics

Fixes #3252 .
Modifications
Describe the modifications you've done.
Added final
Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
If a feature is not applicable for documentation, explain why?
If a feature is not documented yet in this PR, please create a followup issue for adding the documentation

@ibrijesh welcome to contribute


No matching version found error

(base) MacBook-Pro-4:~ Yash$ pip install mediapipe-silicon
ERROR: Could not find a version that satisfies the requirement mediapipe-silicon (from versions: none)
ERROR: No matching distribution found for mediapipe-silicon
(base) MacBook-Pro-4:~ Yash$ pip --version
pip 22.3.1 from /Users/Yash/opt/anaconda3/lib/python3.8/site-packages/pip (python 3.8)
(base) MacBook-Pro-4:~ Yash$ python --version
Python 3.8.16

Please have a look at https://github.com/cansik/mediapipe-silicon/issues/10#issuecomment-1413271418. Could it be that you installed the Intel version of python?

I had switched to x86_64 for a different task, my bad. Switched back and it works!


updatePrevCustos throws error

when inserting an element on the staff who's previous staff does not have a custos, an error is thrown and the element is not posted properly.

fixed in c613d54