[SPARK-14396] [Build] [HOT] Fix compilation against Scala 2.10

What changes were proposed in this pull request?
This PR is to fix the compilation errors in Scala 2.10 build, as shown in the link:
https://amplab.cs.berkeley.edu/jenkins/job/spark-master-compile-maven-scala-2.10/735/console
[error] /home/jenkins/workspace/spark-master-compile-maven-scala-2.10/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala:266: value contains is not a member of Option[String]
[error]     assert(desc.viewText.contains("SELECT * FROM tab1"))
[error]                          ^
[error] /home/jenkins/workspace/spark-master-compile-maven-scala-2.10/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala:267: value contains is not a member of Option[String]
[error]     assert(desc.viewOriginalText.contains("SELECT * FROM tab1"))
[error]                                  ^
[error] /home/jenkins/workspace/spark-master-compile-maven-scala-2.10/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala:293: value contains is not a member of Option[String]
[error]     assert(desc.viewText.contains("SELECT * FROM tab1"))
[error]                          ^
[error] /home/jenkins/workspace/spark-master-compile-maven-scala-2.10/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveDDLCommandSuite.scala:294: value contains is not a member of Option[String]
[error]     assert(desc.viewOriginalText.contains("SELECT * FROM tab1"))
[error]                                  ^
[error] four errors found
[error] Compile failed at Apr 5, 2016 10:59:09 PM [10.502s]

How was this patch tested?
Not sure how to trigger Scala 2.10 compilation in the test environment.

cc @yhuai Sorry, I did not realize this is not allowed in Scala 2.10

Test build #55096 has started for PR 12201 at commit 4036cdd.

Test build #55096 has finished for PR 12201 at commit 4036cdd.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/55096/
Test PASSed.

LGTM

Merging to master. Thanks!

Thanks!


Documentation clarification: what happens if no spot instances are available?

Describe the bug
In this documentation, I see this under OnDemandPercentage:

Default is 100% OnDemand - reduce this to use some Spot Instances when they're available and cheaper than the OnDemand price.

This implies that if no spot instances are available, we'll fall back to on-demand—even with OnDemandPercentage configured to 0.
However, I also see this issue, which says that if no spot instances are available it will continue trying indefinitely. However, that issue is several years old and I'm not sure if it's still accurate.
Which is correct?
Expected behavior
Clearer documentation about what happens when no spot instances are available and the OnDemandPercentage has already been met (or is 0).
To be clear, my desired behavior is that it falls back to on-demand and doesn't continue trying spot indefinitely.

g'day @JacobEvelyn! hopefully i can try to clear this up a little:
first off, at time of writing the elastic stack will never fall back from spot to ondemand - this is a tricky thing to do in EC2, as AWS really doesn't want to cause capacity crunches. it is technically feasible to do it, but it would require a lot of custom scaling logic.
to clarify the docs a little, the way this setting works is that the percentage of spot instances is best-effort - ie, dependent on pricing/availability etc - and the percentage of ondemand instances is guaranteed.
as an example, if i had an elastic stack with a desired count of 10 and an OnDemandPercentage of 70, if there are spot instances available, i'll have 7 on-demand instances and 3 spot instances in the elastic stack ASG. If no spot instances are available, we'll just have the 7 on-demand instances and no spot instances.
i hope this answers your question - let me know if you have any followups.

Thanks @moskyb! If there's a way to clarify that in the docs that would be helpful.


Extend dep from tech

A single "technology" e.g. "python" now implies a tuple of "packaged dependencies"....  e.g. ("python", "python-pip").

Oh and contain is implemented.

@dangle here it is.


Optional input value not correctly encoded

What version of Stacks.js are you using?
"@stacks/transactions": "4.1.0",

Describe the bug
I am using encodeClarityValue with optional(uint) and value "" and receive u0
How to reproduce
Try explorer sandbox with pox-2 allow contract caller function.
Expected behavior
The result should be none
Additional context
https://github.com/hirosystems/explorer/issues/956

Not sure what you're trying to do here. The encodeClarityValue is used for contract abi checking. Do you have an example that fails? (for the explorer issue, I believe it's a frontend bug)
This might be a test in the stacks.js codebase (RE discord)
import { encodeClarityValue } from '../src';

describe('encodeClarityValue', () => {
  test('does not supprt optional encoding', () => {
    expect(() =>
      encodeClarityValue({ optional: { 'string-utf8': { length: 5 } } }, '"foo"')
    ).toThrow();
  });
});

@friedger: Hi! I was reviewing this, and I wanted to ask if you are still having issues with it or we can close.

It is not an explorer bug. The fix to the explore was to implement encodeOptional. The fix should be part of stacks.js
export const encodeOptional = (optionalType: ClarityAbiType, value: NonTupleValueType) => {
  if (value) {
    return someCV(encodeClarityValue(optionalType, value.toString()));
  } else {
    return noneCV();
  }
};

If encodeClarityValue does not support optionals it should be clearly stated in the documentation.


1.1.0 breaks our app

https://github.com/GeoscienceAustralia/gnss-site-manager/commit/b93493297bb1f51ed1b9b84b0c547e751f410f5f
It had in it's package.json:
    "ng2-bootstrap": "^1.0.24",

And of course after 1.1.0 was release it was the version used.
npm run build.dev

errors with:
src/client/app/+home/home.component.ts(3,9): error TS2305: Module '"/Users/brooke/dev/work/ga/gnss-site-manager/node_modules/ng2-bootstrap/ng2-bootstrap"' has no exported member 'DROPDOWN_DIRECTIVES'.
src/client/app/+select-site/select-site.component.ts(5,10): error TS2305: Module '"/Users/brooke/dev/work/ga/gnss-site-manager/node_modules/ng2-bootstrap/ng2-bootstrap"' has no exported member 'PAGINATION_DIRECTIVES'.
src/client/app/+site-info/site-info.component.ts(5,10): error TS2305: Module '"/Users/brooke/dev/work/ga/gnss-site-manager/node_modules/ng2-bootstrap/ng2-bootstrap"' has no exported member 'ACCORDION_DIRECTIVES'.
src/client/app/shared/toolbar/toolbar.component.ts(4,10): error TS2305: Module '"/Users/brooke/dev/work/ga/gnss-site-manager/node_modules/ng2-bootstrap/ng2-bootstrap"' has no exported member 'DROPDOWN_DIRECTIVES'.

It would seem that the changes in 1.1.0 were for rc.5's modules.
However I couldn't find a suitable substitution for those old Directives (I found the ngModule .d.ts but I couldn't work it out from there).
Could you document how to handle this upgrade?

You have to include several modules (or full ng2-bootstrap module) to your App module instead of using <...>_DIRECTIVES.
For example:
import { TooltipModule, DropdownModule } from 'ng2-bootstrap';

@NgModule({
    imports: [
        ...
        // ng2-bootstrap
        TooltipModule, DropdownModule
    ],
    ....
})
class AppModule {}

@oehm-smith you need to import DropdownModule, PaginationModule and AccordionModule as @marcalj described.

Sweet thanks I'll give that a go.

I did that and the DropDown is not appearing.  The items are appearing outside the menu.

    <button id="menu-button" type="button" class="btn menu-btn" dropdownToggle>

    </button>

Select Site

About

Update Application

  GNSS Site Manager
  {{globalService.selectedSiteId}}

I've got it.  I shouldn't have been exporting as-well:
exports: [ToolbarComponent, NavbarComponent, CommonModule, FormsModule, RouterModule]
I don't understand why you export some but not others.  Any ideas?


Why only .gp:first-child non-selectable

Checklist

[x] I have read the newlest tutorials and know the correct effect of the functional design.
[x] There is no similar question on existing issues (including closed ones).
[x] I have tried to find the answer on Jekyll Forum and StackOverflow.
[x] My question is based on the latest code of the master branch.

Description

This commit 41ed33145639415148aec8e85edc7a6fd0de0ca3 set only .gp:first-child  non-selectable. For an example:
$ command1 --options \
> arg1 arg2
$ command2

The symbol > and the second $ can still be selected.

I believe this is an issue so keep it open.


🐞 Indentation issue

Description
When I'm editing a JSON file, if I hit enter to add a new line, it doesn't start the new line just below the position where I have the cursor on the current one. Instead it starts the new line like 4 spaces to the right.
To Reproduce
See attached video
Expected Behavior
The new line should start with the cursor on the exact same position as I left the previous line
Version Information
CodeEdit: 0.0.3-32
macOS: 13.2.1
Xcode: N/A
Additional Context
No response
Screenshots
https://user-images.githubusercontent.com/47545344/230736086-7b88142b-88ee-4f56-b769-770c5af406d4.mp4

I am unable to reproduce this bug on CodeEdit 0.0.3-alpha (37). Has it been fixed?

You are right, it has been fixed with our recent text view replacement.


Bump crossplane-runtime, upjet dependency and GMP promote to BETA

Description of your changes
In this PR:

Updated the feature flag to be true by default, and the hack main.go.tmpl to use the beta flag
Bumped crossplane-runtime dependency to the master branch
Bumped upjet dependency to the main branch

I have:

[ ] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested

/test-examples="examples/azure/resourcegroup.yaml"

/test-examples="examples/azure/resourcegroup.yaml"


Update wfs-parser and geostyler-data

Temporarily using beta releases of geostyler-wfs-parser and geostyler-data that fixes CI fails. Need to update manually, since greenkeeper only checks for tag latest.

Do we need to merge this, or is this just for testing purpose?

Sorry, too fast =)
It makes sense to merge it. So all geostyler-related packages have clean dependency setups. As soon as other dependency updates or features will be added to related packages, we can make a proper release.


Support simultaneous viewing of multiple models

Support for simultaneous viewing of multiple models in the viewer at once is required for augmented reality experiences. Consider the example of a "try-and-buy" experience where the user would like to see how multiple pieces of furniture look in their living room. Modular sofas are an example whereby different components can be combined in myriad configurations based on the dimensions of the space and the tastes of the customer. The creator of the experience should be able to add all of the sofa module models to the package. The implication is that once added to the viewer, the user would need to be able to select the bounding box for each model individually in order to manipulate it.
This is related to issue #481 in that there need to be multiple models packaged with the experience and available for selection, but this differs in that this use case requires multiple models to be simultaneously present in the viewer then selectively manipulated..

Yeah, this is a good question!
We have discussed adding basic scene composition through a mix of tools (#12) and hot-swap/configuration support (my comment on #481). A single modular sofa might be a good use case here, but a full interactive room designer (with many different sofas, couches, and lights) might not.
Longer-term, I think there may be some interesting scene composition features we could add that's more in line with what you may be thinking of. A-Frame has some really interesting work. That needs a fair bit more discussion, though.

I want to document some design discussion that has taken place side-band related to this topic.
At W3C Inclusive Design for Immersive Web standards workshop I gave a presentation that contains this slide:

This suggests a declarative API for incorporating multiple models into a single <model-viewer> element, which in turn has implications for https://github.com/GoogleWebComponents/model-viewer/issues/675, #738 and possibly other planned features.

so theoretically no limit to the number of 's, right? Good start. Lots of considerations for  how the properties operate.

Theoretically no limit beyond what is feasible with DOM nodes and the resource limitations related to loading 3D models in a browser.
Keep in mind that a single glTF model of modest complexity incurs a lot of memory overhead.

Are there any plans on implementing @cdata suggestion?

@pedrobergamini We don't really have the resources to do the declarative approach in the near term, though contributions would be welcome. I'm hoping we can get a JS API together first to add models to the scene.

@elalish any update on this? Would love this feature, especially in AR. So you could add a new table / chairs to your dining room

@jensdev Not yet; it's definitely on the roadmap, but it'll be a fair amount of work. I'm currently working on some smaller items for our upcoming release. Hopefully I can start on this thereafter.

@elalish Thanks for the update. Would be really nice to build a scene in a declarative way with different model files which can be moved/rotated. Can we see the current roadmap somewhere?

@jensdev The near term roadmap is the ToDo column in our github project. This will be a bigger piece of work that I'm not sure when I'll have time for. Any interest in collaborating on it?

Hello, is there any update about this features ? Thanks.

Would be interesting.

Consider this another upvote. I'd love to collaborate, but I'm not a web-developer by trade. Would gladly provide content, UX, and testing/validation support, however.

Hello there, just here to add a +1 on @cdata suggestion.... it could be really interesting !
Thanks for the actual work done by the way, amazing !

@david-rhodes UX would be enormously helpful, as this is pretty complicated. If you can mock up some interactions and we can talk about edge cases here, that would be great. Even the basics like selection are tricky in 3D when you have to deal with small, large, and thin objects, occlusions, collisions, etc. We currently use a bounding box instead of a ray-cast, but that may get trickier with multiple objects.

This initiative seems like it could be split into multiple phases. For example, the scene graph composition to support multiple models at once could be Phase 1. This would already support many use-cases (even without UX/interaction requirements). For example, simple configurators could swap modules or components with predetermined transformations relative to the scene root.
Phase 2 could focus on more specific UX improvements and functionality. I suspect bounding box interaction is sufficient for majority of use-cases, as well.
Side question: Is it currently possible to find a scene node from tap/click? It looks like the API only returns the point and normal?

Agreed. And no, we'll need an API that represents scene nodes in order to return a reference to one from a ray-cast. Definitely an important feature though. FYI @timmmeh

any news on this topic?

Any updates ?

This would be super useful.

What we really need here is detailed feedback on use cases and desired UX. This would add a lot  of  complexity, so we need to have a clear  idea of what  problems we're trying to solve. Are the models independently movable by user interaction, or just by script? Just in AR, or 3D as well? Are they supposed to collide or overlap?

The best would be if someone could link a three.js / WebXR example that's compelling and we could work from.

I think it could be super useful for exchangeable model parts. Lets say a gltf/glb 3d character can have exchangeable hair and shoes. Or that one can construct new 3D models by combining multiple glbs. The easiest way could be that the „src“ object takes an array of glb models and desired positioning in the scene. What do you think @elalish ?

@sprengerst That's yet a different use case / API. This issue is about separate pieces  of furniture you can  move around separately in AR. What you're referring to is more like a game engine, which we don't want to become. We give control  of swapping parts via hiding and showing materials. It's unlikely we'll go beyond that anytime soon.

What about a product configurator with multiple different options? Not unlike that previous example but I think it's definitely safe from game engine territory and that's a legitimate use-case. I can even provide a threejs example from something I've worked on if you'd like to see it.

The example of changing a character's hair or shoes is certainly something that should be handled by a game engine, but I think changing parts is the realm of 3D commerce. And I think model-viewer is often used in the area of 3D commerce.
In fact, model-viewer supports functionality similar to that, and from the Khronos Group blog, it looks like gltf may include geometry variants in the future.
Let's wait for the announcement of this feature and then think about its use cases.

I would like to have a little more discussion on this suggestion by @cdata.
In terms of adding something on top of the 3D space in the model-viewer, wouldn't the hotspot example be helpful?
The following implementation could be considered with reference to the Transforms example in Scene Graph as well.
<model-viewer alt="I will assume for now that there is no 'src' in root">
  <model-node name="table" src="table.glb" data-position="1.1m 0m -0.5m" data-orientation="0deg 0deg 50deg"></model-node>
  <model-node name="chair" src="table.glb" data-position="1.1m 0m -0.5m" data-orientation="0deg 0deg -110deg"></model-node>
</model-viewer>

I'm excited to hear back your opinions as well!
Sincerely,

@futahei Yes, that could certainly work. Can you give a sketch of how you'd make use of this on a website? It seems like it would require a lot of JS to make something more interesting than a single combined GLB. I think the original posters were asking us to do more: actually create the UX for multiple-object placement, which your API would not.

The example of changing a character's hair or shoes is certainly something that should be handled by a game engine, but I think changing parts is the realm of 3D commerce. And I think model-viewer is often used in the area of 3D commerce. In fact, model-viewer supports functionality similar to that, and from the Khronos Group blog, it looks like gltf may include geometry variants in the future. Let's wait for the announcement of this feature and then think about its use cases.

Do you have a link to some documentation where model-viewer supports that functionality? Working on a project for ordering custom beds and being able to swap out and reposition different bed posts, etc. would be super helpful.

We don't have that functionality yet, but you can always get our $scene symbol and hack away at the three.js layer. No promises about breaking changes down there though.

Hey @elalish, how would be the best way to show and hide pieces of a object ? I have variants of this pieces and I created the materials image-based, so what do I have to do regarding the code to be able to show and hide pieces of an object. And might be able to create other things as changing pieces versions, showing one model and hiding the other ones.
I would like to have a direction on how to show and hide pieces of an object? Can you point me in the correct direction please?

Generally starting a new discussion is the best place for these kinds of questions. You can access the GLB materials to edit them using our material API: https://modelviewer.dev/examples/scenegraph/#pickMaterialExample
You can also create/select variant materials, which is what we do in our editor. You might want to look at its code base for inspiration: https://github.com/google/model-viewer/blob/master/packages/space-opera/src/components/materials_panel/materials_panel.ts

I have another use case for this....
I have a model, which has, for example, a field with 100 sheep.
The sheep model weighs 0.1mb, but since there is 100 of them, it weighs 10mb
b total.
It would be much better for me to download the 0.1mb sheep, and instance it 100 times, than to force the user to download a 10mb model.
.... in my case it isnt sheep, but robotic equipment, but you get the idea....

@calumk Actually glTF already takes care of this. You can store a single sheep Mesh and reference it in any number of nodes with different transforms. You can even animate all those nodes independently and scrub through the animation with currentTime.

@elalish - oh really? Thats great to know, i hadnt even considered it might be supported by gltf .... I will take a look!

Any update regarding this feature.
Or any collaboration to build this?

@nirajmohanrana It's a pretty broad feature; you could help us by explaining your use case and what kind of API might help. I do plan to add a large feature to help enable this, but if you're hoping for more multi-model placement UX in, say, AR, then we could certainly use help there.

I want API to handle multi-model placement it would be great to have it.
Is there any development going on this?
I would like to contribute on this.

@nirajmohanrana Excellent, this is basically the next big feature I want to work on. A very helpful contribution right now would be to work on the UX design for placement. If you can hack together any kind of demo, that would be excellent. The main things we need to figure out is where the user's click/touch should do what. We use hits on the placement box (ground outline) currently to move things in AR and outside it to turn them. It's unclear how to map that once multiple objects are in the scene. And what happens when they overlap? Or are collisions detected and avoided?

@elalish I think there should be collision detection (here we can turn hover to red when it occurs).

As for the demo I got this example online:

Blog
YouTube Video
AR Media - Their Website
Which is trying to do the same.

Also here we are talking specifically about the Dining Set in which AR Placement is at Floor, it should also support for Walls consider Multiple Photo Frames or Paintings as examples.
I will try to create UX for it (not good at it, I am developer🙂)

I like the example. I think collisions will be had in practice - bounding box collisions are cheap, but we preclude e.g. pushing a chair under a table. Full 3D collisions will get expensive, especially for fairly high-poly e-commerce models. Perhaps the red box based on bound-box collisions, but without actually blocking the motion is a good compromise.
Currently we choose between translation and rotation by hitting the floor box. For object selection we may need to do a hit test against their meshes instead (like getMaterialFromPoint). Should we only do two-finger rotation to avoid accidental selection? These are the kinds of details it would be great to prototype and try out.

@elalish Do you know any related prototype designer for 3d contents.
I will try to create it.
Also please share references for it if possible.

I'd probably just start (or fork) a three.js project in Glitch or similar. No need for AR - the UX can be worked out in 3D with a simple ground plane and a hit test.

@elalish any update about the multi-object placement  feature?

Not planned yet, and as I say, we haven't even gotten a clear UX design for what we ought to build here. Lots of details to think about - any thoughts appreciated!

We'll be prototyping a e-commerce configurator-like experience and will probably be using the GLTF extension system to embed the configuration / relations of models to each other directly in the GLB.
Example, you're building a grill:

select one of the base models, ie. the "body"
the model's GLB has two extension points, legs and plate, each extension point defines rules for geometry how the extension is supposed to get fitted to it
when you select the legs model, they get snapped into place by the geometry rules from the model they're snapping to
new models can have extension points to, meaning you get to snap a utensils box on the legs you've just added, if they allow it
the snapping rules will probably use other things like how the "joint" works, as in, the legs attached to the base are fixed, moving the legs moves the whole model, but the utensils box can spin around the leg it's attached to, this should allow us to define these things basically per permutation (say: utensils type A spins, utensils type B doesn't spin)

Hope this helps anyone even if just to jump start some totally different idea. :)

Yes, fair enough - with my approach you'd need to make your choices first and load up a corresponding animated GLB, which is a different UX. As another thought - there has been talk within the glTF working group of making a mesh variants extension, akin to the existing material variants extension. That could be another solution, and there's also a physics extension being worked on that might help with the joint-motion idea. I'd recommend you get connected in Khronos and start coming to some of those meetings because you could help drive the design in a use-case-focused way, which is always best.

@elalish

I'd recommend you get connected in Khronos and start coming to some of those meetings

Got a suggestion how we'd go about doing that, where do we start?

Check out the "Join the glTF Community" section of https://www.khronos.org/gltf/

I am also looking to build a configurator (e.g. Car Configurator), where the user can customize some parts like rims, wheels, sunroof, steering wheel, ... etc. in my case no need to define snapping or joint points, for example the different variants of wheels will be modeled to take its position in the main model at the same coordinates, so simply loading the wheel glb and combine it with the main object will work. The user may also change color, size of the new selected variant, so accessing and changing the materials of the loaded object must be possible. At the end I will save the customization settings as json file containing the selected parts names and materials.
I know this can be done using single glb file that contains all different variants for the customizable parts, but imagine there is 50 different variants of the wheels only! this will increase the file size a lot and it may not load at all after some point.
So being able to combine different glb files during run time will be a great addition :)


zh-TW chinese translation

Make a translation of MathCat for traditional chinese(zh-TW).

FYI: the code has now been merged that supports a language subdomain. So when you deal with my comments, your translation should work with a new NVDA build.

I also see that ordinals numbers don't seem to be used in Chinese. However, you did leave one instance in "overview.yaml". Was that intentional?

This is my mistake.
When I investigate why I do not find this mistake. I found all unittest DO NOT touch the rule overview::mroot. Then I found english version of unittest also DO not touch overview::mroot.
Then I found something looks like duplicates is Speak_Rules and overview. overview::mroot is similar to SimpleSpeak::root. It seems SimpleSpeak::root have higher priority.
After inspect english version of the rule SimpleSpeak::root, may be I found some bug in there. If we perform following test, we can find the issue.
#[test]
fn ordinal_root_2() {
    let expr = "<math>
                    <mroot> <mi>x</mi> <mn>9.1</mn> </mroot>
                </math>";
    test("en", "SimpleSpeak", expr, "the 9.1-th root of x,");
}

Ther error message is
  left: "the 9.1-th root of x,"
 right: "the of x,"

I think the problem arise form Line 49-50 of SimpleSpeak_Rules.yaml
      - else_if: "*[2][not(contains(., '.'))]"
        then: [{x: "ToOrdinal(*[2])"}, {t: "root"}]        # phrase(the square 'root' of x)

lack else part.
I also suspect Line 78 in english version of overvie.yaml should up one level(indentation less)
      - x: "*[1]"

otherwise when IsNode(*[1], 'simple') is not true, nothing about *[1] will output.
As a summary, I will fix  my mistake.
I suggest MathCAT can arrange an unit test to test overview::mroot(I do not know how) to benefit other translators.

default.yaml: I see two rules on "mfrac" that speak the numerator before the denominator. That seems wrong.

The first one is correct. It is about combination not ordinary fraction.
The second one is correct also if it is also about combination. But my unit test/integration test never touch it.
May be you can tell me how to create a unit test about this one.

unicode-full.yaml: I see that you did most of the transations (very impressive!) and reverted some of them back to English (mostly in the first ~220 lines). Is there a reason for that?

Many characters in Unicode we have no chinese name. I think keep it in english is more appropriate.
If I think some chinese name is appropriate I mark if from "t" to "T". If I am not sure I just leave it as "t".

Were you able build MathCAT and run the test files using Rust? If so, do they all pass?

I do run  cargo test Languages::zh and got following message
test result: ok. 244 passed; 0 failed; 1 ignored; 0 measured; 450 filtered out; finished in 2.40s

Because there is no ClearSpeak translation, remove the ClearSpeak test files -- there is no reason to keep them there. If you ever do implement ClearSpeak, you can add them back.

I will remove ClearSpeak test files

you should either remove the test or change "ClearSpeak" to "SimpleSpeak" and make the output correct for SimpleSpeak.

I need some time to do it.
Thank you for your patient.

default.yaml: I see two rules on "mfrac" that speak the numerator before the denominator. That seems wrong.

Very sorry, I am wrong. I am confused it with tag binomial in general.yaml.
I will correct it.

I appreciate all the work you did, especially getting the tests to pass.

I'm getting close to a release with your work in it. I'd like to credit you on my MathCAT page. Is that ok? If so, what name and what affiliation should I use?

My name is
Hon-Jang Yang

I've added your name. Take a look and see if there are any changes you would like me to make.

Very Thanks


Getting Plugin error: cycle in imports while trying bookstore sample yaml file

I'm trying with gnostic-grpc to convert a yaml file to proto file. I tried with my own sample obtained the above error. So i tried with the bookstore.yaml file.
Command
./gnostic --grpc-out=service /Users/piraveena/Documents/test/swagger.yaml
Error logs
level:INFO code:"DOCUMENTFIELDS" text:"Field: 'servers' is not supported for the OpenAPI document with title: Bookstore" keys:"servers"
level:INFO code:"DOCUMENTFIELDS" text:"Field: 'security' is not supported for the OpenAPI document with title: Bookstore" keys:"security"
level:INFO code:"COMPONENTSFIELDS" text:"Field: 'securitySchemes' is not supported for the component" keys:"components" keys:"securitySchemes"
level:INFO code:"SCHEMAFIELDS" text:"Field: 'required' is not supported for the schema: book" keys:"components" keys:"schemas" keys:"book" keys:"required"
level:INFO code:"SCHEMAFIELDS" text:"Field: 'required' is not supported for the schema: listBooksResponse" keys:"components" keys:"schemas" keys:"listBooksResponse" keys:"required"
level:INFO code:"SCHEMAFIELDS" text:"Field: 'required' is not supported for the schema: shelf" keys:"components" keys:"schemas" keys:"shelf" keys:"required"
level:INFO code:"SCHEMAFIELDS" text:"Field: 'required' is not supported for the schema: error" keys:"components" keys:"schemas" keys:"error" keys:"required"
level:INFO code:"REQUESTBODYFIELDS" text:"Field: 'required' is not supported for the request: createShelf" keys:"paths" keys:"/shelves" keys:"post" keys:"requestBody" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: shelf" keys:"paths" keys:"/shelves/{shelf}" keys:"get" keys:"parameters" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: shelf" keys:"paths" keys:"/shelves/{shelf}" keys:"delete" keys:"parameters" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: shelf" keys:"paths" keys:"/shelves/{shelf}/books" keys:"get" keys:"parameters" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: shelf" keys:"paths" keys:"/shelves/{shelf}/books" keys:"post" keys:"parameters" keys:"required"
level:INFO code:"REQUESTBODYFIELDS" text:"Field: 'required' is not supported for the request: createBook" keys:"paths" keys:"/shelves/{shelf}/books" keys:"post" keys:"requestBody" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: shelf" keys:"paths" keys:"/shelves/{shelf}/books/{book}" keys:"get" keys:"parameters" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: book" keys:"paths" keys:"/shelves/{shelf}/books/{book}" keys:"get" keys:"parameters" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: shelf" keys:"paths" keys:"/shelves/{shelf}/books/{book}" keys:"delete" keys:"parameters" keys:"required"
level:INFO code:"PARAMETERFIELDS" text:"Field: 'required' is not supported for parameter: book" keys:"paths" keys:"/shelves/{shelf}/books/{book}" keys:"delete" keys:"parameters" keys:"required"
Errors reading /Users/piraveena/Documents/test/swagger.yaml
Plugin error: [cycle in imports: swagger.proto -> swagger.proto]%

Go version: go version go1.19 darwin/amd64
And I'm using latest gnostic-grpc
Any idea why I'm getting above errors

I've also got these errors. Could someone take a look?

Hey, I encountered the same issue.
The easiest way to fix it is specifying a relative path to OpenAPI contract instead an abosule path.
Other possible solution:
The issue is most probably on gnostic side. Particularly, function isSymbolicReference works wrong if an absolute path specified.
One can try to add condition "if sourceName and ref are not the same file" in the if-statement.
It will break support of OpenAPI contracts distributed among multiple files. For example, other.yaml test will fail


objc[1876]: Class GNotificationCenterDelegate is implemented in both /Users/userName/image-processor/node_modules/sharp/vendor/lib/libgio-2.0.0.dylib (0x1076f5578) and /usr/local/opt/glib/lib/libgio-2.0.0.dylib (0x10823b578). One of the two will be used. Which one is undefined.

What is the output of running npx envinfo --binaries --languages --system --utilities?

System:
OS: macOS Mojave 10.14.6
CPU: (4) x64 Intel(R) Core(TM) i5-7360U CPU @ 2.30GHz
Memory: 88.89 MB / 8.00 GB
Shell: 3.2.57 - /bin/bash
Binaries:
Node: 10.16.3 - ~/.nvm/versions/node/v10.16.3/bin/node
npm: 6.9.0 - ~/.nvm/versions/node/v10.16.3/bin/npm
Utilities:
Make: 3.81 - /usr/bin/make
GCC: 10.14. - /usr/bin/gcc
Git: 2.23.0 - /usr/local/bin/git
Clang: 1<IP_ADDRESS> - /usr/bin/clang
Subversion: 1.10.3 - /usr/bin/svn
Languages:
Bash: 3.2.57 - /bin/bash
Go: 1.13 - /usr/local/bin/go
Java: 11.0.2 - /usr/bin/javac
Perl: 5.18.4 - /usr/bin/perl
PHP: 7.1.23 - /usr/bin/php
Python: 2.7.16 - /usr/local/bin/python
Python3: 3.7.0 - /Library/Frameworks/Python.framework/Versions/3.7/bin/python3
Ruby: 2.3.7 - /usr/bin/ruby

What are the steps to reproduce?

I'm trying to use a base64 encoded SVG in an SVG image's source

What is the expected behavior?

When I use base64 encoded SVG in another SVG's image source, the library must convert it to a png file.

Are you able to provide a standalone code sample, without other dependencies, that demonstrates this problem?

    })
Are you able to provide a sample image that helps explain the problem?

Yes, Here's a Fiddle to show clearly what I'm trying to do. I need to convert this image to a PNG file

Terminal Output;
objc[5120]: Class GNotificationCenterDelegate is implemented in both /Users/mustafa/image-processor/node_modules/sharp/vendor/lib/libgio-2.0.0.dylib (0x107675578) and /usr/local/opt/glib/lib/libgio-2.0.0.dylib (0x1081a1578). One of the two will be used. Which one is undefined.
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.859: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.859: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.859: gdk_pixbuf_set_option: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.859: gdk_pixbuf_set_option: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.860: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.860: gdk_pixbuf_get_width: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.860: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.860: gdk_pixbuf_get_height: assertion 'GDK_IS_PIXBUF (pixbuf)' failed
(sharp:5120): GdkPixbuf-CRITICAL **: 14:45:34.860: gdk_pixbuf_scale_simple: assertion 'GDK_IS_PIXBUF (src)' failed

Are there any other native dependencies such as canvas involved? If so, as you're relying on a globally-installed cairo for canvas you must therefore also rely on a globally-installed libvips for sharp.
See also https://github.com/Automattic/node-canvas/issues/1386

I checked my global and project dependencies and I found ImageMagick in my global dependencies and I removed it but didn't work! Also, I've edited the issue with an error log

You'll need to reinstall/rebuild sharp after globally-(re)installing vips so it links against the global version rather than the locally-vendored version.

I used both local and global vips but unfortunately it didn't work!

If the path node_modules/sharp/vendor/lib/libgio-2.0.0.dylib is still appearing in the error message then you're still using the locally-vendored libvips and its dependencies. Perhaps remove the node_modules/sharp directory, reinstall sharp and ensure the node_modules/sharp/vendor does not exist.

@Mustafax06 Were you able to make any progress with this?

Closing due to inactivity but please feel free to reopen with more details if further help is required.

Same issue here:
objc[48917]: Class GNotificationCenterDelegate is implemented in both /Users/dhowe/git/spectre/node_modules/sharp/vendor/lib/libgio-2.0.0.dylib (0x107d08578) and /Users/dhowe/git/spectre/node_modules/canvas/build/Release/libgio-2.0.0.dylib (0x10958e588). One of the two will be used. Which one is undefined.

I'm getting the same waring:
objc[76528]: Class GNotificationCenterDelegate is implemented in both /Volumes/Felix/Work/Highlighter/highlighter-backend/node_modules/canvas/build/Release/libgio-2.0.0.dylib (0x106241568) and /Volumes/Felix/Work/Highlighter/highlighter-backend/node_modules/sharp/vendor/lib/libgio-2.0.0.dylib (0x1076be578). One of the two will be used. Which one is undefined.

Same issue -- why was this closed? It is quite annoying

If canvas and sharp are used together in the same process, both using the prebuilt binaries each provides, then this warning is unavoidable.
Have you tried ensuring both cairo and vips are globally-installed before canvas and sharp, as recommended in https://github.com/lovell/sharp/issues/1917#issuecomment-541744780 ?
See https://github.com/lovell/sharp-libvips/issues/39 for a future possible enhancement to experiment with statically-linking the dependencies of libvips.

objc[11334]: Class GNotificationCenterDelegate is implemented in both /Users/huanghuazhi/Desktop/projects/zwdc/frontend/previewer/node_modules/_canvas<EMAIL_ADDRESS>(0x1089df588) and
/usr/local/opt/glib/lib/libgio-2.0.0.dylib (0x10b655948). One of the two will be used. Which one is undefined.
as you can see vips is globally and locally installed . and canvas and sharp were both rebuild. but this error still occurs? any idea please?

and node_modules/sharp/vendor do not exist

does sharp support anti-alising image?

@constantank You have the inverse problem, namely that node-canvas is using its own prebuilt cairo rather than a globally-installed cairo.
Please see the kernel option of resize and if you still have a question about anti-aliasing, please open a new "question" issue ensuring you answer all of the questions, provide sample images and the code you're using.


Fix odnoklassniki backend

Fix scope separator which is ";" in OK api
Fix logic of get_user_details, it will correctly process email in OK response (because OK may return email in response in case you have permissions for that and scope "GET_EMAIL")

Thanks!


Help compiling on PowerPC linux?

I'm attempting to build atom for my powermac g5 running ubuntu mate and am getting this error.  I was able to compile nodejs from the source without issue although the build script is trying to download node for ppc?
OS
Linux AaronG5 4.4.0-36-powerpc64-smp #55-Ubuntu SMP Thu Aug 11 18:23:55 UTC 2016 ppc64 ppc64 ppc64 GNU/Linux
aaron@AaronG5:~/Build/atom$ ./script/build --create-debian-package
Node:	v4.5.0
Npm:	v3.10.6
Installing script dependencies
Installing apm
download not found: http://nodejs.org/dist/v4.4.5/node-v4.4.5-linux-ppc.tar.gz
/home/aaron/Build/atom/apm/node_modules/atom-package-manager/bin/apm: line 35: /home/aaron/Build/atom/apm/node_modules/atom-package-manager/bin/node: No such file or directory
child_process.js:488
    throw err;
    ^

Error: Command failed: /home/aaron/Build/atom/apm/node_modules/atom-package-manager/bin/apm --loglevel=error install
    at checkExecSyncError (child_process.js:465:13)
    at Object.execFileSync (child_process.js:485:13)
    at module.exports (/home/aaron/Build/atom/script/lib/install-atom-dependencies.js:19:16)
    at Object.<anonymous> (/home/aaron/Build/atom/script/bootstrap:28:1)
    at Module._compile (module.js:409:26)
    at Object.Module._extensions..js (module.js:416:10)
    at Module.load (module.js:343:32)
    at Function.Module._load (module.js:300:12)
    at Module.require (module.js:353:17)
    at require (internal/module.js:12:17)

Was able to get it to build by linking my node to apm/node_modules/atom-package-manager/bin/node and installing node-gyp manually to apm/node_modules/atom-package-manager/
Here's my .deb for anyone else interested.
https://www.dropbox.com/s/jjo7775jkjn3gvq/atom-ppc.deb?dl=0

Still compiling atom binary for the wrong arch.

Electron doesn't support PPC, sorry


Reference Architecture returns a few errors

I ran into a few errors while I was testing the reference architecture for the v6.0 docs.
A few examples:-

SELECT expire_old_request_data() returns

ERROR:  COMMIT is not allowed in a SQL function
CONTEXT:  SQL function "expire_old_request_data" during startup

Errors in the CREATE AGGREGATE function

CREATE AGGREGATE sum (hll)
(
  sfunc = hll_union_agg,
  stype = internal,
);

sfunc should be a function and there is an extra , after stype.

A couple of queries refer to minute, however there isn't a minute column in the http_request_1min table.

We should have a look at these errors and fix them.

All of these are fixed and pushed to master.


Please use uptodated 'Masterminds/sprig'

version info: frep-1.3.10-linux-amd64
According to git.mod, frep now uses  'Masterminds/sprig' of V2.22.
github.com/Masterminds/sprig v2.22.0+incompatible
I hope to have a  'get' dict function  which is available from V3 of  'Masterminds/sprig'.
I always use frep with '--missing error'.
With 'get', I can say somthing like
{{ if eq (get . "optional_value")  "ON" }}
instead of
{{ if hasKey  . "optional_value" }} {{ if eq .optional_value "ON" }}

I will upgrade to sprig V3 for next major version.

This idiom seems to work with --missing error --strict
{{ append (pluck "optionalvalue_value" .) "UNDEF" | first }}

what's the ETA, having get would be so great


Problem to set date manually datepicker when chage nzFormat

Version
1.8.0
Environment
Windows
Reproduction link
https://ng-zorro-antd-start-cekrxg.stackblitz.io
Steps to reproduce
Set dateformat to yyyy-MM-dd in the nz-datepicket, after set date manually in the input box datepicker a date for example 2018-01-01
What is expected?
Ever
What is actually happening?
Problem to set manually date when dateFormat is changed. For example, if you set nzFormat to yyyy/MM/dd set date manually work fine, the datepicker set a date like 2018/01/01 then hide, this is ok. But when nzFormat is set to yyyy-MM-dd, set date manually not work, the datepicker is maintain visible and if you does click outside the calendar the date is not set
Other?

It seems everything works fine in your repro link? Would you plz provide more detail information?

You must set the date manually entering in the input box from the datepicker

I confirm the defect. Manual input only works if the format is using "/" . Any format otherwise don't work.
What's funny is that the doc page is using the "-" format. Go take a look and you'll see it's not working.

Ok, then can you repair this? I stopped using ng-zorro because this... LOL
In Chile this is very important, because the people often digit the date
not picker... thanks for you reply...
El El mié, 12 de jun. de 2019 a las 10:40, Mathieu Bélanger <
<EMAIL_ADDRESS>escribió:

I confirm the defect. Manual input only works if the format is using "/" .
Any format otherwise don't work.
What's funny is that the doc page is using the "-" format. Go take a look
and you'll see it's not working.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/NG-ZORRO/ng-zorro-antd/issues/2492?email_source=notifications&email_token=ADYT2RFNQDJFDOJ32FV74MDP2EDGPA5CNFSM4GFMKJ72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXQUYUA#issuecomment-501304400,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADYT2RBO2XQHMN7UOV353Z3P2EDGPANCNFSM4GFMKJ7Q
.

--
Saludos,
Fabián E. Beas Pizarro
Ingeniero en Informática
[image: image.png]
Coordinador Distrital Unidad de Guías
Responsable de Unidad
Grupo Fernando de Aragón
Móvil: +56995482747

@FabianBeas I don't have the time right now to do it, but why don't you simply switch the format to something like "yyyy/MM/dd" ? With this one the manual input is working.

The official format for Chile is dd-MM-yyyy otherwise is rare... Common
users don’t understand or it is difficult for them...
El El mié, 12 de jun. de 2019 a las 11:00, Mathieu Bélanger <
<EMAIL_ADDRESS>escribió:

@FabianBeas https://github.com/FabianBeas I don't have the time right
now to do it, but why don't you simply switch the format to something like
"yyyy/MM/dd" ? With this one the manual input is working.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/NG-ZORRO/ng-zorro-antd/issues/2492?email_source=notifications&email_token=ADYT2RDYTUCWYF53GM56YGTP2EFQRA5CNFSM4GFMKJ72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODXQXAWQ#issuecomment-501313626,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADYT2RC7YJ4ESNGH3A5ZQP3P2EFQRANCNFSM4GFMKJ7Q
.

--
Saludos,
Fabián E. Beas Pizarro
Ingeniero en Informática
[image: image.png]
Coordinador Distrital Unidad de Guías
Responsable de Unidad
Grupo Fernando de Aragón
Móvil: +56995482747

@FabianBeas It works fine now.

This not work for format dd-MM-yyyy
El El mié, 19 de jun. de 2019 a las 08:01, Wenqi<EMAIL_ADDRESS>escribió:

[image: N3LAhgDE8U]
https://user-images.githubusercontent.com/23337087/59763600-84c50980-92cc-11e9-9cdd-dbe65ca478ff.gif
@FabianBeas https://github.com/FabianBeas It works fine now.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/NG-ZORRO/ng-zorro-antd/issues/2492?email_source=notifications&email_token=ADYT2RHNFXDC6X7HFTNVSXDP3IN3DA5CNFSM4GFMKJ72YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYBUMPI#issuecomment-503531069,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADYT2RFPMBKUI4NX7GMTYCLP3IN3DANCNFSM4GFMKJ7Q
.

--
Saludos,
Fabián E. Beas Pizarro
Ingeniero en Informática
[image: image.png]
Coordinador Distrital Rama Guías
Responsable de Unidad
Grupo Fernando de Aragón
Móvil: +56995482747

Waiting dateFns update to 2.0.0 stable version which support parse.

@wenqi73 date-fns has now released 2.0.0 so can this be looked at again please?

I think problem is here:
components/date-picker/lib/calendar/calendar-input.component.ts
 onInputKeyup(event: KeyboardEvent, isEnter: boolean = false): void {
    const date = this.checkValidInputDate(event);

    if (!date || (this.disabledDate && this.disabledDate(date.nativeDate))) {
      return;
    }

    this.value = date;
    this.valueChange.emit({ date, isEnter });
  }

  private checkValidInputDate(event: Event): CandyDate | null {
    const input = (event.target as HTMLInputElement).value;
    const date = new CandyDate(input);

    this.invalidInputClass = '';
    if (!date.isValid() || input !== this.toReadableInput(date)) {
      // Should also match the input format exactly
      this.invalidInputClass = `${this.prefixCls}-input-invalid`;
      return null;
    }

    return date;
  }

Problem is const date = new CandyDate(input); You should support new CandyDate with dev's format.


Missing records !!

Hi,
We're running mysql 5.7 with master-slave replication based on GTID mode. The database is large 11Gb of size and we need it to convert to postgres. To do it, we used chameleon tool and setup replication with mysql slave (without GTID). On init-replica, the data took some time and replicated to postgres but on checking we found that records are missing e.g there is one table 'users' whose count in mysql is 5lac while its count in postgres replicated databases is 1lac. Is there any buffers that we need to tweak to migrate large database with chameleon?
PS: On pgloader, all records were migrated correctly but since it'll required significant amount of downtime during live migration from mysql to postgres due to which we want to go with pg_chameleon solution.
Awaiting your response!

Update: I just came to know that after 1lac rows are inserted, following errors are started to generate for other entries in same table :-
http://prntscr.com/lo1897
Is there any fix for this ?

Hi, can you please give me more details about the table? It seems like a wrong not null constraint set in the postgresql database

Did you set the row image full on mysql?

Hi, can you please give me more details about the table? It seems like a wrong not null constraint set in the postgresql database

Hi, it was these values creating issues 0000-00-00 00:00:00
We fixed these values in mysql before running chameleon and error got fixed. However we now have another error on different table :-
"sprite_thumbs_no","tr_stored_thumbs","mass_embed_status","is_hd","ebay_epn_keywords","ebay_pre_desc","unique_embed_code","mature_content","remote_play_url","server_ip","file_server_path","files_thumbs_path","file_thumbs_count","has_hq","has_mobile","filegrp_size","process_status","has_hd","file_directory","extras","test") VALUES (\'203471\',\'3B18NBXRUN9W\',\'3\',\'\',\' \',\'6123\',\'Woe To Me \xe1\xb4\xb4\xe1\xb4\xb0 - O That I Regret\',\'1374303078076cd\',\'Woe To Me \xe1\xb4\xb4\xe1\xb4\xb0 - O That I Regret\',\'Woe To Me \xe1\xb4\xb4\xe1\xb4\xb0 - O That I Regret\',\'#24# \',\'24\',\'public\',\'\',\'2013-07-20\',\'0\',\'yes\',\'0\',\'0\',\'0\',\'0\',\'\',\'yes\',\'yes\',\'0\',\'2018-11-28 11:09:23\',\'pending\',\'no\',\'2018-11-28 11:06:51\',\'\',\'yes\',\'yes\',\'0\',\'0\',\'1\',\'2018-11-28 11:11:58\',\'2013-07-20 02:53:47\',\'no\',\'255.76\',\'\',\'none\',NULL,\'1\',\'\',\'none\',\'\',\'0\',\'<IP_ADDRESS>\',\'0\',\'\',\'0\',\'0\',\'0\',\'no\',\'no\',\'\',\'\',\'\',\'no\',\'none\',\'<IP_ADDRESS>\',\'http://lwx003.domain.com/files\',\'http://lwx003.domain.com/files/thumbs\',\'25\',\'no\',\'yes\',\'40886689\',\'2\',\'no\',\'2013/07/20//\',\'{"redirect":"","invactive_message":"","redirect_id":""}\',NULL);' 2018-11-28 14:00:31 MainProcess ERROR pg_lib.py (3509): SQLCODE: 22P02 SQLERROR: ERROR:  invalid input value for enum _cb_tune_01_tmp.enum_cb_video_status: "" LINE 1: ...28 11:11:58','2013-07-20 02:55:30','no','1830.77','','none',...

0000-00-00 00:00:00  it's an issue with the library :( it converts the output in null. there is a PR to have it working differently but still in wait since 2017 :(
For the different error, can you provide the table structure and an example record so I can reproduce it?
thanks

For the different error, can you provide the table structure and an example record so I can reproduce it?

It was some enum value related, we ran mysql query to clean it and then did the migration which fixed this issue. Now we've a table which is falling back to INSERT from COPY and taking significantly high time to complete. Is there a way to know why is it  falling back to insert ? Here is some warnings this table generates during migration :
2018-11-29 05:22:27 MainProcess DEBUG mysql_lib.py (509): estimating rows in domain_001.cb_action_log 2018-11-29 05:22:27 MainProcess DEBUG mysql_lib.py (539): The table domain_001.cb_action_log will be copied in 2  estimated slice(s) of 3932160 rows 2018-11-29 05:22:27 MainProcess DEBUG mysql_lib.py (477): locking the table domain_001.cb_action_log2018-11-29 05:22:27 MainProcess DEBUG mysql_lib.py (479): collecting the master's coordinates for tabledomain_001.cb_action_log 2018-11-29 05:22:27 MainProcess DEBUG mysql_lib.py (548): Executing query for table domain_001.cb_action_log 2018-11-29 05:23:55 MainProcess INFO mysql_lib.py (570): Table _cb_domain_01_tmp.cb_action_log error in PostgreSQL copy, saving slice number for the fallback to insert statements 2018-11-29 05:23:55 MainProcess INFO mysql_lib.py (644): Table domain_001.cb_action_log copied 1 slice of 2 2018-11-29 05:24:46 MainProcess INFO mysql_lib.py (644): Table domain_001.cb_action_log copied 2 slice of 2 2018-11-29 05:24:46 MainProcess INFO mysql_lib.py (621): Executing inserts in _cb_domain_01_tmp.cb_action_log. Slice 1. Rows per slice 3932160. 2018-11-29 05:35:07 MainProcess WARNING pg_lib.py (3512): character mismatch when inserting the data, trying to cleanup the row data 2018-11-29 05:35:07 MainProcess WARNING pg_lib.py (3512): character mismatch when inserting the data, trying to cleanup the row data 2018-11-29 05:35:07 MainProcess WARNING pg_lib.py (3512): character mismatch when inserting the data, trying to cleanup the row data

Mmm it should show the failing row. I'll have a look ASAP. In the meantime, what error is logged by postgresql?
Thanks

Mmm it should show the failing row. I'll have a look ASAP. In the meantime, what error is logged by postgresql?
Thanks
Hi, That's what postgres showed in logs, chameleon didn't showed anything during migration though:

2018-11-29 05:55:27.746 EST [60170] ERROR:  invalid byte sequence for encoding "UTF8": 0x00 2018-11-29 05:55:27.746 EST [60170] CONTEXT:  COPY cb_action_log, line 1221141 2018-11-29 05:55:27.746 EST [60170] STATEMENT:  COPY "_cb_tune_01_tmp"."cb_action_log" ("action_id","action_type","action_username","action_userid","action_useremail","action_userlevel","action_ip","date_added","action_success","action_details","action_link","action_obj_id","action_done_id") FROM STDIN WITH NULL 'NULL' CSV QUOTE '"' DELIMITER ',' ESCAPE '"' ;

ok this is a classic issue with the nul character that the system manages with the inserts.
if you want to speed up the copy you should cleanup the data on mysql removing the nul chars.

I'm closing the ticket as there's no follow up.


Documentation version

I want to try out this package. For compatibility with the rest of my stack I need to use the 2.0-RC version. I'm wondering if the documentation at https://amphp.org/http-server/ is for 1.1 or 2.0. And if it is for stable 1.1 then is there an updated version of the documentation somewhere?
Thanks!

It's always what's contained in the master branch in the ./docs directory. It's mainly for 1.1, as we haven't updated much for 2.x, yet, I think.

I see. Ok, I'll be careful about possible differences when using 2.0. Thanks.

@enumag Skim through the 2.0 RC release notes for a quick summary of changes. There's a good amount of changes, but few (if any) touch the request/response stack, so most of the docs still apply and most user code for 1.x should work fine with 2.0.


Create 44.json

Bingo!

Hi! I think you're at the mozfest session? :star: You'll need to submit this pull request against jlord's repository, so I'm going to close this out!
Good luck! 🍀


ECDHE-ECDSA-AESx-GCM-SHAx ciphers not working

Hello Envoy Team,
Using envoyproxy/envoy:v1.11.2
If I specify either of the following:
cipher_suites:
   - ECDHE-ECDSA-AES128-GCM-SHA256
   - ECDHE-ECDSA-AES256-GCM-SHA384

or
  - TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256
  - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

c02b and c02b  here https://testssl.sh/openssl-iana.mapping.html
neither seem to actually work:
CONNECTED(00000003)
4388959852:error:14004410:SSL routines:CONNECT_CR_SRVR_HELLO:sslv3 alert handshake failure:/BuildRoot/Library/Caches/com.apple.xbs/Sources/libressl/libressl-22.260.1/libressl-2.6/ssl/ssl_pkt.c:1205:SSL alert number 40
4388959852:error:140040E5:SSL routines:CONNECT_CR_SRVR_HELLO:ssl handshake failure:/BuildRoot/Library/Caches/com.apple.xbs/Sources/libressl/libressl-22.260.1/libressl-2.6/ssl/ssl_pkt.c:585:
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 7 bytes and written 0 bytes
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
SSL-Session:
    Protocol  : TLSv1.2
    Cipher    : 0000
    Session-ID:
    Session-ID-ctx:
    Master-Key:
    Start Time:<PHONE_NUMBER>
    Timeout   : 7200 (sec)
    Verify return code: 0 (ok)
---
$ openssl s_client -tls1_2 -cipher 'ECDHE-ECDSA-AES256-GCM-SHA384' -connect <IP_ADDRESS>:8443
CONNECTED(00000003)
4561831532:error:14004410:SSL routines:CONNECT_CR_SRVR_HELLO:sslv3 alert handshake failure:/BuildRoot/Library/Caches/com.apple.xbs/Sources/libressl/libressl-22.260.1/libressl-2.6/ssl/ssl_pkt.c:1205:SSL alert number 40
4561831532:error:140040E5:SSL routines:CONNECT_CR_SRVR_HELLO:ssl handshake failure:/BuildRoot/Library/Caches/com.apple.xbs/Sources/libressl/libressl-22.260.1/libressl-2.6/ssl/ssl_pkt.c:585:
---
no peer certificate available
---
No client certificate CA names sent
---
SSL handshake has read 7 bytes and written 0 bytes
---
New, (NONE), Cipher is (NONE)
Secure Renegotiation IS NOT supported
Compression: NONE
Expansion: NONE
No ALPN negotiated
SSL-Session:
    Protocol  : TLSv1.2
    Cipher    : 0000
    Session-ID:
    Session-ID-ctx:
    Master-Key:
    Start Time:<PHONE_NUMBER>
    Timeout   : 7200 (sec)
    Verify return code: 0 (ok)
---

in the envoy logs we see:
front-envoy_1  | [2019-11-12 05:27:14.631][18][debug][connection] [source/extensions/transport_sockets/tls/ssl_socket.cc:168] [C2] handshake error: 2
front-envoy_1  | [2019-11-12 05:27:14.632][18][trace][connection] [source/common/network/connection_impl.cc:458] [C2] socket event: 3
front-envoy_1  | [2019-11-12 05:27:14.632][18][trace][connection] [source/common/network/connection_impl.cc:543] [C2] write ready
front-envoy_1  | [2019-11-12 05:27:14.632][18][debug][connection] [source/extensions/transport_sockets/tls/ssl_socket.cc:168] [C2] handshake error: 1
front-envoy_1  | [2019-11-12 05:27:14.632][18][debug][connection] [source/extensions/transport_sockets/tls/ssl_socket.cc:201] [C2] TLS error: 268435640:SSL routines:OPENSSL_internal:NO_SHARED_CIPHER

I tried this from 1.11.2 all the way back to 1.8.0 - so I must be missing something obvious.
I did a pcap to confirm what was being sent in the client hello, and for reference curl (which im not using) does list those two ciphers as valid for TLS 1.2 https://curl.haxx.se/docs/ssl-ciphers.html
I went as far as https://boringssl.googlesource.com/boringssl/+/2924/include/openssl/tls1.h where they are listed.
If I use this dummy configuration:
      tls_context:
        common_tls_context:
          tls_certificates:
            - certificate_chain:
                filename: "/certs/certificate.pem"
              private_key:
                filename: "/certs/key.pem"
          tls_params:
            tls_minimum_protocol_version: TLSv1_2 <-- tried with 1.1,2,3 as well
            tls_maximum_protocol_version: TLSv1_3 <--- i tried without this, and with 1.1,2,3
              -  ECDHE-RSA-AES256-SHA  <-- works
              - ECDHE-ECDSA-AES128-GCM-SHA256 <-- doesn't work
              - ECDHE-ECDSA-AES256-GCM-SHA384 <-- doesn't work

and scan using the script here to automate openssl https://superuser.com/questions/109213/how-do-i-list-the-ssl-tls-cipher-suites-a-particular-website-offers
I get the following output:
Obtaining cipher list from LibreSSL 2.6.5.
Testing ECDHE-RSA-AES256-GCM-SHA384...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-AES256-GCM-SHA384...NO (sslv3 alert handshake failure) <-- why not working
Testing ECDHE-RSA-AES256-SHA384...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-AES256-SHA384...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-AES256-SHA...YES <--- correct!!!
Testing ECDHE-ECDSA-AES256-SHA...NO (sslv3 alert handshake failure)
Testing DHE-RSA-AES256-GCM-SHA384...NO (sslv3 alert handshake failure)
Testing DHE-RSA-AES256-SHA256...NO (sslv3 alert handshake failure)
Testing DHE-RSA-AES256-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-CHACHA20-POLY1305...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-CHACHA20-POLY1305...NO (sslv3 alert handshake failure)
Testing DHE-RSA-CHACHA20-POLY1305...NO (sslv3 alert handshake failure)
Testing GOST2012256-GOST89-GOST89...NO (sslv3 alert handshake failure)
Testing DHE-RSA-CAMELLIA256-SHA256...NO (sslv3 alert handshake failure)
Testing DHE-RSA-CAMELLIA256-SHA...NO (sslv3 alert handshake failure)
Testing GOST2001-GOST89-GOST89...NO (sslv3 alert handshake failure)
Testing AECDH-AES256-SHA...NO (sslv3 alert handshake failure)
Testing ADH-AES256-GCM-SHA384...NO (sslv3 alert handshake failure)
Testing ADH-AES256-SHA256...NO (sslv3 alert handshake failure)
Testing ADH-AES256-SHA...NO (sslv3 alert handshake failure)
Testing ADH-CAMELLIA256-SHA256...NO (sslv3 alert handshake failure)
Testing ADH-CAMELLIA256-SHA...NO (sslv3 alert handshake failure)
Testing AES256-GCM-SHA384...NO (sslv3 alert handshake failure)
Testing AES256-SHA256...NO (sslv3 alert handshake failure)
Testing AES256-SHA...NO (sslv3 alert handshake failure)
Testing CAMELLIA256-SHA256...NO (sslv3 alert handshake failure)
Testing CAMELLIA256-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-AES128-GCM-SHA256...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-AES128-GCM-SHA256...NO (sslv3 alert handshake failure) <--- why not working?
Testing ECDHE-RSA-AES128-SHA256...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-AES128-SHA256...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-AES128-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-AES128-SHA...NO (sslv3 alert handshake failure)
Testing DHE-RSA-AES128-GCM-SHA256...NO (sslv3 alert handshake failure)
Testing DHE-RSA-AES128-SHA256...NO (sslv3 alert handshake failure)
Testing DHE-RSA-AES128-SHA...NO (sslv3 alert handshake failure)
Testing DHE-RSA-CAMELLIA128-SHA256...NO (sslv3 alert handshake failure)
Testing DHE-RSA-CAMELLIA128-SHA...NO (sslv3 alert handshake failure)
Testing AECDH-AES128-SHA...NO (sslv3 alert handshake failure)
Testing ADH-AES128-GCM-SHA256...NO (sslv3 alert handshake failure)
Testing ADH-AES128-SHA256...NO (sslv3 alert handshake failure)
Testing ADH-AES128-SHA...NO (sslv3 alert handshake failure)
Testing ADH-CAMELLIA128-SHA256...NO (sslv3 alert handshake failure)
Testing ADH-CAMELLIA128-SHA...NO (sslv3 alert handshake failure)
Testing AES128-GCM-SHA256...NO (sslv3 alert handshake failure)
Testing AES128-SHA256...NO (sslv3 alert handshake failure)
Testing AES128-SHA...NO (sslv3 alert handshake failure)
Testing CAMELLIA128-SHA256...NO (sslv3 alert handshake failure)
Testing CAMELLIA128-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-RC4-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-RC4-SHA...NO (sslv3 alert handshake failure)
Testing AECDH-RC4-SHA...NO (sslv3 alert handshake failure)
Testing ADH-RC4-MD5...NO (sslv3 alert handshake failure)
Testing RC4-SHA...NO (sslv3 alert handshake failure)
Testing RC4-MD5...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-DES-CBC3-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-DES-CBC3-SHA...NO (sslv3 alert handshake failure)
Testing EDH-RSA-DES-CBC3-SHA...NO (sslv3 alert handshake failure)
Testing AECDH-DES-CBC3-SHA...NO (sslv3 alert handshake failure)
Testing ADH-DES-CBC3-SHA...NO (sslv3 alert handshake failure)
Testing DES-CBC3-SHA...NO (sslv3 alert handshake failure)
Testing EDH-RSA-DES-CBC-SHA...NO (sslv3 alert handshake failure)
Testing ADH-DES-CBC-SHA...NO (sslv3 alert handshake failure)
Testing DES-CBC-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-RSA-NULL-SHA...NO (sslv3 alert handshake failure)
Testing ECDHE-ECDSA-NULL-SHA...NO (sslv3 alert handshake failure)
Testing GOST2012256-NULL-STREEBOG256...NO (sslv3 alert handshake failure)
Testing GOST2001-NULL-GOST94...NO (sslv3 alert handshake failure)
Testing AECDH-NULL-SHA...NO (sslv3 alert handshake failure)
Testing NULL-SHA256...NO (sslv3 alert handshake failure)
Testing NULL-SHA...NO (sslv3 alert handshake failure)
Testing NULL-MD5...NO (sslv3 alert handshake failure)

Looking at the docs it appears ECDHE-ECDSA-AES128-GCM-SHA256 should be supported as a default.
https://www.envoyproxy.io/docs/envoy/v1.12.0/api-v2/api/v2/auth/cert.proto
If I leave cipher_suites blank then the following are usable
Testing ECDHE-RSA-AES256-GCM-SHA384...YES
Testing ECDHE-RSA-AES256-SHA...YES
Testing ECDHE-RSA-CHACHA20-POLY1305...YES
Testing AES256-GCM-SHA384...YES
Testing AES256-SHA...YES
Testing ECDHE-RSA-AES128-GCM-SHA256...YES
Testing ECDHE-RSA-AES128-SHA...YES
Testing AES128-GCM-SHA256...YES
Testing AES128-SHA...YES

So it seems that 1. There is some difference between what is documented and what is available and 2. Envoy successfully accepts ciphers even when it cannot provide them?

@PiotrSikora any thoughts?

It looks that you're using RSA certificate, which is why you only see the cipher suites for RSA in your testing. In order for ECDSA cipher suites to be negotiated, you need to use ECDSA certificate.
Note that you can configure both: RSA & ECDSA certificates in the same context.

Thanks @PiotrSikora  that was the issue.
Great work as always.


Ansible updated => lots of spam

Seems ansible in EPEL got updated to version 2.0.1. Stuff seems to work, but there are a lot of warnings like

[DEPRECATION WARNING]: Using bare variables is deprecated. Update your playbooks so that the environment value uses the full variable syntax ('{{autofs_indirect_maps}}'). This feature will be removed in a
future release. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.

Someone should go through all the roles and fix these warnings..

Another common warning

[DEPRECATION WARNING]: Instead of sudo/sudo_user, use become/become_user and make sure become_method is 'sudo' (default). This feature will be removed in a future release. Deprecation warnings can be
disabled by setting deprecation_warnings=False in ansible.cfg.

Finally! The travis tests can help with this: https://travis-ci.org/CSC-IT-Center-for-Science/ ( maybe even check the "devel" build which tests ansible 2.1(master).

Best way to find all of these was with a "grep -R with_items: " in fgci-ansible. Travis helped with testing for syntax errors. Next fgci-ansible release should have all these fixes..

Phew. Lots of updates here. Another error:

TASK [network_interface : Create the network configuration file for vlan devices] ***
[DEPRECATION WARNING]: Skipping task due to undefined Error, in the future this will be a fatal
 error.. This feature will be removed in a future release. Deprecation warnings can be disabled
 by setting deprecation_warnings=False in ansible.cfg.

undefined Errors from network_interfaces is fixed in b9de10bf6b16042e30202538219ef5cca7f7fedb . There's some errors regarding with_subelements in that role which is an ansible bug.
There's a lot of "sudo: yes" in roles and playbooks. Updating these too.

This is mostly done now, marking as closed. A few warnings remaining where I'm not convinced they are actually errors. These two are seen from ansible-pull:
a) the dependency we have in the meta/ in ansible-role-slurm.
b) network_interfaces role regarding a with_subelements

Thanks for all the work on this. One error I'm still seeing is when running tools/pullreq.sh:

- extracting ansible-role-fail2ban to roles/ansible-role-fail2ban
- ansible-role-fail2ban was installed successfully
- extracting ansible-role-slurm to roles/ansible-role-slurm
- ansible-role-slurm was installed successfully
[DEPRECATION WARNING]: The comma separated role spec format, use the yaml/explicit format instead.. This feature will be removed in a future release. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg.
- extracting ansible-role-cvmfs to roles/ansible-role-cvmfs
- ansible-role-cvmfs was installed successfully
...

This deprecation warnings always shows up when installing ansible-role-slurm. I don't really understand why, at least in requirements.yml there is nothing special about ansible-role-slurm..

I think that is the a) I mentioned above
http://docs.ansible.com/ansible/playbooks_roles.html#role-dependencies has the same format we do. So ansible bug like https://github.com/ansible/ansible/pull/14612


Add clarification on authenticating to Azure

Clarifies example to point further down below

Need to add the DCO!
These changes - Do they align better with the name values in the Azure API? Is that the reason for this update?

Need to add the DCO! These changes - Do they align better with the name values in the Azure API? Is that the reason for this update?

DCO added
This PR fixes examples to use non-deprecated values, as well as provide better guidance on how to use auth fields. There was some confusion on our team on how to use Key Vaults.


Logical cull operator

Picking up from @zenzike’s suggestion
(https://github.com/robrix/fused-effects/issues/65#issuecomment-435676919), Cut offers call and cut, but we can also express cull as a scoped effect to select only the first child in p.
I think this is the same as the once operator described in Backtracking, Interleaving, and Terminating Monad Transformers, for pruning or “don’t-care nondeterminism.”

Yes, it’s exactly that. Also in the syntax and semantics for operations with scope paper

Oh that’s right! I forgot that.
We’ve got an effect handler for NonDet, runNonDetOnce, that does this globally. I think we could define this as a scoped effect, either as part of Cut or as a separate effect working with NonDet like Cut does. I’m kind of leaning towards Cut at the moment, but I’m not married to the idea.


WIP: support numpy array comparison with string

fix #7859 .
Choose an alternative to implement this feature:

[x] Aligned with NumPy, use special case to handle string ufunc (I don't want to choose this way, because I guess this makes string case cannot use ufunc-related optimization?)
[x] Pending on NumPy new version (1.23?), then use an unified way to handle all ufuncs

tested on NumPy==1.23.0rc2, it doesn't unify string case and others. [2022-6-6]

Updates on 2022-6-21:

[ ] I choose to help NumPy to complete the string ufunc unification PRs.
[ ] Then back to Numba string ufuncs.

Indeed, I didn't follow this thread these days. So I guess I should just close it.


Feature Request: Color palette in SDS Website

It'd be useful to be able to see every available color on the SDS website.
For ex: var(--pal-brand-primary) next to a swatch of what that color looks like
Issue it solves: when a dev receives a comment like "Let's make this color stand out more", we could take a look at what's available in our color palette to use

SDS v3 has a color palette on the website.


Use of entry_points and project.scripts with pip-sync

What's the problem this feature will solve?
As an engineer looking to pip-sync a Python project packaged using pip-tools, I expect scripts defined with entry_points (using setup.py) and/or project.scripts (using pyproject.toml) to be installed.
Describe the solution you'd like

pip-sync command results in the creation of entries in the bin directory of the Python environment corresponding to the defined scripts
pip-sync command results in the installation of the root package (i.e., as if pip install of the root package was issued)

Alternative Solutions

avoid using pip-sync: pip install of the root package installs bin directory entries for the scripts defined in the package, but doesn't have the benefit of using pip-sync.
pip-sync followed by pip install. pip-sync will uninstall the root package, so the follow-up pip install is necessary for the bin entries for the scripts to be re-created.

Additional context
The effect of this absence of this feature is described in this issue: https://github.com/jazzband/pip-tools/issues/1158

It's not that the scripts are ignored, it's that pip-sync installs explicitly listed dependencies (in contrast to your second proposed solution). My take on this is at the linked issue, copied here:

I don't know which is the intended behavior when using a setup file as pip-compile's input -- including the top package itself or not.

I would personally expect the setup-file package itself to be omitted from the requirements files, to be in line with projects that use both setup and requirements files, without necessarily using pip-tools in any capacity. And if I want it included in this case, I'll make a simple .in file.

Note that in a case like this you probably want to install (only) the root project in editable mode, which AFAIU isn't really able to be specified with pip-sync PROJFILE.
I'm not 110% against changing this behavior but this reflects my current understanding of what's intended by the project, and I welcome insight from other users and devs on the topic.
At the very least, I suggest adding this alternative method to the list:
$ echo '-e .' >dev-requirements.in
$ pip-compile dev-requirements.in
$ pip-sync dev-requirements.txt

I'll also note that in my own wrapper scripts, I do employ your second suggested alternative of following up syncs with pip install, due to #896, which despite being closed, is AFAIK still an issue.

Hi, @AndydeCleyre, thanks for replying.
Regarding your suggestion:

$ echo '-e .' >dev-requirements.in
$ pip-compile dev-requirements.in
$ pip-sync dev-requirements.txt

I'd like to put the self-requirement into requirements.in (which is used by my requirements.test.in, which is used by my requirements.dev.in), but it looks like pip-compile can't parse the editable self-requirement and I see the error:
venv/bin/pip-compile --output-file requirements.test.txt requirements.test.in
WARNING: the legacy dependency resolver is deprecated and will be removed in future versions of pip-tools. The default resolver will be changed to 'backtracking' in pip-tools 7.0.0. Specify --resolver=backtracking to silence this warning.
    error: subprocess-exited-with-error

    × python setup.py egg_info did not run successfully.
    │ exit code: 1
    ╰─> [1 lines of output]
        error in vault setup command: 'install_requires' must be a string or list of strings containing valid project/version requirement specifiers; Parse error at "'-e file:'": Expected W:(abcd...)
        [end of output]

Not directly an issue, but along the way, the -e . dependency is expanded to an absolute path (i.e., file:///home/me/path/to/my/project when it ends up in downstream requirements.*.txt files, which would be a problem for shared development.

A bit about my use case, which perhaps isn't a good fit for pip-tools:
I'm looking to use pip-tools for both development as well as for deployment to the target execution environment, the form of which is the same virtualenv used over time across deployed versions of the software. Essentially deployments are the result of a git pull and (ideally) a pip-sync. To be clear, I'm not using separate virtualenvs across versions, or using an isolated environment (e.g., as provided by docker), so what I'm doing is kind of old fashioned, but the possible benefit to me of a tool like pip-sync is significant.
Am I barking up the wrong tree with this pattern and pip-tools?

Can you share the requirements.in here?

And at least the install_requires value in the setup.py?

requirements.in:
-e .

django<4.1
django-filter
djangorestframework
django-basicauth
django-structlog
fs
internetarchive
Jinja2
psycopg2-binary
PyYAML<6,>=3.10
requests
s3fs
sentry-sdk
more-itertools
tqdm
GitPython
python-dotenv
celery
backoff
redis
prometheus-client
django-prometheus
temporalio
drf-spectacular
jsonschema<4,>=2.5.1
pyhumps
psutil
loky
filetype
sanitize-filename

Abridged setup.py
install_requires = []
with open("requirements.txt", encoding="utf-8") as f:
    install_requires = list(f)

setup(
# ...
    install_requires=install_requires,
# ...

You have a circular dependency situation defined. You're feeding requirements.txt into setup.py, and including the project itself (setup.py) in requirements.txt (and .in). This isn't going to work.
So you may want to, in setup.py, filter out the self-reference coming from requirements.txt, or instead use a separate .txt/.in file for including the project itself. In other words: don't specify the project as a dependency of itself.
I'm also surprised you're feeding in the .txt rather than the .in, but that's of course your choice.
Note that I'm not well versed in what is and is not acceptable syntax for install_requires elements.

I need to note now that I didn't realize listing a project as a dependency of itself might be an accepted pattern, but it seems it is/was/might-be. It's not currently handled by pip-tools.
See also:

#1820
#1685


fix: counter Dockerfile typo

https://github.com/eladb/kubecon-2020-cdk8s/blob/3fdd6553a2cf90afc4f40999c4b5aa9e737286fb/src/app/counter/Dockerfile#L16
fix "usr/bin/env" to "/usr/bin/env"

❤


[SPARK-24339][SQL]Add project for transform/map/reduce sql to prune column

What changes were proposed in this pull request?
Transform query do not have Project Node, query like:
 select transform(a, b) using 'func' from e
and it' logic plan is:

'ScriptTransformation['a, 'b], func, [key#0, value#0]
+- 'UnresolvedRelation e (PlanTest.scala:97)

so that it will scan all the column data of relation.
In this PR, I propose to add Project Node for transform query, so that it scan required data by prune columns, for above transform query,  it's logic plan will be:

'ScriptTransformation['a, 'b], func, [key#0, value#0]
+- 'Project ['a, 'b]
+- 'UnresolvedRelation e

it will scan only two column data of relation.
In summary, Add Project Node for transform query can reduce the time of scan and assemble data.(In our scenario, the relation(table) have 700 columns.)
How was this patch tested?
Modify existing test ("transform query spec")

Can one of the admins verify this patch?

Can one of the admins verify this patch?

@gatorsmile Can you trigger this?

Could you add explain result differences with/without this pr in the description?

@maropu  I updated the commet. In summary, with this pr can reduce the time of scan and assemble data. In our scenario, the relation(table) have 700 columns.

jenkins, test this, please

@maropu @gatorsmile Do you have any comment/suggestion for this PR? Thanks.

@maropu @gatorsmile Can you help me review this pr ?  Thanks。 #

Can one of the admins verify this patch?

kindly pining @gatorsmile @HyukjinKwon @ueshin

ok to test

Test build #92842 has started for PR 21447 at commit 3997ceb.

Test build #92842 has finished for PR 21447 at commit 3997ceb.

This patch fails Scala style tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92842/
Test FAILed.

retest this please

Test build #92916 has started for PR 21447 at commit 958888b.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92916/
Test FAILed.

retest this please

retest this please

Test build #93103 has started for PR 21447 at commit 12b688d.

Test build #93103 has finished for PR 21447 at commit 12b688d.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/93103/
Test FAILed.

@HyukjinKwon Our project is based on the branch-2.2, we will merge the patch to local branch manually if it is against master. we prefer following community to local branch.
If you don't like this approach, I will close the PR and make a new PR to against master.

Yea, usually we do it for master first and then backport it to other branches to reduce the diff and master has the fix. I would appreciate it if you go in this way.

Sorry, the fix does not look good to me. We should let the optimizer add the project automatically.

@xdcjie, mind closing this one?

Ok！

@maropu Do you want to take this over and add such a project in ColumnPruning?

I want to give a follow up PR and cc @gatorsmile @maropu for a review.


Convert expvar values to the correct type int64

expvar only allows int increments and decrements, so use int64 when converting.
Fix shown in action below:
> select * from httpd
name: httpd
-----------
time                            bind    ping_req        req
2015-09-04T21:43:14.676210654Z  :8086   1               1
2015-09-04T21:43:15.676130058Z  :8086   1               1
2015-09-04T21:43:16.676147344Z  :8086   1               1
2015-09-04T21:43:17.67606395Z   :8086   1               1
2015-09-04T21:43:18.67610557Z   :8086   1               1
2015-09-04T21:43:19.676120053Z  :8086   1               1
2015-09-04T21:43:20.676091379Z  :8086   1               1

> select sum(ping_req) from httpd
name: httpd
-----------
time                    sum
1970-01-01T00:00:00Z    16

>

@jwilder

:+1:

Many thanks to @jwilder for spotting this critical bug. Merging now.


#159758545 Add the fetch all answers for a question functionality

What does this PR do?
This PR creates the functionality for users to get all the answers to a picked question
How should this be manually tested?

Clone the repo

$ git clone https://github.com/asheuh/StackOverflow-lite
$ cd StackOverflow-lite

Create virtualenv

$ python -m venv venv

Run app

$ flask run

Then go to <IP_ADDRESS>:5000/api/v2

What are the relevant pivotal tracker stories?
159758545

Pull Request Test Coverage Report for Build 147

40 of 40 (100.0%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.2%) to 93.896%

Totals

Change from base Build 145:
0.2%

Covered Lines:
1123

Relevant Lines:
1196

💛  - Coveralls


Feature Request - Dark mode

I find it hard on the eyes to look at a large screen with a white background especially after sunset.
I've tried to use the Dark Reader  google chrome extension, but the diagram elements still render in black on a near black background making the page unusable.
If there's any chance a dark mode could be made or at least some tweak to make the site more friendly to use with Dark Reader, it would certainly be appreciated.  Thanks.

Hi @deftdawg as this is a feature request, we are following this issue here: https://issues.redhat.com/browse/KOGITO-7542


Adding max-age to objects in AWS S3

Want to add a max age of about 2 weeks-3 months to all SVGs (these don't really change)
Want to add a max age of about 12 hours to operator data and HTML
What is the best way to do this whilst keeping everything automated from GitHub? Any advice would be much appreciated.

Currently, in the AWS CodeBuild step, I sync the site to an S3 bucket and add a blanket max-age header of 24 hours to each object. Need to be able to cache the .svgs for longer.
When a deployment happens now, the CloudFront cache is invalidated for scripts, css and index page (not the .svgs)


chengjun's homework

第一次作业
学号：1712009
名字：王成军
03.python_intro.ipynb.zip

第二次作业
作业 2 tba

from collections import Counter, defaultdict
from linear_algebra import vector_subtract
from stats import mean, correlation, standard_deviation, de_mean
from gradient_descent import minimize_stochastic
import math, random

def predict(alpha, beta, x_i):
    return beta * x_i + alpha

def error(alpha, beta, x_i, y_i):
    return y_i - predict(alpha, beta, x_i)

def sum_of_squared_errors(alpha, beta, x, y):
    return sum(error(alpha, beta, x_i, y_i) ** 2
               for x_i, y_i in zip(x, y))

def least_squares_fit(x,y):
    """given training values for x and y,
    find the least-squares values of alpha and beta"""
    beta = correlation(x, y) * standard_deviation(y) / standard_deviation(x)
    alpha = mean(y) - beta * mean(x)
    return alpha, beta

def total_sum_of_squares(y):
    """the total squared variation of y_i's from their mean"""
    return sum(v ** 2 for v in de_mean(y))

def r_squared(alpha, beta, x, y):
    """the fraction of variation in y captured by the model, which equals
    1 - the fraction of variation in y not captured by the model"""

    return 1.0 - (sum_of_squared_errors(alpha, beta, x, y) /
                  total_sum_of_squares(y))

def squared_error(x_i, y_i, theta):
    alpha, beta = theta
    return error(alpha, beta, x_i, y_i) ** 2

def squared_error_gradient(x_i, y_i, theta):
    alpha, beta = theta
    return [-2 * error(alpha, beta, x_i, y_i),       # alpha partial derivative
            -2 * error(alpha, beta, x_i, y_i) * x_i] # beta partial derivative

num_friends_good = [49,41,40,25,21,21,19,19,18,18,16,15,15,15,15,14,14,13,13,13,13,12,12,11,10,10,10,10,10,10,10,10,10,10,10,10,10,10,10,9,9,9,9,9,9,9,9,9,9,9,9,9,9,9,9,9,9,8,8,8,8,8,8,8,8,8,8,8,8,8,7,7,7,7,7,7,7,7,7,7,7,7,7,7,7,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,6,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1]
daily_minutes_good = [68.77,51.25,52.08,38.36,44.54,57.13,51.4,41.42,31.22,34.76,54.01,38.79,47.59,49.1,27.66,41.03,36.73,48.65,28.12,46.62,35.57,32.98,35,26.07,23.77,39.73,40.57,31.65,31.21,36.32,20.45,21.93,26.02,27.34,23.49,46.94,30.5,33.8,24.23,21.4,27.94,32.24,40.57,25.07,19.42,22.39,18.42,46.96,23.72,26.41,26.97,36.76,40.32,35.02,29.47,30.2,31,38.11,38.18,36.31,21.03,30.86,36.07,28.66,29.08,37.28,15.28,24.17,22.31,30.17,25.53,19.85,35.37,44.6,17.23,13.47,26.33,35.02,32.09,24.81,19.33,28.77,24.26,31.98,25.73,24.86,16.28,34.51,15.23,39.72,40.8,26.06,35.76,34.76,16.13,44.04,18.03,19.65,32.62,35.59,39.43,14.18,35.24,40.13,41.82,35.45,36.07,43.67,24.61,20.9,21.9,18.79,27.61,27.21,26.61,29.77,20.59,27.53,13.82,33.2,25,33.1,36.65,18.63,14.87,22.2,36.81,25.53,24.62,26.25,18.21,28.08,19.42,29.79,32.8,35.99,28.32,27.79,35.88,29.06,36.28,14.1,36.63,37.49,26.9,18.58,38.48,24.48,18.95,33.55,14.24,29.04,32.51,25.63,22.22,19,32.73,15.16,13.9,27.2,32.01,29.27,33,13.74,20.42,27.32,18.23,35.35,28.48,9.08,24.62,20.12,35.26,19.92,31.02,16.49,12.16,30.7,31.22,34.65,13.13,27.51,33.2,31.57,14.1,33.42,17.44,10.12,24.42,9.82,23.39,30.93,15.03,21.67,31.09,33.29,22.61,26.89,23.48,8.38,27.81,32.35,23.84]

alpha, beta = least_squares_fit(num_friends_good, daily_minutes_good)
print("alpha", alpha)
print("beta", beta)

print("r-squared", r_squared(alpha, beta, num_friends_good, daily_minutes_good))

print()

print("gradient descent:")
# choose random value to start
random.seed(0)
theta = [random.random(), random.random()]
alpha, beta = minimize_stochastic(squared_error,
                                  squared_error_gradient,
                                  num_friends_good,
                                  daily_minutes_good,
                                  theta,
                                  0.0001)
print("alpha", alpha)
    print("beta", beta)


Profile: nit fixes

Blank popup I go to my profile right after submitting my app. Can we not display this at this point?