MS2 generation in simulator

At the moment the code can generate MS2 spectra from either:

A kernel density
A CRP

To be able to run realistic experiments (e.g. DIA vs DDA) we need to be able to assign a Chemical a real MS2 spectrum. This could come from either

an mzML file (i.e. choosing a random MS2 scan from an mzML file)
an mgf file (i.e. choosing a random spectrum from a mgf file)

For either of these, it looks straightforward: we need a new peak_sampler object. Or the ability in a peak sampler object to return spectra like the above.
Note: I think the peak sampler object is just used to initialise Chemicals? Is that correct?  In which case, I'm not sure why it has (un-implemented) noise methods? Noise is an artefact of the data sampling process.
There is an additional use case (for DIA vs DDA experiments):
We have an mzML containing a known mixture. I.e. we know the molecules that are in there (there will also be noise)
We have an mgf holding the spectra of these known chemical
When we seed the simulator with this data, we want to be able to assign the correct MS2 spectrum to the correct Chemical (and perhaps noisy ones to the other chromatograms)
Maybe this is best done using the known chemicals? We have a DB of known chemicals, and we have a DB of their known spectra. In that setting, can we add "noisy" chemicals? I.e. random extra UnknownChemical objects to test the acquisition / analysis more?

For either of these, it looks straightforward: we need a new peak_sampler object. Or the ability in a peak sampler object to return spectra like the above. Note: I think the peak sampler object is just used to initialise Chemicals? Is that correct? In which case, I'm not sure why it has (un-implemented) noise methods? Noise is an artefact of the data sampling process.

The peak sampler (misleading name?) is actually what the paper calls the 'database'. It stores the trained KDEs, all the scan data extracted from one of several mzML files, and also the scan duration information, i.e. the (1,1), (1,2), (2,1), and (2,2) information. We've already added a method to return ms2 spectra in the peak sampler. This is used by the ChemicalCreator object used to initialise chemicals. It has two modes:

generate spectra following the CRP or
generate spectra by sampling the spectra.

In the current skeleton code, that unimplemented noise method is to be called by the Mass Spec when generating scans from chemicals. I forgot why it's there. Maybe the noise should be added as part of the ChemicalCreator instead? @vinnydavies

So, we need new methods to be able to get spectra from .mgf or .mzml files (ms2 spectra that is).
Ok for noise. Maybe the MS should pass some kind of noise generator? The noise generator ought to be an attribute of the MS, right?
Dr Simon Rogers
Senior lecturer, School of Computing Science, University of Glasgow

On 9 Jul 2020, at 16:32, Joe Wandy<EMAIL_ADDRESS>wrote:

For either of these, it looks straightforward: we need a new peak_sampler object. Or the ability in a peak sampler object to return spectra like the above. Note: I think the peak sampler object is just used to initialise Chemicals? Is that correct? In which case, I'm not sure why it has (un-implemented) noise methods? Noise is an artefact of the data sampling process.
The peak sampler (misleading name?) is actually what the paper calls the 'database'. It stores the trained KDEs, all the scan data extracted from one or several mzML files, and also the scan duration information, i.e. the (1,1), (1,2), (2,1), and (2,2) information. We've already added a method to return ms2 spectra in the peak sampler. This is used by the ChemicalCreator object used to initialise chemicals. It has two modes:
generate spectra following the CRP or
generate spectra by sampling the spectra.
In the current skeleton code, that unimplemented noise method is to be called by the Mass Spec when generating scans from chemicals. I forgot why it's there. Maybe the noise should be added as part of the ChemicalCreator instead? @vinnydavies
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub, or unsubscribe.

By "generate ms2 spectra by sampling a random spectra from the data.", that means sample N individual fragments right? The new method would need to get all the frags that come from one real ms2 scan
The mass spec has some noise generation already for the intensity, we can add more functionality there

The new method would need to get all the frags that come from one real ms2 scan

Yeah this here already gets all the frags that come from one real ms2 scan.

@joewandy what about the final part of my comment? When we have a real molecule and real spectrum?

To be fixed as part of issue #2

Continue in issue #102


.progress-bar-animated ignores $enable-prefers-reduced-motion-media-query.

.progress-bar-animated ignores $enable-prefers-reduced-motion-media-query
Missing condition
@if $enable-prefers-reduced-motion-media-query {
before line 39 in _progress.scss

reduced motion is generally concerned with animations that can cause issues for users with vestibular disorders (i.e. parallax scrolling, slow animated opening/closing things). it's not necessarily a "no animations at all" setting. at this stage, we've left the animated progress bar on purpose, unless there's evidence this can cause issues to users?

You already did implement reduced-motion media query #27986. I want to enable animations in my design regardless of browser/system settings. Issue is a variable $enable-prefers-reduced-motion-media-query having no effect wether it's true or false and leaves the animation disabled on my system.

ah, now i see what you mean - i forgot that we flipped on that one in the end. yes, since we do have a variable for reduced motion, it makes sense to add that there.


Question about implementation

Sorry for now I don't know anything about webauthn but when I look at windows header file webauthn/windows_webauthn/webauthn/webauthn.h it seems that on Windows everything is implemented but in your implementation you use only the MS API to implement WebAuthnWinHello and the other part you implement it yourself ?
Do I understand it right ? and if this is the case would it be possible to only implement using the Windows API ?

Hi,
you can use only Windows API to communicate with a device (authenticator). My library only provides the c++ wrapper for it (and libfido2, which does the same thing as Windows API but it also works on Linux) and exposes a more restricted, but much easier interface to use. I also implemented some cryptographic functionality, using libssl, which works with those libraries, but is not required on the client side.
If you are interested in using Windows API, you should check CTAP2 documentation, which provides more detailed information about client - authenticator communication.


Create install.sh

add an install script if omf or fisher doesn't work

Hi, that's a great script but not necessarily what I want people to be using. It is clearly a great workaround for when installing via Fisher fails, but that should be rare and I only intend for my users to use Fisher b/c then they can get updates and I can easily reason about my users. Sorry!


Would be nice to keep some of the derivs on the “Community Art” section changed and were dynamic, so you are not always seeing the same ones

@0xKiwi The community art section images are already dynamic. We could add more if that helps? But for now I'l close this issue as I think it's already implemented.

Yes! Pretty sure we solved this, thank you!
On Mon, Oct 23, 2023, 1:59 PM Chase Manning @.***>
wrote:

@0xKiwi https://github.com/0xKiwi The community art section images are
already dynamic. We could add more if that helps? But for now I'l close
this issue as I think it's already implemented.
—
Reply to this email directly, view it on GitHub
https://github.com/uwu-labs/uwucrew-site-v2/issues/20#issuecomment-1776011471,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ABPWH5QC53A7EPGLD55KS3DYA3LCZAVCNFSM6AAAAAA4OMBJ4CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTONZWGAYTCNBXGE
.
You are receiving this because you were mentioned.Message ID:
@.***>


feat(material-progress-spinner): Ability to adjust mat-progress-spinner track color.

Feature Description
In the implementation of mat-progress-bar there are 2 variables available to set both the spinner color and track color.
I would like to ask if this pattern can be applied to mat-progress-spinner to make it consistence.
Reference link:
mat-progress-bar:
Track Color: https://github.com/angular/components/blob/main/src/material/progress-bar/progress-bar.scss#L135
Active Color: https://github.com/angular/components/blob/main/src/material/progress-bar/progress-bar.scss#L96
mat-progress-spinner:
Active Color:https://github.com/angular/components/blob/main/src/material/progress-spinner/progress-spinner.scss#L100C52-L100C74
I am happy to contribute.
Use Case
This is an internal tool to match our UX design.

Team, I am diving to the code and I dont think this is possible to do.
The alternative option on top of my mind is to add a determined progress spinner behind it.
Closing this ticket.


Error when Debugging UserProfile.Manipulation.CSOM

I am trying to use the patterns and practices examples called userprofile manipulation CSOM to understand more about the ability to change info in a users profile field. I may have found a bug in the code. I am working with a office 365 sharepoint site. The project will build and install on a dev site but when I click on the link to one of the senarios I get an error in the code behind for the codesample1 that the reads the clientcontext is null. Is there some thing that I am doing that is not correct?

I will try to repo the issue. please allow me sometime.

HI jtrimblecraez, I was unable to repo the issue. Which scenario did you have issues with?

Same here, could not repo. Tested the sample without issues. One possible challenge might be though the CSOM version what you are using. Please check that you have the latest CSOM from this location - http://aka.ms/spocsom.
Second option would be to go and change the version number from app.config file with leading .1. That would force the app to be reinstalled to the site, if trust failed for some reason.

Please let us know what was the result.

Thank you both for checking into this issue .... I would say that the issue is with the CSOM version. I need to understand more about how to install that version. I will report back with my findings.

Anytime. I will keep this open just awhile longer until you get back to us.

forgive me as I am a rather new developer. I think that I have the correct Csom version as I have went into my references in the project and see that the version of the microsoft.sharepoint client is version 16. and runtime version v4.0.30319.... is this the correct version?

No worries. Yes that is the correct version if you are using Office 365 MT.

Well shoot,
That is the correct Version and yes I am using O365 MultiTenant. we are actually going in a different direction being that we are using angular. We are going to use json. I will try to sweep back around on this issue and wee if I can work on this in my spare time to try a few other things. thank you both for your time and I am sure it is something that I am dong wrong. you can close this issue out.

Feel free to ping us back or reach out to us at http://aka.ms/OfficeDevPnPYammer


[11.x] Add typed getters to session store

Hi :smile:
I previously submitted a PR #50140 for typed configuration getters that have been approved and then enhanced by  #50287.
I tried to make the same features for the session store as I believe it can help to have static analysis. Not sure though the way I wrote the tests.
Let me know if any changes needed (and also I didn't find a pint or lint command)
EDIT: Tests for type errors are not correct, changing to draft

I fixed the tests but I wonder if these could be more readable or more clean:
public function testSessionTypedGettersWithWrongTypes(): void
{
    $session = $this->getSession();
    $session->getHandler()->shouldReceive('read')->once()->with($this->getSessionId())->andReturn(serialize([
        'integer' => '12',
        'array' => null,
        'boolean' => 'true',
        'float' => '12.34',
        'string' => 12,
    ]));
    $session->start();

    $this->assertTypeError(fn () => $session->integer('integer'), 'integer');
    $this->assertTypeError(fn () => $session->array('array'), 'array');
    $this->assertTypeError(fn () => $session->boolean('boolean'), 'boolean');
    $this->assertTypeError(fn () => $session->float('float'), 'float');
    $this->assertTypeError(fn () => $session->string('string'), 'string');
}

private function assertTypeError(callable $callback, string $expectedType): void
{
    try {
        $callback();
        $this->fail("Expected TypeError for $expectedType type.");
    } catch (\TypeError $e) {
        $this->assertMatchesRegularExpression("/Session value for key \[(.*)\] must be (.*) {$expectedType}, (.*) given./", $e->getMessage());
    }
}

I really am not sure this needs to propogate throughout the entire framework. 😬  Where else might this also apply?

Going to hold off on this for now I think.


Technical difficulty  building OpenLayers 3 Widget on MAC

I am experiencing difficulty building this widget on MAC. I can confirm that Node.js and Bower are installed. Steps:
$ brew install nodejs
Warning: node 11.12.0 is already installed, it's just not linked
You can use `brew link node` to link this version.

$ brew install npm
Warning: node 11.12.0 is already installed, it's just not linked
You can use `brew link node` to link this version.

$ brew link node
Linking /usr/local/Cellar/node/11.12.0...
Error: Could not symlink include/node/common.gypi
Target /usr/local/include/node/common.gypi
already exists. You may want to remove it:
  rm '/usr/local/include/node/common.gypi'

To force the link and overwrite all conflicting files:
  brew link --overwrite node

To list all files that would be deleted:
  brew link --overwrite --dry-run node

$ npm install -g bower
env: node: No such file or directory

$ brew install -g bower
Updating Homebrew...
Warning: bower 1.8.8 is already installed, it's just not linked
You can use `brew link bower` to link this version.

$ npm install
env: node: No such file or directory

$ brew install -g grunt-cli
Warning: grunt-cli 1.3.2 is already installed, it's just not linked
You can use `brew link grunt-cli` to link this version.

$grunt
env: node: No such file or directory

I repeat this same process on Ubuntu, it fails too.

Your node installation is broker.
Take into account that the brew link node command you executed raised an error:
$ brew link node
Linking /usr/local/Cellar/node/11.12.0...
Error: Could not symlink include/node/common.gypi
Target /usr/local/include/node/common.gypi
already exists. You may want to remove it:
  rm '/usr/local/include/node/common.gypi'

To force the link and overwrite all conflicting files:
  brew link --overwrite node

To list all files that would be deleted:
  brew link --overwrite --dry-run node

@aarranz
I can confirm node is installed:
$ node -v
v11.13.0

Ok, then try again with npm install -g bower. If you fixed the problem, you'll get bower installed instead of the env: node: No such file or directory error message.

I think the problem has to do with bower installation, but I have no clear idea what courses it
$ npm -v
6.7.0

$ npm install -g bower
npm WARN deprecated<EMAIL_ADDRESS>We don't recommend using Bower for new projects. Please consider Yarn and Webpack or Parcel. You can read how to migrate legacy project here: https://bower.io/blog/2017/how-to-migrate-away-from-bower/
npm WARN checkPermissions Missing write access to /usr/local/lib/node_modules/bower
npm ERR! path /usr/local/lib/node_modules/bower
npm ERR! code EACCES
npm ERR! errno -13
npm ERR! syscall access
npm ERR! Error: EACCES: permission denied, access '/usr/local/lib/node_modules/bower'
npm ERR!  { [Error: EACCES: permission denied, access '/usr/local/lib/node_modules/bower']
npm ERR!   stack:
npm ERR!    "Error: EACCES: permission denied, access '/usr/local/lib/node_modules/bower'",
npm ERR!   errno: -13,
npm ERR!   code: 'EACCES',
npm ERR!   syscall: 'access',
npm ERR!   path: '/usr/local/lib/node_modules/bower' }
npm ERR!
npm ERR! The operation was rejected by your operating system.
npm ERR! It is likely you do not have the permissions to access this file as the current user
npm ERR!
npm ERR! If you believe this might be a permissions issue, please double-check the
npm ERR! permissions of the file and its containing directories, or try running
npm ERR! the command again as root/Administrator (though this is not recommended).

npm ERR!      /Users/Akil/.npm/_logs/2019-04-02T22_32_22_152Z-debug.log

Great, the command is raising an exception, but it almost there. I forget to tell you to use sudo: sudo npm install -g bower.
So,  It should work if you execute the following commands on the repo folder:
sudo npm install -g bower
npm install
sudo npm install -g grunt-cli
grunt

Cheers.

$ sudo npm install -g bower
Password:
npm WARN deprecated<EMAIL_ADDRESS>We don't recommend using Bower for new projects. Please consider Yarn and Webpack or Parcel. You can read how to migrate legacy project here: https://bower.io/blog/2017/how-to-migrate-away-from-bower/
/usr/local/bin/bower -> /usr/local/lib/node_modules/bower/bin/bower
+<EMAIL_ADDRESS>updated 1 package in 5.012s

$ npm install
npm WARN saveError ENOENT: no such file or directory, open '/Users/Akil/Code/package.json'
npm notice created a lockfile as package-lock.json. You should commit this file.
npm WARN enoent ENOENT: no such file or directory, open '/Users/Akil/Code/package.json'
npm WARN Code No description
npm WARN Code No repository field.
npm WARN Code No README data
npm WARN Code No license field.

up to date in 1.17s
found 0 vulnerabilities

sudo npm install -g grunt-cli
/usr/local/bin/grunt -> /usr/local/lib/node_modules/grunt-cli/bin/grunt
+<EMAIL_ADDRESS>updated 1 package in 4.099s

$ grunt
grunt-cli: The grunt command line interface (v1.3.2)

Fatal error: Unable to find local grunt.

If you're seeing this message, grunt hasn't been installed locally to
your project. For more information about installing and configuring grunt,
please see the Getting Started guide:

https://gruntjs.com/getting-started

The npm install and grunt commands has to be executed on the repo folder, e.g.:
$ git clone https://github.com/Wirecloud/ol3-map-widget.git
$ cd ol3-map-widget
$ npm install
$ grunt

Cheers!

Ah....!  I understand. Everything goes well, now.
Many thanks.

Great,
Have a nice coding! 😄


better host?

wonder how i can put another host the get more users to connect. it failed at 30 connections. anyone can help me?

all users need to share one mysql database.
you tried to connect 30 accounts with one database and it doesn't work ?
my friends & me using about 10 accounts with one mysql database and it works.
please more details for your issue.

can i use my own mysql database server?

sure you can use your own mysql server. but if your friends want to connect from outside (from his home) you need to open a port to the internet and give him your static IP Adresss. if you dont have a static IP, you need a DNS service.
i use a webhost mysql database server where my websites are hosted too.
easy to set up and allways online.

could make tutorial how to do?


Make v0.9.0 header the same level as others.

Wow, how fast!
Thank, you Charlie! Now allmychanges.com will be happy! :)


Optimism.io/ecosystem

https://www.notion.so/Creative-Brief-Brand-design-for-2025-ecosystem-incentive-programs-14b5831e3452805f8b46e00f914ec5e0

@jvmi7 @tarunkhasnavis can you add more detail here as you see fit? Also, do you know what the timeline looks like for it? I'm unsure how to prioritize. Thanks!


Absolute path in inject when relative path is expected

Hello again boys, thank you all for the assistance so far. I have another small problem and I hope you guys can point me to a direction.
        new WebappWebpackPlugin({
            logo: "./src/assets/example.png",
            prefix: "icons-[hash]/",
            cache: false,
            inject: "force",
        })

Why is the plugin adding a reference to the root folder in /icons-214bffbdb7514553954e6113cebd4aa1/favicon-16x16.png when the prefix uses a relative path?
Thx.
<link rel="icon" type="image/png" sizes="16x16" href="/icons-214bffbdb7514553954e6113cebd4aa1/favicon-16x16.png">
<link rel="icon" type="image/png" sizes="32x32" href="/icons-214bffbdb7514553954e6113cebd4aa1/favicon-32x32.png">
<link rel="shortcut icon" href="/icons-214bffbdb7514553954e6113cebd4aa1/favicon.ico">

I have the same issue :(

By definition, URLs to assets are composed as '${publicPath}/${prefix}/${assetName}, where publicPath is configured by We pack: https://webpack.js.org/guides/public-path/
If it's not set, it defaults to /, so if you need it to be relative, then just set it as appropriate.

This is probably due to #105, could you retry with caching disabled?

@brunocodutra The default behaviour for many webpack plugins is to keep the path unchanged (according to the prefix) if no publicPath is offered.

It defaults to '/' because otherwise it would produce broken output by default, since browserconfig.xml does not support relative paths, see https://stackoverflow.com/questions/27116378/mstile-image-location-specification

I am running into this issue as well.  We use  in our index.html to control delivery of assets.  HTMLWebpackPlugin does not add a leading slash to its injected resources, only webapp-webpack-plugin is adding this leading slash to its injected resources in index.html.
This is inconsistent with HTMLWebpackPlugin's behavior and makes it impossible for us to use webapp-webpack-plugin for favicon injection into index.html.

It seems like the path should only get fixed up when rendering browserconfig.xml, rather than breaking expected behavior for injected assets in HTMLWebpackPlugin in index.html

Are you able to set publicPath: ''?
Does that fix the issue for you?

@brunocodutra I can't set publicPath because it's controlled by Next.js framework I'm using. Is it possible to override this option only for webapp-webpack-plugin

@sheerun could you give more details, e.g. what output do you get and what you expect instead?

This is still not ideal behavior.
My use case is building static files to be hosted under subfolders, e.g. http://example.com/app1, http://example.com/app2, etc. This makes relative paths incredibly useful, because it decouples the app from the deployment.
I can't find any way to do that with webapp-webpack-plugin without manually setting the subfolder in the build configuration meaning I must know the subfolder ahead of time.
The closest I can get is doing something like this:
    new WebappWebpackPlugin({
        logo: "/path/to/icon.png"
        outputPath: "icons/",
        publicPath: "icons/",
        prefix: "",
    }),

This will cause all the icons to be resolved relatively like normal, but the manifest files don't take into account the relative path, so the browser will request something like icons/icons/file... instead of icons/file....
If the manifest files could be made to reference the files relatively, or even give another option similar to publicPath but just for manifests, it would fix this issue.

@korylprince doesn't the following do what you expect, i.e. resolve icons relative to the manifest file?
    new WebappWebpackPlugin({
        logo: "/path/to/icon.png"
        outputPath: "icons/",
        publicPath: ".",
        prefix: "",
    }),

Note however that relative paths in manifest files may not always work https://stackoverflow.com/questions/27116378/mstile-image-location-specification

That fixes the manifest problem, but now all the files are referenced in index.html without the icon/ so it's just shifting the problem.
I understand the problem with browserconfig.xml, but I'm in agreement with others that have posted here that the default behavior should be the more useful and any corner cases should be handled for the weird cases like browserconfig.xml with additional config or something.
Because I didn't say it before, thanks for the project!


[BUG] Unable to install mlx on MacbookPro M3Pro with MacOS 14.4.1

pip install ./mlx-0.12.0-cp312-cp312-macosx_14_0_arm64.whl
Looking in indexes: http://mirrors.aliyun.com/pypi/simple/
ERROR: mlx-0.12.0-cp312-cp312-macosx_14_0_arm64.whl is not a supported wheel on this platform.

CONDA_SUBDIR=osx-arm64 conda create -n AppleMLX python=3.11 fixed the problem


PageHeader NullReferenceException in NuGet 1.1.11

if i update template10 to latest version i have this exception
System.NullReferenceException: Object reference not set to an instance of an object.
at Template10.Controls.PageHeader.UpdateSpacingToFitHamburgerMenu()
at Template10.Controls.PageHeader.PageHeader_Loaded(Object sender, RoutedEventArgs e)
on this line of code
the error is related to this piece of code but i cannot find why
http://pastebin.com/gnJL8vJc
thanks for your help!

Take a look at line 180 in PageHeader.cs and set a breakpoint there. Is the "spacer" available in your XAML?

For starters you only have one appbarbutton in side the secondary tag, the rest are probably throwing the erroe

I can't dream up a single scenario where this error would occur except one. If the developer has changed the template of PageHeader and failed to put spacer in their template. I did not have a check for this before, but I will add one that we will ship with v12. In fact, I will add it now.
@a-iafrate is this your scenario? Have you possibly changed the template of PageHeader to do something specific in your application? If so, the only thing you would need to change is to add this spacer to your template so the null ref. doesn't occur.

Thanks to all for try to help me.
@JerryNixon i don't have changed the template, but i have a not common situation, i Page with PageHeader that include a usercontrol with another PageHeader.
The null for spacer is in the usercontrol PageHeader and not in the Page,
Thanks again!
thanks

You have two page headers on a single page?

yes and no :D
one in the page and one in the usercontrol in the page, and the page can have an array of this usercontrol, so i can have 1,2 or more pageheader in the page.
yes i know is not a common situation :D

I’m also got this problem when upgrading from preview 20160512 to 1.1.11.
I’m also have two page headers on some of my views. I have one header for “view mode” and another for “selection mode” (where you select items from a grid – just like the standard Photo app). These headers look quite different so it kind of make sense doing so. If I remove on header it’s no longer crash.

This started happening in my apps as well when I updated, but I think it's because OnApplyTemplate is not called if the control is not used in a base page.
For example, ThreadView.xaml
ThreadView.xaml a user control which has a PageHeader. I use this because it's a part of a Master/Detail control I also have. OnApplyTemplate is not being called from this control, so spacer is never set. As a result, I get an exception.
But on a page view, such as ThreadListPage.xaml
This works fine. No issues at all.

We'll definitely resolve this. As soon as we understand it.
I'm all ears, maybe @Windows-XAML/contributors see the issue?

Same issue here, it happens on PageHeader sample too.

What happens is this:
OnApplyTemplate() is only called when the control is Visible. But our UpdateSpacingToFitHamburgerMenu() not.
In PageHeader sample u can notice this "behavior".
Guys what is the best handle for this? @Windows-XAML/contributors

We converted our 8.1 project to use UWP with Template 10 and we started seeing the bug mentioned here. From what I can tell, all the fixes mentioned here exist in our ....nuget\packages\Template10\1.1.11\lib\uap10.0\Template10Library\Themes\PageHeader.xaml file.
We can use the PageHeader control in the usual way except we must use a modified copy of PageHeader.cs for the Styles in Custom.xaml (from Hamburger Template). We simply commented out the Throws line in method GetTemplateChild. If we leave that "throws" in we crash.

@tnesham The nuget package it's not updated yet. This will be corrected in the next version...

@angusbreno Thanks for the reply. Any idea when the next version will be released?

Only Jerry can tell u this...
https://github.com/Windows-XAML/Template10/milestone/8

Thanks. Btw, I discovered a page in our app that had two PageHeaders, and removing one fixed our issue.

https://github.com/Windows-XAML/Template10/issues/1113
The fix for this issue is not in the current preview.

Hi,
First of all, thanks a lot for your effort. Good job about "Template 10", I'ts really great !!!
After Update (1.1.12-preview-160712), I can navigate without this bug, but not in all cases. No, when I've a button (+) in my Hamburger menu. One button like this:
<ctrl10:HamburgerButtonInfo ClearHistory="True"                             Tapped="NewProjectTapped">     <StackPanel Orientation="Horizontal">         <SymbolIcon Width="48"                     Height="48"                     Symbol="Add" />         <TextBlock Margin="12,0,0,0"                     VerticalAlignment="Center"                     Text="New project" />     </StackPanel> </ctrl10:HamburgerButtonInfo>
And with this code behind, for the event:
public void NewProjectTapped(object sender, RoutedEventArgs e)
{     MyHamburgerMenu.NavigationService.Navigate(typeof(Views.ProjectEditionPage)); }
When I click/tapp on it,  I have this error:
"Template10.Common.TemplatePartNotFoundException: Control part Spacer not found in Template.
at Template10.Controls.PageHeader.GetTemplateChild[T](String name)
at Template10.Controls.PageHeader.OnApplyTemplate()"

I've just one PageHeader on my ProjectEditionPage.

Thanks for your help.
Juanlu

This no longer seems like a reproducible bug. I have added a MultiplePageHeader sample in the Sample collection for you to review. It has more than one page header, more than one frame. Nested frames in User Controls. Everything I could think of to cause trouble. And I could not cause any. If you would take just a minute to review the sample and see if it covers your use case. I will close this bug on Friday if I don't hear back from you.

The commmented line you can se below inside de VisualState is my problem:
<VisualStateManager.VisualStateGroups>     <VisualStateGroup x:Name="DeviceVisualStateGroup">         <VisualState x:Name="DesktopVisualState">             <VisualState.StateTriggers>                 <t:DeviceFamilyStateTrigger DeviceFamily="Desktop" />             </VisualState.StateTriggers>             <VisualState.Setters>                 <Setter Target="PageHeader.Visibility"                         Value="Visible" />                 <!--<Setter Target="PageHeader.Style"                         Value="{ StaticResource MainCommandBarStyle}" />-->             </VisualState.Setters>         </VisualState>         <VisualState x:Name="MobileVisualState">
So, "MainCommandBarStyle", cannot be assign directly using VisualState but if change code inside "Template10.Controls.PageHeader", it works perfectly.
Below my change:
private T GetTemplateChild<T>(string name) where T : DependencyObject {     var child = GetTemplateChild(name) as T;     if (child == null)     {         // throw new Common.TemplatePartNotFoundException($"Control part {name} not found in Template.");     }     return child; }
I can change my App XAML code, but this modification is much better, :-D.

That exception was put there to prevent issues that could potentially cause
major problems. I don't think it's wise to remove it - it's probably there
for a good reason.
It's causing problems in your particular use case, but I don't believe most
people will need to use that kind of implementation.
On Fri, Sep 23, 2016 at 10:00 AM Juan Luis Guerrero <
<EMAIL_ADDRESS>wrote:

The commmented line you can se below inside de VisualState is my problem:
<VisualStateManager.VisualStateGroups>

<VisualState.StateTriggers>
<t:DeviceFamilyStateTrigger DeviceFamily="Desktop" />
</VisualState.StateTriggers>
<VisualState.Setters>

</VisualState.Setters>

So, "MainCommandBarStyle", cannot be assign directly using VisualState but
if change code inside "Template10.Controls.PageHeader", it works perfectly.
Below my change:
private T GetTemplateChild(string name) where T : DependencyObject
{
var child = GetTemplateChild(name) as T;
if (child == null)
{
// throw new Common.TemplatePartNotFoundException($"Control part {name}
not found in Template.");
}
return child;
}
I can change my App XAML code, but this modification is much better, :-D.
—
You are receiving this because you are on a team that was mentioned.
Reply to this email directly, view it on GitHub
https://github.com/Windows-XAML/Template10/issues/993#issuecomment-249040910,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AM3pI4W1xSJu0GaMHlcGsf1Edv6n1S-yks5qsvqAgaJpZM4IjB3S
.

--
Thanks,
Callum

Yes, I know, and  I'll change my code to solve it, but it means I can't use this kind of "Setter" inside VisualState.
Probably I'm wrong but, If I use this style inside PageHeader it works but, why not inside the VisualState? Any reason for this?
Thanks a lot

Why do you need a Setter there anyway? If you style it right, it shouldn't need those modifications.

Because if I set Sytle inside VisualState, I can use my Page Header everytime (Desktop, Mobile, ...), with the same styles (Background color and text/title) and in adition, I show commandbar depending on the device.

In a Desktop.Text/tile and Command bar
In a Mobile. Just text/tile to sow my text/title

I've been trying some sentences but they don't work anyway.

This one doesn't hide command buttons.
<Setter Target="PageHeader.PrimaryCommandsVisibility" Value="Collapsed" />

I loose my PageHeader text/title
<ctrl10:PageHeader x:Name="PageHeader"                         Text="{Binding Title, Mode=TwoWay}"                         Grid.ColumnSpan="2">          <ctrl10:PageHeader.Content>              <CommandBar x:Name="PageHeaderCommandBar" Style="{StaticResource MainCommandBarStyle}" />          </ctrl10:PageHeader.Content>      </ctrl10:PageHeader>

Try this @juanluelguerre
<pageheader>
    <appbarbutton x:Name="MyButton" />
</pageheader>
<visualstate>
    <setter target="MyButton.Visibility" value="collapsed" />
</visualstate>

Using it, could work but not in a best practices. I'm using two command bar. One visible in a desktop mode (PageHeader) and the other in mobile one. So If i try that you said, I have to create separated content and buttons for two command bar. That means two different command bar.
In any case, and afer all (reviweing your code) and I solved it just including "x:Name" in my style MainCommandBar !! Now spacer is not null and it works !
Hope this help. Could be a good practice to use PageHeader, ;)
Thanks a lot once again !

Hi @JerryNixon ,
Using it, could work but not in a best practices. I'm using in my pages two command bar with the same content. One visible in a desktop mode (PageHeader) and the other in mobile one. So If I try that you said, I have to create separated Primary and Secondary buttons for two command bar. That means two different command bar in several pages. So "Copy & Paste" code in each pages !!!
Workarround. Using ContentTemplateSelector:
`
<ctrl10:PageHeader x:Name="PageHeader"
Grid.ColumnSpan="2"
Text="{Binding Title, Mode=TwoWay}"
ContentTemplateSelector="{StaticResource DevicePageHeaderTemplateSelector}" />

`
Here my "DevicePageHeaderTemplateSelector":
`public class DevicePageHeaderTemplateSelector : DataTemplateSelector
{
protected override DataTemplate SelectTemplateCore(object item, DependencyObject container)
{
var template = base.SelectTemplateCore(item, container);
    var header = container as PageHeader;
    // if (header.Tag is string && header.Tag as string != "Mobile")
    if (!DeviceInformationService.IsMobile())
    {
        CommandBar cmb = null;
        var obj = CommandBarTemplate.LoadContent();
        if (obj is CommandBar)
        {
            cmb = (CommandBar)obj;

            // Asign Comands just one
            if (header.PrimaryCommands?.Count == 0)
                foreach (var b in cmb.PrimaryCommands)
                    header.PrimaryCommands.Add(b);

            // Asign Comands just one
            if (header.SecondaryCommands?.Count == 0)
                foreach (var b in cmb.SecondaryCommands)
                    header.SecondaryCommands.Add(b);
        }

        return this.CommandBarTemplate;
    }
    return this.EmptyCommandBarTemplate;
}

public DataTemplate EmptyCommandBarTemplate { get; set; }
public DataTemplate CommandBarTemplate { get; set; }

}`
I my opinion, you could add a "CommandBar" Property,  inside PageHeader or allow set style.
Hope this help
Thanks

I am using version 1.18 of Template10 and I created a new UserControl with a PageHeader to display inside a page with a PageHeader, and I get the error:
Message = "System.NullReferenceException: Object reference not set to an instance of an object.\r\n   at Template10.Controls.PageHeader.UpdateSpacingToFitHamburgerMenu()\r\n   at Template10.Controls.PageHeader.PageHeader_Loaded(Object sender, RoutedEventArgs e)"
Of course I don't need a PageHeader control nested like that but just letting you know.

Why do you need two PageHeaders for different platforms? One is probably enough.

No, I'm using just one PageHeader but, one more Command Bar. I'm working in the same way as you can see in the sample "BottomAppBar": https://github.com/Windows-XAML/Template10/tree/master/Samples/BottomAppBar.


fix(build): newline after each call in a method chain

Since prettier prints chained calls in new line, eslint fails when used with prettier.
PR for the same in prettier https://github.com/prettier/prettier/pull/2673
If there is an option to disable this prettier rule when using with eslint I guess we can go for that.

not sure why travis ci still fails, could not reproduce that in local. Any help here would be great.

this doesn't fix the issue, closing this


JavaScript Console Error Fix

This should resolve that JavaScript console error issue for the non-Customizer Kanboard pages.

closes #83


Us27 registration period

Coverage increased (+0.03%) to 99.574% when pulling a8e8506df00db4861316bf7a9c72bc3ad5f8f6c0 on us27_registration_period into e67e82ba5c3b0a2b382c57cd004b03231859b7da on development.


How to remove Phoenix default logging

The logster README shows how to log new messages with logster, but it doesn't show how to remove the Phoenix generated log statements.  To me, the README implies that you can remove logging by removing a plug Plug.Logger line, but that line doesn't exist in a new Phoenix generated app.
I found this Phoenix issue that details how to remove the Phoenix generated log statements, https://github.com/phoenixframework/phoenix/issues/3483#issuecomment-549484373
I used this technique in my project to keep Phoenix from generating redundant messages with logster.  Added the following lines to m Application.ex file in my Phoenix project.
    # Disable Phoenix logging, using Logster instead
    :ok = :telemetry.detach({Phoenix.Logger, [:phoenix, :endpoint, :start]})
    :ok = :telemetry.detach({Phoenix.Logger, [:phoenix, :endpoint, :stop]})

Not sure if you want to update the README or not, but I thought I'd mention it in case it saves someone else some time.

The most recent Phoenix docs suggests the following to disable the built-in logger:
config :phoenix, :logger, false

According to Phoenix.Logger's doc

Disable logging: In your endpoint plug Plug.Telemetry, ..., log: Logger.level | false

-  plug Plug.Telemetry, event_prefix: [:phoenix, :endpoint]
+  plug Plug.Telemetry, event_prefix: [:phoenix, :endpoint], log: false


battle attack accuracy not well-modeled

Need to figure in dexterity of attacker into whether they miss or not. Also, certain weapons should make you more/less likely to miss.

0.12.6 now models accuracy and damage much more accurately. Weapon modifiers are not yet implemented.

0.13.0 now takes care of all this.


Better error handling

Better handling of launcher failures using CLI.
Same with MAPDL crashes (read the output files if in local?)
See #2798

I think we should have:

report support: pymapdl report --file report.txt so it prints the report to a file
activate the debug mode pymapdl debug on --file mylog.log.

Related to #2703


HDD calculation

For Bologna, I do not think our results match the climate.onebuilding results.
HDD for 10°C baseline with our tool = 730
HDD for 10°C baseline Onebuilding = 673

from this file
bologna.txt

@FedericoTartarini
Hi Federico, to verify that Bologna's HDD calculations were accurate. I went to Climate.OneBuilding. Org, downloaded the Bologna EPW and opened the CBE Clima tool and uploaded this EPW file and I calculated the total HDD results. Then, on this CBE Clima tool, I selected the Bologna EPW file and again calculated the results for the total HDD. I compared these two results and found them both to be the same. I would like to check with you if this has been solved, thanks!

I apologize for not making this 100% clear, but unfortunately, this is not the issue I was mentioning.
The issue is that if you open the .zip climateorg file you downloaded with from here, inside there is a file with ends with stat (ITA_ER_Bologna-Marconi.AP.161400_TMYx.stat).
Open this file with either NotePad or Excel you will find a table in it showing the heating degree day.

This is the value that does not match the results of the Clima tool. Please let me know if this is clear now.

I apologize for not making this 100% clear, but unfortunately, this is not the issue I was mentioning.
The issue is that if you open the .zip climateorg file you downloaded with from here, inside there is a file with ends with stat (ITA_ER_Bologna-Marconi.AP.161400_TMYx.stat).
Open this file with either NotePad or Excel you will find a table in it showing the heating degree day.

This is the value that does not match the results of the Clima tool. Please let me know if this is clear now.

I apologize for not making this 100% clear, but unfortunately, this is not the issue I was mentioning.
The issue is that if you open the .zip climateorg file you downloaded with from here, inside there is a file with ends with stat (ITA_ER_Bologna-Marconi.AP.161400_TMYx.stat).
Open this file with either NotePad or Excel you will find a table in it showing the heating degree day.

This is the value that does not match the results of the Clima tool. Please let me know if this is clear now.

Hi Federico, thanks for the explanation, I misunderstood it a bit before. I would like to double check, I noticed that the STAT file has two HDDs "Monthly Standard Heating/Cooling Degree Days/Hours" and "Monthly Weather File Heating/Cooling Degree Days/Hours", which one should I use. Thanks!

I believe there are two HDD value sets based on the following which is stipulated in the stat file.
The "Monthly Standard Heating/Cooling Degree Days/Hours" values are being based off the 2021 ASHRAE design conditions.

Where as the "Monthly Weather File Heating/Cooling Degree Days/Hours" HDD values are solely based off the weather data source.

Great, so I then believe we should compare our results with the Monthly Weather File Heating since we only have access to this dataset.

Hey @FedericoTartarini, Eric and I have been wrapping our heads around quite a bit, but so far are unable to identify where the calculation error may be with the clima code:

I've researched but I am unable to ascertain the formula climate.onebuilding is using to calculate the HDD and CDD values.

Thank you for looking into this. @giobetti shall we contact Dru and ask him if he knows how these values are calculated in the OneBuilding files?

Thank you for looking into this. @giobetti shall we contact Dru and ask him if he knows how these values are calculated in the OneBuilding files?

Hi Federico, just checking if you've received any response here?

No unfortunately.


fix incorrect command (git add *) plus typos

I separated what I consider "fixes" into three chunks so you can reject something if you don't like it.

Awesome thank you.


Not able to update NVE CVE data. i am working with proxy. after run the script i dont have the cert error but got HTTP head error while update . I also used to stop HEAD by mvn -Ddownloader.quick.query.timestamp=false. but it din't work for me.

Reporting Bugs/Errors
When reporting errors, 99% of the time log file output is required. Please post the log file as a gist and provide a link in the new issue.
Reporting False Positives
When reporting a false positive please include:

The location of the dependency (Maven GAV, URL to download the dependency, etc.)
The CPE that is believed to be false positive

Please report the CPE not the CVE

Example
False positive on library foo.jar - reported as cpe:/a:apache:tomcat:7.0
<dependency>
   <groupId>org.sample</groupId>
   <artifactId>foo</artifactId>
   <version>1.0</version>
</dependency>

Very detailed issue title - however, as the issue template suggests we'll need the log to assist in debugging your issue.

Hi Jeremy,
I am using proxy. without proxy script is working fine for me. But I need it with the proxy. can you please tell me the process how I configure it with my proxy url. I checked th NVE site and my proxy is able to download package from this site. But when I run this is script it will not update and gives the error. Can you please tell me the site links from where script hits for update . So that I can whitelist those site in my proxy.
Thanks

Look for the cveUrl12Modified argument on
http://jeremylong.github.io/DependencyCheck/dependency-check-cli/arguments.html.
The four urls used are listed.  Note that the %d in two of the urls are
replaced with 2002-2016.
-Jeremy
On Thu, Nov 24, 2016 at 3:08 AM, pankaj khali<EMAIL_ADDRESS>wrote:

Hi Jeremy,
I am using proxy. without proxy script is working fine for me. But I need
it with the proxy. can you please tell me the process how I configure it
with my proxy url. I checked th NVE site and my proxy is able to download
package from this site. But when I run this is script it will not update
and gives the error. Can you please tell me the site links from where
script hits for update . So that I can whitelist those site in my proxy.
Thanks
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jeremylong/DependencyCheck/issues/620#issuecomment-262713981,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA0qwmtK7XHzRp8emrqaguSwLmILfDgtks5rBUYKgaJpZM4K2PBf
.

Hi Jeremylong,
I tried running  https://github.com/stevespringett/nist-data-mirror/blob/master/src/NistDataMirror.java .
It did not fetch me the desired output. But Wget on the same URL is working well.

HTTP request sent, awaiting response... 200 OK
Length: 1401344 (1.3M) [application/x-gzip]
Saving to: “nvdcve-2.0-2016.xml.gz”
100%[==============================================================================================================================>] 1,401,344    300K/s   in 4.6s
2016-11-25 17:48:32 (300 KB/s) - “nvdcve-2.0-2016.xml.gz” saved [1401344/1401344]
Also please tell if some how I get all the files where shall I club n place them ?  Or I need to copy them each to "data" folder ?
Thanks,
Neeraj Virmani

First, what version of Java and dependency-check are you using? Oracle JRE
8, OpenJDK 8, etc.? dependency-check 1.4.2 (1.4.4 is the latest)?
Regarding creating a local mirror of the NVD see this:
http://jeremylong.github.io/DependencyCheck/data/mirrornvd.html
--Jeremy
On Fri, Nov 25, 2016 at 7:30 AM, neerajv<EMAIL_ADDRESS>wrote:

Hi Jeremylong,
I tried running https://github.com/stevespringett/nist-data-
mirror/blob/master/src/NistDataMirror.java .
It did not fetch me the desired output. But Wget on the same URL is
working well.

HTTP request sent, awaiting response... 200 OK
Length: 1401344 (1.3M) [application/x-gzip]
Saving to: “nvdcve-2.0-2016.xml.gz”
100%[=======================================================
=======================================================================>]
1,401,344 300K/s in 4.6s
2016-11-25 17:48:32 (300 KB/s) - “nvdcve-2.0-2016.xml.gz” saved
[1401344/1401344]
Also please tell if some how I get all the files where shall I club n
place them ? Or I need to copy them each to "data" folder ?
Thanks,
Neeraj Virmani
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/jeremylong/DependencyCheck/issues/620#issuecomment-262948107,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA0qwpMnF6BpvXULDla84l8OpGAqSfCTks5rBtTlgaJpZM4K2PBf
.

Hi,
After i did as wrote on :-  http://jeremylong.github.io/DependencyCheck/data/mirrornvd.html
I am facing this issue : -
[root@gitlabserver neeraj]# sh dep-check-date.sh "NVD" "11/28/2016" --project virmani -s "/tmp/neeraj/my_code"
[INFO] Checking for updates
Exception in thread "main" java.lang.IllegalArgumentException: URI has an authority component
at java.io.File.(File.java:423)
at org.owasp.dependencycheck.utils.Downloader.getLastModified(Downloader.java:249)
at org.owasp.dependencycheck.utils.Downloader.getLastModified(Downloader.java:228)
at org.owasp.dependencycheck.data.update.nvd.UpdateableNvdCve.add(UpdateableNvdCve.java:101)
at org.owasp.dependencycheck.data.update.NvdCveUpdater.retrieveCurrentTimestampsFromWeb(NvdCveUpdater.java:330)
at org.owasp.dependencycheck.data.update.NvdCveUpdater.getUpdatesNeeded(NvdCveUpdater.java:259)
at org.owasp.dependencycheck.data.update.NvdCveUpdater.update(NvdCveUpdater.java:79)
at org.owasp.dependencycheck.Engine.doUpdates(Engine.java:678)
at org.owasp.dependencycheck.Engine.analyzeDependencies(Engine.java:489)
at org.owasp.dependencycheck.App.runScan(App.java:272)
at org.owasp.dependencycheck.App.run(App.java:164)
at org.owasp.dependencycheck.App.main(App.java:69)
With NoUpdate :-
[root@gitlabserver neeraj]# sh dep-check-date.sh "NVD" "11/28/2016" --project virmani -s "/tmp/neeraj/my_code" --noupdate
[ERROR] No documents exist
Unable to continue dependency-check analysis.
[ERROR] One or more fatal errors occurred
[ERROR] No documents exist
==========
My env :-
Java :- 1.8.0_91
Dependency Check version :- 1.4.4
Thanks,
Neeraj Virmani

As mentioned in the other issue - I have no idea what is in you script. However, it appears that the URL is incorrect; try googling for "URI has an authority component".

I have only copied the scripts provided on the link u suggested http://jeremylong.github.io/DependencyCheck/data/mirrornvd.html You can check the script there.
Thanks

The Data folder should have some old database from any previous run to resolve the issue of " No documents exist"
For URI :- there has to be an extra / in the file , ie
--cveUrl20Modified file:///NVD/2016-11-28/nvdcve-2.0-Modified.xml.gz       CORRECT
--cveUrl20Modified file://NVD/2016-11-28/nvdcve-2.0-Modified.xml.gz         INCORRECT
Thanks,
Neeraj Virmani

Hi jeremylong,
I am behind proxy and not able to update NVD data. I am executing following command :
./dependency-check.sh --app "project_name" -scan "my_code_location" --proxyserver "proxy_url" --proxyport "port_number" --log "log_location"
Please let me know what I am missing.
While finding other options, I also try with mirror NVD data and facing same issue.
I am able to download NVD gzip file by directly putting url in browser. in Browser proxy is configured.
Please tell me what should I add above script for proxy.

@pankaj-14 couple of questions:

Does your proxy require authentication?
Are you specifying anything other then the server name in the proxyserver parameter (i.e. there is no http://)?
Does running something like the following work?

curl -x http://proxy_server:proxy_port https://nvd.nist.gov/download/nvdcve-Modified.xml.gz

mac os x
cd /usr/local/Cellar/dependency-check/nist-data-mirror
wget https://nvd.nist.gov/download/nvdcve-2002.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2002.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2003.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2003.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2004.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2004.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2005.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2005.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2006.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2006.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2007.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2007.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2008.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2008.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2009.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2009.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2010.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2010.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2011.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2011.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2012.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2012.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2013.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2013.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2014.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2014.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2015.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2015.xml.gz &
wget https://nvd.nist.gov/download/nvdcve-2016.xml.gz &
wget https://nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2016.xml.gz &

Refer to https://jeremylong.github.io/DependencyCheck/data/mirrornvd.html for information on how to mirror the NVD. Once you have a local mirror, you can point Dependency-Check to the mirror.

@jeremylong it works for me now. Thanks for your Support.


S3 compatible platform support

Hello Ivan,
Firstly, congratulations on creating a great library... I think it's a really clean design and very easy to use, thanks for your great work!
I noticed that the AwsS3BlobStorageProvider is missing the constructors that would be required to use it with S3 compatible services like DreamObjects. I've added these constructors for your consideration.
I also found that the AwsS3BlobStorageProvider provider's GetMetaAsync method behaved differently to the equivalent methods in the DiskDirectoryBlobStorage provider and the AzureBlobStorageProvider in the situation where one of the blobs being requested doesn't exist. The latter two providers return null for the non-existent blobs, whereas the AwsS3BlobStorageProvider implementation throws a NullReferenceException when a non-existent blob is encountered. I've fixed this issue.
I will create a separate pull request after this one including a unit test for that GetMetaAsync(missingFile) behaviour mentioned above, and will fix any other IBlobStorage providers that are failing it.
Cheers,
Dave.

Here is the integration test that should be added to BlobStorageProviderTests.cs in Storage.Net.Tests.Integration... my apologies, I tried adding it but as I don't have an environment setup to test all of the other providers, I won't be able to easily see if all the other providers are passing it...
  [Fact]
  public async Task GetMeta_doesnt_exist_returns_null()
  {
     string id = RandomGenerator.RandomString;

     BlobMeta meta = (await _storage.GetMetaAsync(new[] { id })).First();

     Assert.Null(meta);
  }

And here is the fixed code for ZipFileBlobStorageProvider.cs, which is the only other provider that I can confirm is failing the test:
public Task<IEnumerable<BlobMeta>> GetMetaAsync(IEnumerable<string> ids, CancellationToken cancellationToken = default(CancellationToken))
{
     var result = new List<BlobMeta>();
     ZipArchive zipArchive = GetArchive(false);

     foreach(string id in ids)
     {
        string nid = StoragePath.Normalize(id, false);

        try
        {
           ZipArchiveEntry entry = zipArchive.GetEntry(nid);

           long originalLength = entry.Length;

           result.Add(new BlobMeta(originalLength, null));
        }
        catch (NullReferenceException)
        {
           result.Add(null);
        }
     }

     return Task.FromResult<IEnumerable<BlobMeta>>(result);
  }

Great, thanks @aloneguid - I'm glad it's still passing all of your tests. I notice that the latest AppVeyor build was cancelled. Let me know if you need anything else from me for the build to proceed.


Can't run Sampling.py

I'm having trouble running Sampling.py after training.
There are no such classes named Polynomial and Ridge in conditioner.py but it imports in runners/stastical_translation.py .

Hi, just comment those imports. They are not used here and will be removed in next update


Writing files on external drive

I was trying to setup a Nextcloud instance with an Postgres database on a raspberry pi for a homelab. Therefore of course an external data drive is needed. Now I was able to reduce the problem to a permission failure. When trying to mount the external drive in the docker container for the _data directory I get an chown: changing ownership of '/var/lib/postgresql/data': Operation not permitted error. I also reduced the docker-compose to a simple command:
docker run -i -d -t --env=POSTGRES_PASSWORD=example -v /mnt/usb/db_data:/var/lib/postgresql/data postgres

Of course I tried to mount the drive in a simple ubuntu bash container:
docker run -i -t -v /mnt/usb:/opt/usb ubuntu /bin/bash

here I got all files, can write on it, etc
I hope this is the right place to ask and thank's for help

You need to make sure the filesystem of your storage is one that PostgreSQL supports and that the (unix) file permissions are suitable for the PostgreSQL instance to be able to read/write to it (I'm guessing it's something like vfat/FAT32, and PostgreSQL is probably not designed to handle that well).
Unfortunately, we do not have the bandwidth to provide in-depth integration/deployment/environment debugging or support here; these sorts of questions/requests would be more appropriately posted to a dedicated support forum, such as the Docker Community Slack, Server Fault, Unix & Linux, or Stack Overflow.


Update to support ruby 2.4.2

Summary
Test against ruby 2.4.2 in travis CI
/domain @Betterment/test_track_core

Fix for issue #52
Required updating rails, json, rspec, therubyracer, and newrelic_rpm gems to run application.
Updated simple_form and simplecov to resolve Fixnum/Bignum deprecation warnings.
Updated sass-rails to fix sprockets deprecation warning.
All tests pass locally.

/platform @jmileham
<< domain platform
Thanks @jeremyjung - looking now.

This is great. Thanks for tracking down the dependency versions necessary to make this work and killing some deprecation warnings in the process. I took the liberty of unlocking some of the precise version numbers and running a full bundle update in an attempt to get on the most modern versions of everything, in addition to swapping FactoryGirl to FactoryBot.
domain lgtm
platform lgtm!
/domain @aburgel can you check that my additions are all cool?

<< domainlgtm

Thanks again, @jeremyjung!


If "cmake.cmakePath" is set wrong, cmake-tools fails with unhandled exception

Brief Issue Summary
I had from another platform set the cmake.cmakePath to cmake3, which didn't exist on my current plattform.
Expected:
I would expect that cmake-tools would return some meaningful error, e.g. "No cmake file in cmake.cmakePath found".
Apparent Behavior:
cmake-tools threw an unhandled exception:
console.ts:136 [Extension Host] Error: spawn cmake3 ENOENT
	at exports._errnoException (util.js:1050:11)
	at Process.ChildProcess._handle.onexit (internal/child_process.js:193:32)
	at onErrorNT (internal/child_process.js:367:16)
	at _combinedTickCallback (internal/process/next_tick.js:80:11)
	at process._tickCallback (internal/process/next_tick.js:104:9)
t.log @ console.ts:136
t._logExtensionHostMessage @ extensionHost.ts:400
(anonymous) @ extensionHost.ts:213
emitTwo @ events.js:106
emit @ events.js:194
process.nextTick @ internal/child_process.js:766
_combinedTickCallback @ internal/process/next_tick.js:73
_tickCallback @ internal/process/next_tick.js:104

Platform and Versions

Operating System: Windows 7
CMake Version: 3.9.4
VSCode Version: 1.21.1
CMake Tools Extension Version: 0.11-beta5
Compiler/Toolchain: Visual C++ 2017 x86

@s-martin CMT doesn't check whether a file exists before trying to execute it, so that is why an exception is thrown in your case. It's trivial to add a check, but I don't know what @vector-of-bool s opinion is on this topic.

Should be fixed in next version.


RFC bib model

@ronaldtse do we have RNG grammas for RFC bibliographic item?

@opoudjis could you help extend the current one for IETF documents? I suppose we should model it according to the attributes given in <reference> of RFC XML v3.

So, RFC XML already has a serialisation, as captured in https://tools.ietf.org/html/rfc7991 for the reference element. I take it this request is to express RFC in the isobib model. I hope this is for the purposes of citing RFC etc in ISO, and not in RFC, since the roundtrip is kinda silly.
OK, I'll get to mapping.

@ronaldtse @opoudjis could we use XML from https://www.rfc-editor.org/refs/bibxml/reference.RFC.8341.xml for example? So we don't have to make model class and serialization, just get the XML document and include it to asciidoctor-gb output.

No, the point is we need to translate from the IETF Bib XML format to the Relaton data model format. Asciidoctor-gb will not (and should not) understand the IETF format.

There may be refinements down the road, but this is an attempt to map all of the RFC XML to be found in the RFC references into IsoXML.
NOTE: This references the draft grammar at https://github.com/riboseinc/iso690xml/blob/master/grammars/biblio.rnc

reference@lang => bibitem/language
reference@base => IGNORE
reference@anchor => bibitem@id
reference@target => bibitem/source
reference@quoteTitle => IGNORE
reference/front/title => bibitem/btitle
reference/front/title@abbrev => IGNORE
reference/front/title@ascii => IGNORE
reference/front/seriesInfo@asciiName: see reference/front/seriesInfo@name. General rule for ascii* attributes: ignore in favour of UTF-8 originals
reference/front/seriesInfo@asciiValue: see reference/front/seriesInfo@value
reference/front/seriesInfo@name => bibitem/series/title
reference/front/seriesInfo@status => bibitem@type
reference/front/seriesInfo@stream => bibitem/contributor[role@type = "author"]/organization/name
reference/front/seriesInfo@value => bibitem/series/number
reference/front/author@asciiFullname: see reference/front/author@fullname
reference/front/author@asciiInitials: see reference/front/author@initials
reference/front/author@asciiSurname: see reference/front/author@surname
reference/front/author@fullname => bibitem/contributor[role@type = "author"]/person/name/completeName
reference/front/author@initials => bibitem/contributor[role@type = "author"]/person/name/initial
reference/front/author@role => bibitem/contributor/role@type : if this is populated, bibitem/contributor[role@type = "author"] becomes bibitem/contributor[role@type = "editor"]
reference/front/author@surname => bibitem/contributor[role@type = "author"]/person/name/surname
reference/front/author/organization => bibitem/contributor[role@type = "author"]/person/affiliation/organization/name : default is IETF
reference/front/author/organization@abbrev => bibitem/contributor[role@type = "author"]/person/affiliation/organization/abbreviation
reference/front/author/address/postal/postalLine => bibitem/contributor[role@type = "author"]/person/contact/street : interim solution, we haven't modelled this
reference/front/author/address/postal/postalLine@ascii: see reference/front/author/address/postal/postalLine
reference/front/author/address/postal/city => bibitem/contributor[role@type = "author"]/person/contact/city
reference/front/author/address/postal/city@ascii: see reference/front/author/address/postal/city
reference/front/author/address/postal/code => bibitem/contributor[role@type = "author"]/person/contact/postcode
reference/front/author/address/postal/code@ascii: see reference/front/author/address/postal/code
reference/front/author/address/postal/country => bibitem/contributor[role@type = "author"]/person/contact/country
reference/front/author/address/postal/country@ascii: see reference/front/author/address/postal/country
reference/front/author/address/postal/region => bibitem/contributor[role@type = "author"]/person/contact/state
reference/front/author/address/postal/region@ascii: see reference/front/author/address/postal/region
reference/front/author/address/postal/street => bibitem/contributor[role@type = "author"]/person/contact/street
reference/front/author/address/postal/street@ascii: see reference/front/author/address/postal/street
reference/front/author/address/phone => bibitem/contributor[role@type = "author"]/person/contact/phone
reference/front/author/address/facsimile : NOT MODELLED YET
reference/front/author/address/email => bibitem/contributor[role@type = "author"]/person/contact/email
reference/front/author/address/email@ascii: see reference/front/author/address/email
reference/front/author/address/uri => bibitem/contributor[role@type = "author"]/person/contact/uri
reference/front/date@day => bibitem/date[@type = "published"]/on (compose)
reference/front/date@month => bibitem/date[@type = "published"]/on (compose)
reference/front/date@year => bibitem/date[@type = "published"]/on (compose)
reference/front/area => bibitem/classification[@type = "area"]
reference/front/workgroup  => bibitem/contributor[role@type = "author"]/person/affiliation/organization/subdivision
reference/front/keyword => bibitem/classification[@type = "area"]
reference/front/note => bibitem/note (header: NOTE)
reference/front/boilerplate => IGNORE
reference/annotation => bibitem/note (header: ANNOTATION)
reference/format => IGNORE
reference/refcontent => bibitem/note (header: REFCONTENT)
reference/seriesInfo: see reference/front/seriesInfo

Text formatting

reference/front/abstract@anchor => IGNORE
reference/front/abstract/dl => dt
reference/front/abstract/dl/dt => dt
reference/front/abstract/dl/dd => dd
reference/front/abstract/dl@anchor => IGNORE
reference/front/abstract/dl@hanging => IGNORE
reference/front/abstract/dl@spacing => IGNORE
reference/front/abstract/ol => ol
reference/front/abstract/ol@anchor => IGNORE
reference/front/abstract/ol@group => IGNORE
reference/front/abstract/ol@spacing => IGNORE
reference/front/abstract/ol@start => IGNORE
reference/front/abstract/ol@type => ol@type (with a mapping)
reference/front/abstract/ol/li => li
reference/front/abstract/ul => ul
reference/front/abstract/ul@anchor => IGNORE
reference/front/abstract/ul@empty => IGNORE
reference/front/abstract/ul@spacing => IGNORE
reference/front/abstract/ul/li => li
reference/front/abstract/t => p
reference/front/abstract/t@anchor => IGNORE
reference/front/abstract/t@hangText => IGNORE
reference/front/abstract/t@keepWithNext => IGNORE
reference/front/abstract/t@keepWithPrevious => IGNORE
reference/front/abstract/.../artwork => image
reference/front/abstract/.../artwork@align => IGNORE
reference/front/abstract/.../artwork@alt => IGNORE
reference/front/abstract/.../artwork@anchor => IGNORE
reference/front/abstract/.../artwork@height => image@height
reference/front/abstract/.../artwork@name => IGNORE
reference/front/abstract/.../artwork@src => image@src
reference/front/abstract/.../artwork@type => IGNORE
reference/front/abstract/.../artwork@width => image@width
reference/front/abstract/.../artwork@xml:space => IGNORE
reference/front/abstract/.../figure => figure
reference/front/abstract/.../figure@align => IGNORE
reference/front/abstract/.../figure@alt => IGNORE
reference/front/abstract/.../figure@anchor => IGNORE
reference/front/abstract/.../figure@height => IGNORE
reference/front/abstract/.../figure@src => IGNORE
reference/front/abstract/.../figure@suppress-title => IGNORE
reference/front/abstract/.../figure@title => figure/name
reference/front/abstract/.../figure@width => IGNORE
reference/front/abstract/.../figure/name => figure/name
reference/front/abstract/.../figure/preamble => .../p
reference/front/abstract/.../figure/postamble => .../p
reference/front/abstract/.../sourcecode => sourcecode
reference/front/abstract/.../sourcecode@anchor => IGNORE
reference/front/abstract/.../sourcecode@name => IGNORE
reference/front/abstract/.../sourcecode@src => IGNORE
reference/front/abstract/.../sourcecode@type => IGNORE
reference/front/abstract/.../bcp14A => text
reference/front/abstract/.../cref => review
reference/front/abstract/.../cref@anchor => review/id
reference/front/abstract/.../cref@display => IGNORE
reference/front/abstract/.../cref@source => review/reviewer
reference/front/abstract/.../em => em
reference/front/abstract/.../eref => text
reference/front/abstract/.../eref@target => link
reference/front/abstract/.../iref => IGNORE
reference/front/abstract/.../list => ul/li
reference/front/abstract/.../relref => eref
reference/front/abstract/.../relref@displayFormat => IGNORE
reference/front/abstract/.../relref@relative => IGNORE
reference/front/abstract/.../relref@section => eref/locality[@type = "section"]
reference/front/abstract/.../relref@target => xref@target
reference/front/abstract/.../spanx => text (there's a lot more formatting, but this is legacy v2 element)
reference/front/abstract/.../strong => strong
reference/front/abstract/.../sub => sub
reference/front/abstract/.../sup => sup
reference/front/abstract/.../tt => tt
reference/front/abstract/.../vspace => br
reference/front/abstract/.../xref => xref
reference/front/abstract/.../xref@format => IGNORE
reference/front/abstract/.../xref@pageno => IGNORE
reference/front/abstract/.../xref@target => xref@target

@andrew2net, I'm trying to introduce release notes into all Metanorma gems, now that they are starting to be used in production. If you bump one of your gems related to Metanorma, please summarise all changes, and link to related tickets. This issue is now linked to https://github.com/riboseinc/iso-bib-item/releases/tag/v0.1.7

@opoudjis are we going to do an XSLT or a Ruby implementation for RelatonXML to RFC BibXML?

@opoudjis it could be several reference/front/seriesInfo. So, how we shoud assign multiple series@info to one `bibitem@type?
reference/front/seriesInfo@status => bibitem@type

RFC has an idiosyncratic way of dealing with seriesInfo, it encodes two different pieces of information. I will summarise later today.

We have two versions of RFC XML, unfortunately: v2 https://tools.ietf.org/html/rfc7749 and v3 https://tools.ietf.org/html/rfc7991#section-2.47. The v2 tags are included as v3 as deprecated elements, and I have included both in the mappings above.
The RFC XML currently on https://xml2rfc.tools.ietf.org/public/rfc/bibxml is RFC XML v2. In fact, support for v3 is still quite poor, and v3 may yet be radically altered. Which is a pity, because overall v3 is better—except for its handling of series.
In v2, seriesInfo is a simple tag, that indicates only the name and value of the series as attributes. In https://xml2rfc.tools.ietf.org/public/rfc/bibxml/reference.RFC.0001.xml, one series is the RFC series, which is the one we are interested in:
<seriesInfo name="RFC" value="1"/> => <bibitem><series><title>RFC</title><number>1</number></bibitem>
The second series given in that URL is the DOI of the document, and that is actually not a series, it's a document identifier:  <seriesInfo name="DOI" value="10.17487/RFC0001"/> =>  <bibitem><docidentifier type="DOI"> 10.17487/RFC0001 </docidentifier></bibitem>.
So for the documents you're going to be getting from the https://xml2rfc.tools.ietf.org sites, the best thing to do is to have a different mapping for each seriesInfo@name type; some will be better treated as series, some as doc identifiers. I'll go further though: properly we should be providing only one series for each document, and any other seriesInfo instances should be treated as document identifiers. If a document is somehow published by two organisations, each organisation can assign it to its own series, but that is unusual (though in the standards world, probably not unusual enough).
All of these elements:
reference/front/seriesInfo@asciiName: see reference/front/seriesInfo@name. General rule for ascii* attributes: ignore in favour of UTF-8 originals
reference/front/seriesInfo@asciiValue: see reference/front/seriesInfo@value
reference/front/seriesInfo@status => bibitem@type
reference/front/seriesInfo@stream => bibitem/contributor[role@type = "author"]/organization/name
reference/front/seriesInfo@value => bibitem/series/number

are from RFC XML v3. v3 does something very annoying:

If a  element contains a  element with a name
of "Internet-Draft", it can also have at most one additional
 element with a "status" attribute whose value is of
"standard", "full-standard", "bcp", "fyi", "informational",
"experimental", or "historic" to indicate the intended status of
this Internet-Draft, if it were to be later published as an RFC.
If such an additional  element has one of those
statuses, the name needs to be "".

If a  element contains a  element with a name
of "RFC", it can also have at most one additional
element with a "status" attribute whose value is of
"full-standard", "bcp", or "fyi" to indicate the current status of
this RFC.  If such an additional  element has one of
those statuses, the "value" attribute for that name needs to be
the number within that series.  That  element might also
contain an additional  element with the status of
"info", "exp", or "historic" and a name of "" to indicate the
status of the RFC.

In other words, even if there are multiple seriesInfo tags per document, RFC expects only one of those tags to contain a status attribute. The status attribute does not really belong in RFC XML, and I wouldn't be that concerned if you omit it from the mapping to Relaton XML completely; but the issue of multiple seriesInfo@status instances is not intended to apply. And in any case, this is RFC XML v3, which I doubt is going to be available for online bibliographies for some time.

Found an instance where an item is actually cited as belonging to two different series by two different organisations:
https://xml2rfc.tools.ietf.org/public/rfc/bibxml2/_reference.ITU.X530.2001.xml
<seriesInfo name="ITU-T" value="Recommendation X.530"/>
<seriesInfo name="ISO" value="Standard 9594-10"/>

That is.... annoying. I think we really do have to model this as two distinct series elements in the bibitem. But the issue of ambiguity of seriesInfo@status does not arise in these: seriesInfo@status is specific to RFC and Internet-Draft series, published by the IETF.


Auto-format

Thanks for your work on the plugin so far. I'd love to be able to run the format shortcut in the IDE and have my WGSL shaders formatted. Is this functionality on your roadmap?

if there is a standard formatter for wgsl I can probably add it into the plugin without too much hassle

@dparnell, can this formatter be added to the plugin?
https://github.com/wgsl-analyzer/wgsl-analyzer/tree/main/crates/wgsl_formatter


What's the purpose of testdata/echo

I noticed that testdata/echo is a compiled binary (testdata/echo: Mach-O 64-bit x86_64 executable, flags:<NOUNDEFS|DYLDLINK|TWOLEVEL|PIE>) and was wondering what it is used for.
I tried looking for commits that touched this file and it seems like it was imported from onetruawk test data. I also (briefly) looked at the test drivers and it looks like this is not used anywhere, but I might be wrong.

Ah, thanks for the report! I have no idea what that file is. I'll do some further digging and then delete it. Maybe it's Brian Kernighan's backdoor into GoAWK. ;-)

Removed in https://github.com/benhoyt/goawk/commit/158232a76856e12d680a53c0b3ab7666bf2c3c3a -- thanks!

Thanks!

Maybe it's Brian Kernighan's backdoor into GoAWK. ;-)

I hope not :^)

Sorry for commenting on an already-closed issue, but can you consider tagging a new release?
Tagging a new release simplifies the Debian packaging, since I won't need to repackage your code to exclude this file or track HEAD instead of git tags.
It's no big deal if you don't want to tag, though. Just ignore me if that's the case :^)

@guilherme-puida Done! https://github.com/benhoyt/goawk/releases/tag/v1.27.0
Speaking of Debian, I've been hoping that Debian updates its version of awk (Gawk is the default) to Gawk 5.3.0, which includes the new CSV support. Any idea how to make that happen? I've emailed the maintainer (Adrian Bunk) a couple of times, but got no response. Once it's in Debian it'll automatically trickle down to Ubuntu too. Both stable and unstable are still on 5.2.1.
The original-awk package has updated unstable to the new version with CSV, which is nice, though it seems stable is still on the old version.

@guilherme-puida Done! https://github.com/benhoyt/goawk/releases/tag/v1.27.0

Thanks!

Speaking of Debian, I've been hoping that Debian updates its version of awk (Gawk is the default) to Gawk 5.3.0, which includes the new CSV support. Any idea how to make that happen? I've emailed the maintainer (Adrian Bunk) a couple of times, but got no response.

I'm not sure if we can do anything else, but I'll ask around and get back to you.

The original-awk package has updated unstable to the new version with CSV, which is nice, though it seems stable is still on the old version.

The version on stable is kind of set in stone (that's why it's called stable). There is a way to update it via backports, but it's an extra repository that users can opt in. [This page] has a flowchart showing the way packages flow through the different releases.

I'm not sure if we can do anything else, but I'll ask around and get back to you.

Thanks!


How to replace default Realm with another Realm (in the bundle)?

I've been reading a bunch of Stack Overflow posts and the documentation, but I can't seem to achieve the results I'm after. :grimacing:
Goals
I am building a game where most of the in-game content, add-ons, etc are being stored in Realm. I would like to pre-populate a Realm (that's being stored in the app's bundle) with this data and copy all of it to the default Realm when the app is launched for the first time.

Content will have an unlocked value that will determine if the user can see that bit of content.

Expected Results

Pre-build all game content in Realm.
Copy all data to the default Realm on first launch.

Actual Results

Nothing right now, Not sure where to start.

Version of Realm and Tooling

Realm v0.98.5
Xcode Version 7.2.1 (7C1002)
OS X 10.11.3 (15D21)
RealmSwift on iOS
Carthage

I'd appreciate a push in the right direction. :dancer:

Have you read the Bundling a Realm with an App section of our docs?

Thanks @jpsim! I'll take a look and see how far I get. :+1:

The Bundling a Realm with an App guide got me pretty far in achieving what I wanted, but I'm having issues figuring out how to create a fresh/empty *.realm file. Could you point me in the right direction?

let path = Realm.Configuration.defaultConfiguration.path!
// delete any previously created Realm files
do {
  try NSFileManager.defaultManager().removeItemAtPath(path)
} catch {}
_ = try Realm()
print("empty Realm created at path: \(path)")

Thanks again, @jpsim! :+1:

My app uses CloudKit to backup the realm data and fetch the data whenever user want.
I coded to upload "default.realm" file in the documents folder to iCloud with below code.
And the data seems to be uploaded well.
// create file path from app's documents folder
NSString* filePath = [NSSearchPathForDirectoriesInDomains(NSDocumentDirectory, NSUserDomainMask, YES) objectAtIndex:0];
NSString* fileName = @"default.realm";
NSString* fileAtPath = [filePath stringByAppendingPathComponent:fileName];
CKRecordID *recordID = [[CKRecordID alloc] initWithRecordName:kRecordName];
CKRecord *record = [[CKRecord alloc] initWithRecordType:kRecordType recordID:recordID];

if ([[NSFileManager defaultManager] fileExistsAtPath:fileAtPath]) {
    CKAsset *asset = [[CKAsset alloc] initWithFileURL:[NSURL fileURLWithPath:fileAtPath]];
    [record setObject:asset forKey:@"Realm"];
}

// upload
CKDatabase *privateDatabase = [[CKContainer defaultContainer] privateCloudDatabase];
[privateDatabase saveRecord:record completionHandler:^(CKRecord *record, NSError *error) {
    // completion handling
}

And below is the download part. I can download as well but seems like the realm file is not changing.
CKDatabase *privateDatabase = [[CKContainer defaultContainer] privateCloudDatabase];
CKRecordID *recordID = [[CKRecordID alloc] initWithRecordName:kRecordName];

// fetch realm from cloud
[privateDatabase fetchRecordWithID:recordID completionHandler:^(CKRecord *record, NSError *error) {
  if (!error) {
        CKAsset *realmAsset = record[@"Realm"];
        NSData *realmData = [NSData dataWithContentsOfURL:realmAsset.fileURL];
        NSString* filePath = [NSSearchPathForDirectoriesInDomains(NSDocumentDirectory, NSUserDomainMask, YES) objectAtIndex:0];
        NSString* fileName = @"default.realm";
        NSString* fileAtPath = [filePath stringByAppendingPathComponent:fileName];

        // delete existing realm file
        if ([[NSFileManager defaultManager] fileExistsAtPath:fileAtPath]) {
            NSError *error;
            [[NSFileManager defaultManager] removeItemAtPath:fileAtPath error:&error];
            if (error) {
                 // error handling
            }
        }
        // create a new realm file
        if([[NSFileManager defaultManager] createFileAtPath:fileAtPath contents:realmData attributes:nil]) {
              // code goes thru here but nothing changes
        }
    }
}];

I want to change the entire realm data. What am I doing wrong? Where should I start from?


Apply the double-search change to simple search

...and also add some comments for visibility.

OK, I think it had to do with a config difference between prod and staging/localdev. By enabling error logging (log_threshold=1) on prod, I could see the following error logged multiple times:
ERROR - 2024-03-17 16:18:29 --> Severity: Warning --> Undefined array key "full_count" /librivox/www/librivox.org/catalog/application/controllers/catalog/Search.php 183

When I merged and pulled this PR, those stopped.

By enabling error logging (log_threshold=1) on prod, I could see the following error logged multiple times:

I see!  What I was seeing on localdev is that the page never switched to a new URL - it just stayed on whatever page you started the search from, which was why I couldn't just give an example.  With logging on, I suppose the server goes ahead and sends the AJAX response, instead of the HTML error message I was seeing.

That way, if you're proposing a PR that isn't ready yet, you can disapprove your own PR, and then change your approval once it's ready.

Sorry to put you to the extra trouble, but this sounds good.  I don't do anything like this at my day job, so having some guard rails that force me to be 100% clear and matching your expectations sounds like the way to go.


Update Python version to 3.5 in govuk_python module

This will install Python 3.5.2 on the CI agent machines and others
that include the govuk_python modules (such as mapit and ckan).
This is currently blocking some of our branches from building
successfully as they require Python 3.5 or later.
Trello card: https://trello.com/c/lR6qMIm1/1780-5-upgrade-to-a-supported-python-version

I assume this change means that python3 now points to python3.5 rather than python3.4.

I think you're imagining a world where we take software deployment seriously! I don't think Puppet will remove the python3 or python3-dev packages, but there is the potential for them not to be installed on new machines, so this could cause additional inconsistencies between machines in AWS. Also, I don't think this will have any effect on update-alternatives, so python3 will still point to python3.4, at least on the machines with python3 still installed, for new machines it might be python3.5.


Improve search functions

Closes #489, #156 and #13

Use fuzzy searching, pattern matching and description text searching to get better search matches
Fuzzy search gives better results and gives accurate rankings
Description searching allows you to search for concepts as well as crates, so serialization will also pull up results for serde (With any better name matches before it)
Also trimmed the string, so the leading/trailing whitespace thing ain't a thing

#708 brings up a good point, does the actual date a crate was published matter when we have semver?

I don't know how to sort by semver in SQL. I think we should wait on that until later, we're making a big change already.

Looks like you need to remove the migration to get the tests to pass: https://github.com/rust-lang/docs.rs/pull/721/checks?check_run_id=606111571#step:14:80

You need to rebase over the changes to CI. Additionally, you may need to write an extra (small) dockerfile to add the fuzzy-search extension to postgres, see https://stackoverflow.com/a/54630526/7669110 for an example of what that would look like.
Past that, the current blocker is the performance of the query. The old query took less than half a second, this one takes almost 3. We've been working on this in Discord.

Got a much-improved query in, had to remove description searching, as with it the query took 700-800ms, while without it the query takes a consistent 300ms

:tada: :tada: :tada:


[SPARK-17949][SQL] A JVM object based aggregate operator

What changes were proposed in this pull request?
This PR adds a new hash-based aggregate operator named ObjectHashAggregateExec that supports TypedImperativeAggregate, which may use arbitrary Java objects as aggregation states. Please refer to the design doc attached in SPARK-17949 for more details about it.
The major benefit of this operator is better performance when evaluating TypedImperativeAggregate functions, especially when there are relatively few distinct groups. Functions like Hive UDAFs, collect_list, and collect_set may also benefit from this after being migrated to TypedImperativeAggregate.
The following feature flag is introduced to enable or disable the new aggregate operator:

Name: spark.sql.execution.useObjectHashAggregateExec
Default value: true

We can also configure the fallback threshold using the following SQL operation:

Name: spark.sql.objectHashAggregate.sortBased.fallbackThreshold

Default value: 128
Fallback to sort-based aggregation when more than 128 distinct groups are accumulated in the aggregation hash map. This number is intentionally made small to avoid GC problems since aggregation buffers of this operator may contain arbitrary Java objects.
This may be improved by implementing size tracking for this operator, but that can be done in a separate PR.

Code generation and size tracking are planned to be implemented in follow-up PRs.
Benchmark results
ObjectHashAggregateExec vs SortAggregateExec
The first benchmark compares ObjectHashAggregateExec and SortAggregateExec by evaluating typed_count, a testing TypedImperativeAggregate version of the SQL count function.
Java HotSpot(TM) 64-Bit Server VM 1.8.0_92-b14 on Mac OS X 10.10.5
Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz

object agg v.s. sort agg:                Best/Avg Time(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------
sort agg w/ group by                        31251 / 31908          3.4         298.0       1.0X
object agg w/ group by w/o fallback           6903 / 7141         15.2          65.8       4.5X
object agg w/ group by w/ fallback          20945 / 21613          5.0         199.7       1.5X
sort agg w/o group by                         4734 / 5463         22.1          45.2       6.6X
object agg w/o group by w/o fallback          4310 / 4529         24.3          41.1       7.3X

The next benchmark compares ObjectHashAggregateExec and SortAggregateExec by evaluating the Spark native version of percentile_approx.
Note that percentile_approx is so heavy an aggregate function that the bottleneck of the benchmark is evaluating the aggregate function itself rather than the aggregate operator since I couldn't run a large scale benchmark on my laptop. That's why the results are so close and looks counter-intuitive (aggregation with grouping is even faster than that aggregation without grouping).
Java HotSpot(TM) 64-Bit Server VM 1.8.0_92-b14 on Mac OS X 10.10.5
Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz

object agg v.s. sort agg:                Best/Avg Time(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------
sort agg w/ group by                          3418 / 3530          0.6        1630.0       1.0X
object agg w/ group by w/o fallback           3210 / 3314          0.7        1530.7       1.1X
object agg w/ group by w/ fallback            3419 / 3511          0.6        1630.1       1.0X
sort agg w/o group by                         4336 / 4499          0.5        2067.3       0.8X
object agg w/o group by w/o fallback          4271 / 4372          0.5        2036.7       0.8X

Hive UDAF vs Spark AF
This benchmark compares the following two kinds of aggregate functions:

"hive udaf": Hive implementation of percentile_approx, without partial aggregation supports, evaluated using SortAggregateExec.
"spark af": Spark native implementation of percentile_approx, with partial aggregation support, evaluated using ObjectHashAggregateExec

The performance differences are mostly due to faster implementation and partial aggregation support in the Spark native version of percentile_approx.
This benchmark basically shows the performance differences between the worst case, where an aggregate function without partial aggregation support is evaluated using SortAggregateExec, and the best case, where a TypedImperativeAggregate with partial aggregation support is evaluated using ObjectHashAggregateExec.
Java HotSpot(TM) 64-Bit Server VM 1.8.0_92-b14 on Mac OS X 10.10.5
Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz

hive udaf vs spark af:                   Best/Avg Time(ms)    Rate(M/s)   Per Row(ns)   Relative
------------------------------------------------------------------------------------------------
hive udaf w/o group by                        5326 / 5408          0.0       81264.2       1.0X
spark af w/o group by                           93 /  111          0.7        1415.6      57.4X
hive udaf w/ group by                         3804 / 3946          0.0       58050.1       1.4X
spark af w/ group by w/o fallback               71 /   90          0.9        1085.7      74.8X
spark af w/ group by w/ fallback                98 /  111          0.7        1501.6      54.1X

Real world benchmark
We also did a relatively large benchmark using a real world query involving percentile_approx:

Hive UDAF implementation, sort-based aggregation, w/o partial aggregation support
24.77 minutes

Native implementation, sort-based aggregation, w/ partial aggregation support
4.64 minutes

Native implementation, object hash aggregator, w/ partial aggregation support
1.80 minutes

How was this patch tested?
New unit tests and randomized test cases are added in ObjectAggregateFunctionSuite.

Can you change the tile to "JVM object" rather than "Java object"?

Test build #67356 has finished for PR 15590 at commit c8ec18b.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class ObjectAggregationIterator(
class SortBasedAggregationStore(
class ObjectAggregationMap()
class AggregationBufferEntry(var groupingKey: UnsafeRow, var aggregationBuffer: InternalRow)
case class ObjectHashAggregateExec(

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67356/
Test PASSed.

Merged build finished. Test PASSed.

BTW overall this patch is really well written!

This is pretty cool.
I was wondering how much code this shares with the regular hash based aggregation path? And if it is worth the effort to integrate the two paths? We can do this in a follow-up if you will.

Test build #67466 has started for PR 15590 at commit 17117d6.

Test build #67466 has finished for PR 15590 at commit 17117d6.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class SortBasedAggregator(

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67466/
Test PASSed.

lgtm1

@hvanhovell That's a great point.
This is actually one of my pain points while writing this new operator. These problems are:

HashAggregateExec and SortAggregateExec have some similar code paths like merging multiple external sorters but can't really share the same code.
While prototyping ObjectHashAggregateExec, the behavior of the first version of the operator was more consistent with HashAggregateExec, which still fed the rest input rows into new hash maps after falling back to sort-based aggregation. However, I found it's still quite hard to reuse any code paths beside AggregationIterator. Mostly because HashAggregateExec is highly specialized to the unsafe format.

The fallback logic of the current version is more consistent with SortAggregateExec, which no longer builds any other hash maps. I think it's possible to unify this part of code paths with SortAggregateExec. I'd like to do this in a follow-up PR.

Test build #67997 has started for PR 15590 at commit 254a400.

Test build #67997 has finished for PR 15590 at commit 254a400.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
class SortBasedAggregator(

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67997/
Test PASSed.

Merged build finished. Test PASSed.

LGTM. Merging to master.

The fallback strategy is actually the "pure external sorter" approach, right? (https://github.com/apache/spark/blob/41439fd52dd263b9f7d92e608f027f193f461777/sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/ObjectAggregationIterator.scala#L181)
The design doc in the JIRA indicated the hashmap + externalSorter one


⚠ ZV800.com has degraded performance

In f494f5b, ZV800.com (https://www.zv800.com/) experienced degraded performance:

HTTP code: 200
Response time: 1092 ms

Resolved: ZV800.com performance has improved in 87c620d after 108 days, 8 hours, 7 minutes.


Implement Empty operation in libnd4j and nd4j

Empty op constructor should have arguments:

shape
init - boolean
It should should operate identically to Nd4j.create vs. Nd4j.createUninitialized, depending on whether init arg is true/false.

there should be dtype argument as well.
and what init option does?

I mean: in case of empty array - there's no buffer - hence nothing to initialize

It's "numpy" empty, not ND4J "empty"
https://docs.scipy.org/doc/numpy/reference/generated/numpy.empty.html

It should should operate identically to Nd4j.create vs. Nd4j.createUninitialized, depending on whether init arg is true/false.

^ This is what we need.
We should probably call it something else to avoid confusion though, "Empty" op is what TF calls it

Or equivalent to fill op, but options are 0 vs. uninitialized
for uninitialized case, exec should be a no-op

Implemented.


[INLONG-7959][Sort] Dynamic schema evolution support delete and update columns when sink to Iceberg

Fixes: #7959

I accidentally deleted the original PR https://github.com/apache/inlong/pull/8095 by mistake, so I resubmitted it.
For details, see this PR https://github.com/apache/inlong/pull/8095

@dockerzhang

The idea of this PR is mainly provided by @sparklezzz, I am mainly responsible for practice and testing, thanks to @sparklezzz

How is column reorder handled? Throw unsupport exception?  @hejiay @thexiay


query_predict failing

./query_predict /tmp/starspace/models/wikipedia_sentence_match.tsv k  /tmp/starspace/data/wikipedia_test_basedocs_tm3.txt
Start to load a trained embedding model in tsv format.
Loading dict from model file : /tmp/starspace/models/wikipedia_sentence_match.tsv
Number of words in dictionary:  267523
Number of labels in dictionary: 0
Loading model from file /tmp/starspace/models/wikipedia_sentence_match.tsv
Model loaded.
Loading base docs from file : /tmp/starspace/data/wikipedia_test_basedocs_tm3.txt
Finished loading 10000 base docs.
Enter some text: 'hello'
Enter some text:
There is no result of either labels/documents on trying to do query_predict with sentence model (from the example). Could any one help me understand why so ? and also help me understand the need for basedocs file ?

@firesting Thanks for reporting. I think you need to remove the '' from 'hello' when you input the text. In addition basedoc argument is not needed for ./query_predict I believe.

Closing the issue as there's no recent update.