Compute regression-line coefficients for joint-read-depth-histogram

My thought would be to focus pageant only on spark analyses that take BAMs and write out something like a csv file with the results, and avoid dealing with the inevitable huge long tail of plots people will want to generate from this data.
My most common scenario for looking at plots is when I'm already running ipython notebook, where I can easily generate the plot myself (and subsequent analyses like regression lines). It's pretty rare in my experience to want to just generate a pdf plot with a script without wanting to manipulate the data and the plot myself in python in some way.
For nontrivial plotting tasks that we want to make reusable, the "genomisc" module I put up might be one place to put it: https://github.com/timodonnell/genomisc . But for things like scatter plots with regression lines, unless we're doing something clever, I'm not sure it necessitates a library function.

That makes sense. I think there's some experimenting that's worth doing re: where to draw the line between Spark and matplotlib, and for a few simple things like this we can probably try both while we develop a feel for it.
Computing the two parameters of the regression line is a one/two-liner in Spark (I did a close relative of that calculation in a spark-shell yesterday in a couple of seconds on the millions of data points in the two samples I'm currently comparing); if there's an easy way to throw that result over the wall to matplotlib, and have one less pass over millions of data on my laptop, that might make more sense. I don't know enough matplotlib to know whether that is possible / how amenable it might be to allowing us to plug variously-precomputed aspects of our plots in to it, so that's something I need to investigate / would love to hear thoughts on. I am not trying to write my own plotting code, just tell matplotlib a slope+intercept rather than have it arduously/inefficiently recompute numbers I already know.
My current thinking on an ideal to move toward is a notebook setup where we can write Scala/Python-Spark commands and consume/plot the results in non-spark Python. IIUC the spirit of your concern is that we shouldn't waste effort duplicating plot logic, and I definitely agree with that, I just also think we should not blow up our iteration times by having matplotlib do O(n) passes over the data on our laptops more than we have to (that is where my initial work on pageant stalled out), and I want to explore the space between those two constraints a little bit.
Let me know what you think!

Gotcha, thanks. I agree that agree that if matplotlib is the slow step something is going wrong, and we'll need to experiment to find the right specification for each analysis so the output has the data we need while still being easily analyzed interactively.
For the specific case of the read depth histogram, probably the csv output should be binned counts (it's a histogram, after all). So for a 2d histogram with a bin width of 10 and max bin 1000, we would have a count for how many loci have e.g. sample1_depth between [0,10) and sample2_depth between [30, 40), and so on for all pairs of bins 0-10, 10-20, 20-30, ... 990-1000 (might want to have a bin for >1000 too). That would give us (1000/10)^2 = 10,000 counts, which would be a very manageable dataset to analyze interactively in ipython, including computing a best fit line.
The idea to do interactive analyses in Spark sounds interesting. On one hand it feels really strange to have the whole cluster allocated and waiting on me to type keys (is that how it works?), but if we can get that kind of thing sorted out, sounds like could be a much more flexible environment.

agreed that binning/downsampling will likely be two key pillars of whatever gross+emergent CSV-serde-or-equivalent API develops here between Spark and matplotlib.
IIRC from running the #'s yesterday, these 2 BAMs' joint-hist was about 20,000 x 20,000 with 3.5MM non-zero locations, every square in [0,1000) x [0,1000), and presumably further out, was non-zero.

restricting to exons / capture-targeted areas (per #2) will likely help this a lot, though comparing these shapes for {all, exons, non-exons} would also be interesting and is something I'd like to do.
It's not obvious to me what the bin sizes should be; at the very least log-scaled bins seem like they'd make more sense than fixed-width. In the limit I can imagine some other variable-sized binning that might further tease out some structure to the data, so there's some questions I'd like to answer there, presumably involving analysis more in Spark than in matplotlib. Again, I definitely agree that this is stuff that pageant should do in Spark-land before feeding a plot-data-model to MPL.

re: interactive spark analyses, that's what I've been doing with Spark shells, and it's true that hogging many resources for it can be clumsy. However:

if I only do it when I'm actually running analyses (and don't leave them sitting around idle, which I have done), then I don't think it's much/any worse than spark-submiting the equivalent job; for pageant today I mostly run one command in my spark-shell that runs ~20 jobs to compute the thing I then want to interactively analyze.
More importantly, Spark has dynamic executor allocation which should make this all free/ideal. I'm going to try to get that working today and will lyk how it goes.

Cool, interested how the dynamic executor stuff goes.
I'd stick with fixed sized bins plus an overflow bin (with the bin width and number of bins an arguments of course). Restricting to exon capture will be very useful too.


[Material UI Chip] onHover DeleteIcon Css Overloading Issue

I was working on a tag editor component using material UI chips. I came across a CSS overloading issue that is hard to debug. Can anyone point out the mistake?

The issue with the chip delete icon is, whenever I hover over the last chip i.e, chip da in the current image of Media 1, it expands and pushes the chip down and up continuously making the Dom unresponsive and unable to select.
Tag Editor Image
CSS for chips:
  textTypography: {
    margin: theme.spacing(1),
    display: "inline-block",
  },
  chip: {
    margin: theme.spacing(0.3),
    width: "auto",
    "& .MuiChip-deleteIcon": {
      display: "none",
    },
    "&:hover": {
      "& .MuiChip-deleteIcon": {
        margin: theme.spacing(0.2),
        padding: theme.spacing(0.3),
        display: "inline-block",
      },
      cursor: "pointer",
      backgroundColor: darken(
        theme.palette.primary.main,
        theme.palette.action.hoverOpacity * 5,
      ),
    },
  },

Chip Component

  const renderChips = () => (
    <div>
      {state.tags
        .map((tag, i) => (
          <Box component="span" key={`${i}`}>
            <Chip
              className={classes.chip}
              label={tag}
              size="small"
              color="primary"
              onDelete={(e) => handleDeleteEvent(e, i)}
              onMouseDown={(e) => e.preventDefault()}
            />
          </Box>
        ))}
      {!state.edit && (
      <Typography
        variant="body2"
        className={classes.textTypography}
        color="textSecondary"
        component="span"
        onClick={action(() => {
          state.edit = true;
          inputRef?.current?.focus();
        })}
      >
        Add a tag
      </Typography>
      )}
    </div>
  );

@BradPrit09 can you please provide a minimal reproduction that we can look into? Sharing a codesandbox would be the best.

@mnajdova  I will build one and update it in a while.

@BradPrit09 can you please provide a minimal reproduction that we can look into? Sharing a codesandbox would be the best.

@BradPrit09 can you please provide a minimal reproduction that we can look into? Sharing a code sandbox would be the best.

@mnajdova Here is the  sample
https://codesandbox.io/s/material-ui-chip-with-delete-icon-on-hover-zsjee?file=/demo.js
STEP 1: Reduce the Project Runtime View Size
STEP 2: Try to select polym in the second row.
Image to Verify the sizes.

I see, the problem is how you designed the chips, you are showing/hiding the delete icon on hover, so the width is changing. I don't see any problem with the component itself. I'd propose you just change the visibility instead, or specify bigger width of the chips so that when adding the delete icon it won't affect the width.


Add test cases for C-CDA to FHIR service

Add test cases for C-CDA to FHIR service
Related Issue: https://github.com/wso2-enterprise/open-healthcare/issues/1470

Merging of this PR should wait until a patch is released for ccda-to-fhir package with https://github.com/ballerina-platform/module-ballerinax-health.fhir.r4/pull/236


Make menu z-index configurable on the fly

Moodle uses Mathjax to render the Tex equations, but the menus for the equation preview in our equation editor dialogue appear behind the dialogue because we can't specify a z-Index for the menu.

How could this be accomplished in Version 3.2.2?

@Remich, try
<style>
CtxtMenu_MenuFrame {
  z-index: 1000 ! important;
}

and see if that works.

I already tried this:
.CtxtMenu_MenuFrame { 	z-index: 1000 !important; }
But it does not work.
I am loading the math that i want to render via an ajax call into the modal, then i call window.MathJax.typeset().
Setting the z-index of CtxtMenu_MenuFrame in the developer tools gives the desired result.

Does the develop tools show the .CtxMenu_MenuFrame rule as being overridden when the frame is being selected?  Or does that rule not show up for it?  If it doesn't show up, then it may be that the style is not being loaded properly.
If you add this rule by hand in the develop console CSS inspector (usually using a "+" or "add rule" button somewhere), does it work?

It turns out that a z-index of 1000 is not enough.
Somehow I missed that the z-index of the bootstrap modal is alreay 1050.
Using 1100 works as expected.
Thanks for your quick help.

Great!  Glad that you got it worked out.


Weather issue fixes

This should fix issue 1 in #86

The old applySDM() function is still used if include_climate is True. So trying to display the climate indices plot with climate projections results in NameError: Name 'applySDM' is not defined. The plot is shown when include_climate is set to False, but I think it still shows a matplotlib figure.
https://github.com/hydrocode-de/RUINSapp/blob/b17d5d736508de6bdb0e8010b97e79d49b055591/ruins/apps/weather.py#L157

Sorry, I got confused with the PRs, the climate indices plot is what #90 is about.

This PR can be closed, as its changes are also included in #90


Cannot stream in landscape..

I have set the settings to portrait only in deployment info, but not when i set the outputImageOrientation to .LandscapeLeft, when the phone is in portrait, the video on the iphone screen is rotated 90 degrees clockwise, however the data that is sent to the stream is portrait. WHen i rotate my phone landscape left, the data that is sent to the rtmp stream is also in landscape which is what I want however, the video on my phone is rotated 90 degrees clockwise. how do i fix this error? I want my iphone to display wahtever is being sent to the RTMP server..

@rinfosho Hello
Have you been able to solve this problem? I used Accelerate and vImage (vImage_Buffer) to rotate pixelBuffer, but a extension app has too little RAM for such operations.
As far as I know, you need to set the video orientation parameter so that the RTMP service player itself rotates the video in the right direction. You have no information about this?

Was there any resolution to this? having the same problem


Update to version 2.5.1

It would be nice to update to version 2.5.1. libmpdec++ has changed the exception hierarchy in order to ensure a nothrow copy constructor. As a result, both libmpdec and libmpdec++ have had an soversion increment.
https://www.bytereef.org/mpdecimal/changelog.html
It might also be worthwhile to change the URLs, which now  use https.
In case people use the package to build Python: mpdecimal-2.5.1 is compatible with recent Python versions,
except that these build patches are required:
Python 3.8, Python 3.9: https://www.bytereef.org/contrib/decimal.diff
Python 3.7: https://www.bytereef.org/contrib/decimal-3.7.diff
Debian Bullseye, Arch Linux, Alpine Linux etc. also carry these patches.

Thank you @skrah for the notice of the new release. I'll update the wrap ASAP.

Hello @skrah It took more than a year, but I finally found the time to upgrade the meson wrap to mpdecimal release 2.5.1 (this happened in the new combined wrapd repository and not here). Linux, macOS, and Widows build correctly and pass the unit tests. I don't have easy access to other systems to verify the build definition. AIX may work with gcc, but Meson does not yet have support for xlc.


statistics.StatisticsError: mean requires at least one data point

When I ran the code, I found this problem, and the error message was as follows:
File "/public/home/ScarMapper/scarmapper.py", line 225, in main
indel_processing.main_loop()
File "/public/home/ScarMapper/scarmapper/INDEL_Processing.py", line 801, in main_loop
indexed_read_count, lower_limit = self.consensus_demultiplex()
File "/public/home/ScarMapper/scarmapper/INDEL_Processing.py", line 778, in consensus_demultiplex
lower, upper_limit = stats.norm.interval(0.9, loc=statistics.mean(key_counts), scale=stats.sem(key_counts))
File "/public/home/miniconda3/envs/py36/lib/python3.6/statistics.py", line 311, in mean
raise StatisticsError('mean requires at least one data point')
statistics.StatisticsError: mean requires at least one data point

Hopefully this fixed it.  I flipped the slicing for doing the index match.  You only need to download the INDEL_Processing.py file.

thanks very much，now it has successfully run


Concrete Strength Calculation

Issue Title : Concrete Strength Calculation

Info about the related issue (Aim of the project)

Calculate the strength of the concrete using Machine Learning techniques.

[x] SWOC Participant

[ ] JWOC Participant

[ ] Contributor

Name: Sankalp Srivastava

GitHub ID: github.com/sankalp-srivastava

(Mention these details are must)
Closes: #96
Describe the add-ons or changes you've made
done eda and created 5 models and made predicitons. Also done parameter tuning of xgboost.
Type of change
What sort of change have you made:

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Code style update (formatting, local variables)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Describe how it has been tested
Describe how have you verified the changes made
Checklist:

[x] My code follows the guidelines of this project.
[x] I have performed a self-review of my own code.
[x] I have commented my code, particularly wherever it was hard to understand.
[x] I have made corresponding changes to the documentation.
[x] My changes generate no new warnings.
[x] I have added things that prove my fix is effective or that my feature works.
[x] Any dependent changes have been merged and published in downstream modules.

@abhisheks008 Now the problem is fixed. Had to reset back and commit again

Dataset folder is missing buddy @sankalp-srivastava

Th folder is now added. I think I missed to add the folder in git tracking

LGTM! Your PR is merged and approved @sankalp-srivastava


Need a cdn for css ,like bootstrap

We need a feature like bootstrap for getting all the css class

Duplicate of #16543.


PROD-9593 Enable GHAS on SciProd Repos

Can't be done - https://jira.internal.dnanexus.com/browse/APPS-1865
Spoke with GH support and unfortunately looks like this isn't going to work
GH's response:
"Unfortunately, no. CodeQL hooks into the Java compiler to do the extraction. It cannot get the information it needs without a compiler that starts with Java source."


feat: add custom openai api endpoint

If you can't access the OpenAI API directly (due to firewall or other issues), you can use it.
And you can custom OpenAI API endpoint to set OPENAI_API_ENDPOINT （default: https://api.openai.com/v1）
ai-shell config set OPENAI_API_ENDPOINT=<your proxy endpoint>

This is great! Can you add it to the new config UI as well? https://github.com/BuilderIO/ai-shell/blob/main/src/helpers/config.ts#L105-L134

looks great! we've just got a merge conflict now, then ready to merge

Hi @steve8708,
With Azure OpenAI endpoint, I got this error '✖ Invalid config property OPENAI_KEY: Must start with "sk-"', probably you need to change the logic here . Can you please take a look at it? Thanks!

oh, they handle different keys too, I'll go back and reopen your issue, as it sounds like the scope of this is larger than first thought
I would had to remove the validation of openai keys, I gues an alternative is if you use azure (e.g. detecting an azure url configured) we add different logic for validating keys (or remove the validation)
interested in sending a PR @lzhgus?

@steve8708 , I raised the PR to remove the restriction that require OPENAI_KEY to start with 'SK'. This is because we cannot determine whether the proxy endpoint is for Azure or OpenAI without introducing another configuration setting such as "USEAZURE: boolean". Therefore, I believe it would be better to remove the validation of openai keys. Please review. Thanks!


Procfile for deployment on heroku?

Hello, I'm trying to deploy this on heroku but it needs a procfile and i can't figure it out :(

I don't know heroku at all, but I'm definitely willing to help figure this
out, and wouldn't mind adding the files needed into my repository.
On Sat, Mar 11, 2017 at 4:30 AM Bewinxed<EMAIL_ADDRESS>wrote:

Hello, I'm trying to deploy this on heroku but it needs a procfile and i
can't figure it out :(
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/freiheit/discord_feedbot/issues/51, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AABNZVn5ynYBgD2FXNfbhQjXRWafgvAJks5rkpPwgaJpZM4MaMPC
.

Please try out what I have on the heroku branch now. And let me know how it goes.
You can use  git checkout --track origin/heroku to switch to it.

I was able to push it to Heroku (A platform for hosting code online in multiple languages)
It built and pushed, now i checked the logs and it keeps crashing and giving the following
State changed from crashed to starting Starting process with command python feed2discord.py State changed from starting to up Process exited with status 0 WARNING:discord.client:PyNaCl is not installed, voice will NOT be supported INFO:__main__:ednews: Starting up background_check_feed INFO:__main__:discordreddit: Starting up background_check_feed INFO:__main__:galnet: Starting up background_check_feed INFO:__main__:gazelle: Starting up background_check_feed sys:1: ResourceWarning: unclosed <socket.socket fd=8, family=AddressFamily.AF_INET, type=2049, proto=6, laddr=('<IP_ADDRESS>', 40021), raddr=('<IP_ADDRESS>', 443)> /app/.heroku/python/lib/python3.6/asyncio/selector_events.py:631: ResourceWarning: unclosed transport <_SelectorSocketTransport fd=8> source=self) /app/.heroku/python/lib/python3.6/site-packages/aiohttp/client.py:88: ResourceWarning: Unclosed client session <aiohttp.client.ClientSession object at 0x7f75608ffdd8> ERROR:asyncio:Unclosed client session client_session: <aiohttp.client.ClientSession object at 0x7f75608ffdd8> ERROR:asyncio:Task was destroyed but it is pending! task: <Task pending coro=<background_check_feed() running at feed2discord.py:360> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f7560855708>()]>> ERROR:asyncio:Task was destroyed but it is pending! task: <Task pending coro=<background_check_feed() running at feed2discord.py:360> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f7560855768>()]>> ERROR:asyncio:Task was destroyed but it is pending! task: <Task pending coro=<background_check_feed() running at feed2discord.py:360> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f7560855858>()]>> ERROR:asyncio:Task was destroyed but it is pending! task: <Task pending coro=<background_check_feed() running at feed2discord.py:360> wait_for=<Future pending cb=[<TaskWakeupMethWrapper object at 0x7f75608558b8>()]>> State changed from up to crashed

I'm using this RSS feed http://feeds.feedburner.com/surrenderat20/CqWw

The output looks like it's using the example .ini file, not yours...
Copy feed2discord.ini to feed2discord.local.ini, make sure the only feed and room in there is what you want, and make sure your bot's auth token is in there.

I have already added my changes in the local.ini thing, i think i should've deleted the first one and the example one and left the local one :)
After lots of tampering i found that the async error was because i didn't reference the correct channel in the feed (only one channel named "one" but the feed was set to "two" and that threw the error.
And for some reason git kept ignoring the local ini from pushing it to the heroku git! freaky!
i'm inexperience with git but i figured it out, now it seems to be running =) is there a way to test the rss without waiting for new posts?

Shouldn't need to delete the original .ini file; if the bot finds a .local.ini file it will prefer that.
There's a line in .gitignore that causes the .local.ini file to be ignored, because I'm trying to discourage people from pushing their bot's login credentials into public git repositories.
Since this seems to have worked, I've merged this into the main code, so you can switch the the "master" branch.
No way to send any test commands to the bot right now. This bot is purely write-only and doesn't read anything in any rooms or listen to any commands. You can set start_skew to 1 and restart the bot to get it to immediately process a feed.
I'd have to see more details about the show_all_entries.py problem. Try python3 show_all_entries.py http://...


[Bug]: Python Streaming Combine load tests on Dataflow are timing out

What happened?
https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/700/
These tests are being aborted after 2 hours.
Issue Priority
Priority: 1
Issue Component
Component: build-system

These were failing for a while due to #22422, now that that's been resolved they've gone back to their previous state: timing out.

@tvalentyn is it possible there's a bug that's causing these jobs to hang? Or is it more likely that we actually just need to bump the timeout?

it is possible, i'd look at earlier runtime and consider bisection

Ack, I'll look into bisecting. Unfortunately the last passing run still in Jenkins history is in September 2020. That one took 54 minutes: https://ci-beam.apache.org/job/beam_LoadTests_Python_Combine_Dataflow_Streaming/30/

ok, that's way too long ago to block the release.

Yeah, I suppose it's possible that there was a passing run since then that was deleted, but IIUC Jenkins tries to keep the log for the last successful run indefinitely.

Sending #22436 to bump the timeout and get these running again. The possible regression can be investigated separately.


rework ModelMethodOrder linter

fixes #162
The linter now also knows the booting() and booted() methods and can differentiate relationship and custom methods by return type.
The description now also contains an explicit listing of all model methods with the matched type and ordered similar to what the linter expects.

@Gummibeer I'll exercise this branch on some codebases and try to get it merged/released Friday, thank you so much for the contribution!

I think the best change is that thee linter tells the user how each method is detected and also an optional sorting. If I would find a way to move whole methods with everything related it would even be possible to add a fixer. 🤔


Better prevention of context menu (mostly Firefox)

Also noting here that on Chrome, if you hold shift, the scroll becomes a horizontal scroll. In apps that don't care about the direction of scrolling you can simply do scroll = ev.vscroll or ev.hscroll.

This breaks checkboxes and radiobuttons (because they need that default action ... PR coming.


Unable to deploy Articulate in Google Cloud. Error: HNS service is not started due to invalid parameter

I am trying to install on google cloud but getting error for the command "docker-compose up" as "alpha-nlu-network" parameter is not correct. HNS service is not started due to invalid parameter. As per the documentation i have changed the localhost with the public vm ip. I have done the changes for Api_url, Swagger_host and docker_instance. Please advice.

Hi @amritapcs would you mind to answers this questions please to help you out
Please describe the issue you are having here and answer the question below.

Did you download a release or pull from Master? Which release?
What operating system are you running?
Are you running locally or in the cloud?
Which browser are you using?

Pl see my revert below in red .Appreciate your quick revert.
Regards
Amrita Anand
On Sun, Jun 17, 2018 at 1:26 PM, Daniel Calvo Marin <
<EMAIL_ADDRESS>wrote:

Hi @amritapcs https://github.com/amritapcs would you mind to answers
this questions please to help you out
Please describe the issue you are having here and answer the question
below.

Did you download a release or pull from Master? Which release?
     Yes,Pull from master.Version 3.0

What operating system are you running?
   Windows server 2016

Are you running locally or in the cloud?
     Google Cloud

Which browser are you using?
     Chrome

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/samtecspg/articulate/issues/249#issuecomment-397861742,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AY7xNfDn345fZpVIdsWCLbboSRbWxT1tks5t9gu8gaJpZM4UqvJU
.

Thanks for your answers. So are you running docker on windows? Right?

Yes.
Regards
Amrita Anand
On Sun, Jun 17, 2018 at 7:16 PM, Daniel Calvo Marin <
<EMAIL_ADDRESS>wrote:

Thanks for your answers. So are you running docker on windows? Right?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/samtecspg/articulate/issues/249#issuecomment-397880112,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AY7xNRh_8PqCtslIFmkon91LIvtKNJDHks5t9l2kgaJpZM4UqvJU
.

By looking on docker issues it seems it could be related with an issue. Could you check if you are able to update your docker?

By the way, Master branch is our working space, so it isn't stable. We recommend you to use our latest release and follow the cloud installation instructions

Daniel,
I tried as suggested still getting error after running docker-compose up.
Regards
Amrita Anand
On Mon, Jun 18, 2018 at 12:07 AM, Daniel Calvo Marin <
<EMAIL_ADDRESS>wrote:

By the way, Master branch is our working space, so it isn't stable. We
recommend you to use our latest release
https://github.com/samtecspg/articulate/releases/tag/v0.9.4 and follow
the cloud installation instructions
https://samtecspg.github.io/articulate/getting_started/cloud-installation
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/samtecspg/articulate/issues/249#issuecomment-397897767,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AY7xNVpAZzzfV5Nnok66r9vLM80Q5aXoks5t9qHjgaJpZM4UqvJU
.

@amritapcs can I get the exact error message. Copy paste/screenshot?

Pl find the attached error as well as revised docker-compose.yml file and
env file
Regards
Amrita Anand
On Mon, Jun 18, 2018 at 8:17 AM, Caleb M. Keller<EMAIL_ADDRESS>wrote:

@amritapcs https://github.com/amritapcs can I get the exact error
message. Copy paste/screenshot?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/samtecspg/articulate/issues/249#issuecomment-397929161,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AY7xNXPGmzT34VbDoVpic5WUKZ87EkLvks5t9xTZgaJpZM4UqvJU
.

@amritapcs Given that you are directly answering the emails from GitHub we aren't able to see the files you attached. Could you please attach them by firstly accessing into this link https://github.com/samtecspg/articulate/issues/249 and then attaching the files in a new comment

Pl check the attached file.
articulate_error.docx

After reviewing your document I confirmed this is totally related with your docker set up in your windows machine.
You can get information about your particular error here:
https://github.com/docker/compose/issues/4024
https://github.com/docker/for-win/issues/598
https://github.com/docker/compose/issues/4149
The most common fix seems to be this one, taked from stackoverflow:
This is a known limitation. At present windows only supports one NAT network. Removing Netnat by invoke Remove-Netnat is not supported.
Run this in powesrhell.
Get-NetNat | Remove-NetNat

@amritapcs let us know if that solves your issue. If not, do you have the option of creating a linux VM on GCS?

Hi,
Thanks for you suggestion.
I have successfully install articulate on ubuntu VM. Now I want to check to
the code and want to customize as per my requirement. Can you please guide
me where I will get those file.
Thanks
Amrita
Regards
Amrita Anand
On Tue, Jun 19, 2018 at 7:23 AM, Caleb M. Keller<EMAIL_ADDRESS>wrote:

@amritapcs https://github.com/amritapcs let us know if that solves your
issue. If not, do you have the option of creating a linux VM on GCS?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/samtecspg/articulate/issues/249#issuecomment-398249166,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AY7xNfpXgVRJOdfl-DCwLrNVx6z90mCxks5t-FmSgaJpZM4UqvJU
.

Our défaut releases don't include the code, just a compose file and some config files.
If you want to the code you'll want to git clone https://github.com/samtecspg/articulate.gitand you will have all of the source files!
Let us know if you run into any other problems.

Hi,
can we add a login page.
Thanks
Amrita
Regards
Amrita Anand
On Tue, Jun 19, 2018 at 5:19 PM, Caleb M. Keller<EMAIL_ADDRESS>wrote:

Our défaut releases don't include the code, just a compose file and some
config files.
If you want to the code you'll want to git clone
https://github.com/samtecspg/articulate.gitand you will have all of the
source files!
Let us know if you run into any other problems.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/samtecspg/articulate/issues/249#issuecomment-398371386,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AY7xNTGaE83mAq-fajj5XJ8rQb6DY6AQks5t-OVUgaJpZM4UqvJU
.

Amrita,
For a process to fronend articulate with a login, please see the link on Issue#162 (that also links to issue 22 which is about the (future) direct implimention of a login interface)

@amritapcs (forgot to paste link) I mean this issue https://github.com/samtecspg/articulate/issues/162

Based on @amritapcs comment I have successfully install articulate on ubuntu VM
We can close this issue.


409 error should display a better error message

Right now I see a "Could not create project: Unexpected response status 409". This is likely due to a workspace/slug name collision, so we could show a message to that effect. E.g., "Could not create project: / is already in use."

I just encountered this. There was a previous project with the same slug that was deleted. When I try and create a new project with that slug I get this error.
If we show a better error message, then we should keep in mind that the user may not see a project with that name in the workspace anymore (since the slug is occupied by a deleted project).
Alternatively we should allow the slug to be re-used.

Yes, we should allow the slug to be re-used.


Add group - Detroit, MI, USA

Please provide the following information to aid in adding your group to the directory:
Esssential

[https://www.meetup.com/Detroit-Free-Code-Camp-Meetup/] Group URL (Web address)
[Detroit] Town or City group is located in
[Michigan] State / County / Region
[United States] Country

Nice to have

[ ] Co-ordinates

If you have one

[ ] URL of Group Photo

@rayray3899 Do you have co-ordinates for this study group?


RoadLanes unexpectedly twist when a RoadSegment is rotated

RoadLanes twist when a RoadSegment is rotated. They should remain straight or, at least, the same as they were before the rotation. Here are some screenshots to demonstrate the problem.
In this screenshot, a 2x2 Road is added to an empty scene. "Draw Lanes Editor" is enabled. So, we see orange triangles depicting the RoadLanes and they are straight.

In this screenshot, the 2x2 Road has been rotated 45° and the RoadLanes are now twisted. They should be straight like they were in the first image.

Closing this issue as the fix was made by


Setup modelator on all methods

Before this PR, calling e.g. modelator::module::Apalache::parse would fail if crate::setup (which downloads the model checkers) hadn't been called before.
This PR addresses this issue by ensuring that crate::setup is called on all methods that need the model checkers.
This PR also canonicalizes the paths in the artifacts TlaFileand TlaConfigFile. This ensures that the directory of some tla_file can be correctly computed with
let mut tla_dir = tla_file.path().clone();
assert!(tla_dir.pop());

as we do e.g in modelator::module::Tla::generate_tests: https://github.com/informalsystems/modelator/blob/e3e859d70694d5c79ddd414f8668f4506157e608/modelator/src/module/tla/mod.rs#L69-L71

Nice changes, Vitor!
A step towards better usability & reliability.

Ping @andrey-kuprianov - shall this be merged?

@danwt  if you could merge main into the branch, and check that everything still works, that would be awesome!
This PR is from a long time ago, smth. might have changed already...

Closing as obsolete.


Add support for proxy

Include proxy parameter of requests.get in REST() class and consequently in Request()

Should be easy to implement. Maybe better in the Request constructer.
PR for this?

Am 11.05.2015 um 10:50 schrieb KotZer<EMAIL_ADDRESS>Include proxy parameter of requests.get in REST() class and consequently in Request()
—
Reply to this email directly or view it on GitHub.

You can already use a proxy by setting one of the environment variables
HTTP_PROXY or HTTPS_PROXY. This is a feature of 'requests'.
But exposing the optional 'proxies' parameter in pandasdmx is useful anyway.
Am 11.05.2015 um 10:50 schrieb KotZer:

Include proxy parameter of requests.get in REST() class and
consequently in Request()
—
Reply to this email directly or view it on GitHub
https://github.com/dr-leo/pandaSDMX/issues/13.

That's true, did not think about it...
You can even generalize it and expose all **kwargs parameter of 'requests'.
Anyway thanks for this nice module

Great idea! I've just committed that. Does this work for you?
Am 11.05.2015 um 22:21 schrieb KotZer:

That's true, did not think about it...
You can even generalize it and expose all **kwargs parameter of
'requests'.
Anyway thanks for this nice module
—
Reply to this email directly or view it on GitHub
https://github.com/dr-leo/pandaSDMX/issues/13#issuecomment-101036321.

Perfect thanks!


Release process blog

blog on our release process and what a release process that incorporates devops principles could look like

Agreed with Remys requested changes, though won't double up on requested changes. Approval pending Remys recommended changes.
I would also consider giving credit where credit is due. There are examples of automated processes, such as the cloud sandbox env. We could also give an (indirect) shoutout to those doing good work in this direction, to bring light and promote the direction this blog is proposing.

Absolutely I was having this discussion with @remyb2canada yesterday. Will give shout outs to several teams including Noc, interop, SE and CCOE

I agree with the above suggestions and I made some spelling changes. Overall great blog, it's headed in the right direction :)


[stable/grafana] use grafana-image-render

By default, does not use grafana-image-renderer
We need a solution for this. https://github.com/grafana/grafana-image-renderer/blob/master/docs/remote_rendering_using_docker.md
is a way for this.
But this docker needs a helm chart, and there is another question:
How can this pod (grafana-image-render pod) communicate with grafana pod?

I created my own helm chart for this. It would be great if the operator could be updated to allow us to deploy the image through the chart. For example:
renderImage:
  enabled: true
  repository: grafana/grafana-image-renderer
  tag: 1.0.7

Setting environment variables works for now:
grafana:
  env:
    GF_EXPLORE_ENABLED: true
    GF_RENDERING_SERVER_URL: http://grafana-image-renderer:8081/render
    GF_RENDERING_CALLBACK_URL: http://prometheus-operator-grafana/
    GF_LOG_FILTERS: rendering:debug

@rust84 Can you give the link?

Now that Grafana 7.0 removed build in image rendering, this seems even more important to move forward, so we can do it within our existing helm-based deployments.

In case someone else is stumbling across this and needs a quickfix with the current chart:
    extraContainers: |
      - name: renderer
        image: grafana/grafana-image-renderer:latest

    env:
      GF_RENDERING_SERVER_URL: http://localhost:8081/render
      GF_RENDERING_CALLBACK_URL: http://localhost:3000/

I think this is still a valid request and needed.

Let's move the issue to the grafana helm2-chart repo itself? Is it possible?

/remove-lifecycle stale

/reopen


Mutually Exclusive set and Required parameters doesn't work right.

If I have 4 parameters.  Two for A, and two for B.
A are optional... but if you use the B set, then BOTH are required.
I can't do this with the 1.9x release.  If I set the B set to Required, then it fails when passing A values, since the B set are still considered required, even though they are not part of the A set.

Hi Eric, this is the expected behavior both in 1.9x and 2.0 - you cannot have a required argument that is optional in some cases but not in others. For more complex argument validation you will have to perform some post-processing yourself.

Wouldn't it be sensible to assume that a set of required, mutually exclusive parameters mean that exactly one of them must be provided? Like below, where I'd like to accept either -c or -n. Not both. Not none
public class Options
{
    [Option('c', Required = true, SetName = "connection")]
    public string ConnectionString { get; set; }

    [Option('n', Required = true, SetName = "connection")]
    public string ConnectionStringName { get; set; }
}


create substrate-explorer grant application

Grant Application
This application is (select one):

[x] Speculative (use this by default)
[ ] an RFP response

This application is (select one):

[x] Public (fully)
[ ] Public with private finances

Abstract
A suitable substrate Explorer, with strong expansibility, easy construction, and easy interface.
The features to be implemented:

Connect substrate nodes and synchronize data in real time,Persist data with PostgreSQL(or Mysql).
Establish associations between the underlying data,and provides the GraphQL Query query interface.
Provides a WebSocket interface to the outside world based on GraphQL Subscription as a middleware.
Set up the module table, realize the optimization query of staking, treasury, council and other data

Checklist

[x] The grants document has been read and understood.
[x] The Google Form will be completed accurately. Note that the Google Form requires the pull request URL.
[x] Abstract (above) is succinct and complete.
[x] The application is being included into the correct directory: either 'targeted' or 'speculative'.
[x] The application includes a project description.
[x] The application includes all names of team members.
[x] The application includes a description of the team's experience.
[x] The application includes all necessary links (e.g. GitHub and LinkedIn)
[x] The "Development Roadmap" section in the application has a timeline of development ("milestones").
[x] The "Development Roadmap" section in the application has an estimate of funds required.
[x] The "Development Roadmap" section gives an indication of the team's long term plans.
[x] The "Development Roadmap" section includes documentation as a deliverable for at least one milestone.

Hi @puti94,
Thank you very much for your grant application. The grant committee team met yesterday and unfortunately decided to not go ahead with funding your grant.
The primary reason is that we already have quite a few quality block explorers, and your application did not make a convincing argument as to why the current solutions struggle with scalability, in contradistinction to the application's claim.
Naturally, you are welcome to reapply if you make changes that provide a more convincing argument for us to fund another block explorer, or if you have another project in mind.


Recipe compile error "uninitialized constant MysqlCookbook::Helpers" under Vagrant

Cookbook version
8.5.1
Chef-client version
13.7.16
Platform Details
Ubuntu 14.04 x86_64
Scenario:
Trying to setup project via Vagrant
Steps to Reproduce:
run "vagrant provision"
Expected Result:
Chef successfully completed.
Actual Result:
==> default: ================================================================================ ==> default: Recipe Compile Error in /var/chef/cache/cookbooks/mysql/libraries/provider_mysql_client.rb ==> default: ================================================================================ ==> default:  ==> default:  ==> default: NameError ==> default: --------- ==> default: uninitialized constant MysqlCookbook::Helpers ==> default:  ==> default:  ==> default: Cookbook Trace: ==> default: --------------- ==> default:   /var/chef/cache/cookbooks/mysql/libraries/provider_mysql_client.rb:7:in class:MysqlClient'
==> default:
==> default:   /var/chef/cache/cookbooks/mysql/libraries/provider_mysql_client.rb:6:in <class:Provider>' ==> default:  ==> default:   /var/chef/cache/cookbooks/mysql/libraries/provider_mysql_client.rb:5:in class:Chef'
==> default:
==> default:   /var/chef/cache/cookbooks/mysql/libraries/provider_mysql_client.rb:4:in `<top (required)>'
==> default:
==> default:
==> default: Relevant File Content:
==> default: ----------------------
==> default: /var/chef/cache/cookbooks/mysql/libraries/provider_mysql_client.rb:
==> default:
==> default:
==> default:
==> default:   1:  require 'chef/provider/lwrp_base'
==> default:
==> default:   2:  require_relative 'helpers'
==> default:
==> default:   3:
==> default:
==> default:   4:  class Chef
==> default:
==> default:   5:    class Provider
==> default:
==> default:   6:      class MysqlClient < Chef::Provider::LWRPBase
==> default:
==> default:   7>>       include MysqlCookbook::Helpers
==> default:
==> default:   8:
==> default:
==> default:   9:        use_inline_resources if defined?(use_inline_resources)
==> default:
==> default:  10:
==> default:
==> default:  11:        def whyrun_supported?
==> default:
==> default:  12:          true
==> default:
==> default:  13:        end
==> default:
==> default:  14:
==> default:
==> default:  15:        action :create do
==> default:
==> default:  16:          # From helpers.rb
==> default:
==> default:
==> default:
==> default: System Info:
==> default: ------------
==> default: chef_version=13.7.16
==> default:
==> default: platform=ubuntu
==> default:
==> default: platform_version=14.04
==> default:
==> default: ruby=ruby 2.4.3p205 (2017-12-14 revision 61247) [x86_64-linux]
==> default:
==> default: program_name=chef-solo worker: ppid=11022;start=16:47:23;
==> default:
==> default: executable=/opt/chef/bin/chef-solo
==> default:
==> default:
==> default:
==> default: Running handlers:
==> default: [2018-01-26T16:47:31+00:00] ERROR: Running exception handlers
==> default: [2018-01-26T16:47:31+00:00] ERROR: Running exception handlers
==> default: Running handlers complete
==> default:
==> default: [2018-01-26T16:47:31+00:00] ERROR: Exception handlers complete
==> default: [2018-01-26T16:47:31+00:00] ERROR: Exception handlers complete
==> default: Chef Client failed. 0 resources updated in 07 seconds
==> default: [2018-01-26T16:47:31+00:00] FATAL: Stacktrace dumped to /var/chef/cache/chef-stacktrace.out
==> default: [2018-01-26T16:47:31+00:00] FATAL: Stacktrace dumped to /var/chef/cache/chef-stacktrace.out
==> default: [2018-01-26T16:47:31+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
==> default: [2018-01-26T16:47:31+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
==> default: [2018-01-26T16:47:31+00:00] ERROR: uninitialized constant MysqlCookbook::Helpers
==> default: [2018-01-26T16:47:31+00:00] ERROR: uninitialized constant MysqlCookbook::Helpers
==> default: [2018-01-26T16:47:31+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
==> default: [2018-01-26T16:47:31+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
Chef never successfully completed! Any errors should be visible in the
output above. Please fix your recipes so that they properly complete.
`

Same error here with mysql 8.5.1 and chef 13.8.0
helpers.rb provides MysqlCookbook::HelpersBase
but provider_mysql_client.rb tries to include MysqlCookbook::Helpers

The file provider_mysql_client.rb does not exist anymore in version 8.x.x of the cookbook.
Make sure you don't have old files from a previous version 7.x.x of the cookbook lying around.
If you're using Berkshelf, try to delete its cache (~/.berkself).
If you're copying everything to your target server, and then use chef zero (-z), look over there as well.


More detailed instructions on how to run the code

Hey there!
Everyone praising your paper and code, but honestly I hardly understood anything. I saw some visuals and thought perhaps I could try to run this algorithm of a few images I have. However, with the instructions you left (for your fellow researchers probably) it is impossible for me to run or understand what is the problem.
Can you please, please write a more detailed step-by-step instructions, on how to run the code on my own sample images. I am not interested in metrics or comparison across datasets, I just need to get output image and compare it with the original.
More people could benefit from your work, and we would be grateful.

Hello, since we are busy with our project, we are sorry for the late reply.  We will refine our README when we finish our current project. Thanks for your understanding.


chore: add esModuleInterop flag

cc @jmgiaever

Removes the particular issue, but seems there's conflicts with TS versions.


Remove *.xcscheme from Global/Xcode.gitignore,Objective-C.gitignore and…

… Swift.gitignore
Xcode schemes should be held under source control when shared. When not shared they are stored in xcuserdata, so are already ignored. Therefore ignoring *.xcscheme is incorrect, as far as I'm aware.

@nrbrook do you have a supporting link which discusses this? I'd love something (semi-)official to point other curious people to...

There is nothing specific, but some references to sharing schemes in Apple's documentation.
https://developer.apple.com/library/ios/recipes/xcode_help-scheme_editor/Articles/SchemeShare.html
https://developer.apple.com/library/ios/recipes/xcode_help-scheme_editor/Articles/SchemeManage.html

So sharing this file seems like something that should be opt-in (either explicitly add the file or delete the line from the gitignore file) because perhaps people don't want to share these schemes.
Instead of removing this rule, should keep it around and annotate it to explain when you should be committing this file?

'Sharing' is opt-in – schemes by default are not shared, and are stored in xcuserdata directory, which is ignored already here. But when you enable sharing on a scheme, Xcode moves it to the xcshareddata directory, and it should be committed. As far as I'm aware, xcschemes are only placed in those two locations. As such, the wildcard to ignore all scheme files is unnecessary.
The most popular answer on stack overflow does not ignore *.xcscheme.
http://stackoverflow.com/questions/49478/git-ignore-file-for-xcode-projects

@nrbrook thanks for the extra context!


Editor window - show toolbar

Show toolbar is available even when there is no text field on the screen (would rpefer to just leave this to the up / down arrow on the form)
By Julian

I like the show toolbar checkbox as it means you don't have to constantly click the arrows on individual fields. Maybe it could disappear when there aren't any text fields on the wizard though (like the language one only appears when there are lang properties)


Add instruction for local notifications

Hi, thank you for the great library.
I tried postLocalNotification as the documentation, but actually I had to add code as shown on the following comment:
https://github.com/zo0r/react-native-push-notification/issues/275#issuecomment-58962213

thanks @acro5piano but we do have it already implemented in our code here. I think the error you had is connected to the #import "RNNotifications.h" we have here. I'll change it to #import <RNNotifications.h>


Multiple modals scrolling bug

dimmable dimmed are deleted from body when the second modal is closed
Steps

Scroll modal
Open second modal
Scroll modal
Close second modal
Try to scroll modal

Expected Result
The first modal should be scrollable
<body class="dimmable dimmed scrolling">
Actual Result
First Modal is not longer scrollabel
<body class="scrolling">
Version
tested in 0.64.0 & 0.63.5
Testcase
https://codepen.io/csxmedia/full/mRVgYX/

Yep, this makes sense.  I think it is time to consider a stack for managing things like overlays and document level keybindings.
Another example of this issue is pressing ESC.  This will close all Dropdowns, Popups, Modals, and anything else that has a document level listener for ESC.  Ideally, we'd have a stack of listeners and only the most recent would be invoked and removed.  That way, only the top level component unmounts.  This would allow opening/closing a Popup inside of a Modal without also closing the Modal.
The stack could also be used here to keep the classes on the body until there were no more page dimmers in the stack.
@jcarbo / @layershifter have you run into needs that would be well served by a stack or top-level Provider component for managing state such as listeners and multiple Portals?

Will this be resolved to work by default in upcoming versions?

If someone submits a PR it certainly will.   If we run into this issue at @TechnologyAdvice then @davezuko or I may find time for it, though, we don't really use double modals nor have immediate plans to.
I'd love to help support any community PR for this though.

my temporary fix
class ModalTrigger extends React.Component {
  constructor(props) { ... }

  componentWillUpdate() {
    this.fixBody();
  }

  componentDidUpdate() {
    this.fixBody();
  }

  fixBody() {
    const anotherModal = document.getElementsByClassName('ui page modals').length;
    if (anotherModal > 0) document.body.classList.add('scrolling', 'dimmable', 'dimmed');
  }

  render() {
    return (
      <Modal ... >
        ...
      </Modal>
    );
  }
}

If still not working with @marcdibold fix, try bellow:
class ModalTrigger extends React.Component {
  constructor(props) { ... }

  fixBody() {
    const anotherModal = document.getElementsByClassName('ui page modals').length;
    if (anotherModal > 0) document.body.classList.add('scrolling', 'dimmable', 'dimmed');
  }

  render() {
    return (
      <Modal onUnmount={this.fixBody} ... >
        ...
      </Modal>
    );
  }
}

This commit solves the issue with closing one of modal in presence of others. Unfortunately I don't know hot to make a PR out of 1 commit only (not the whole branch)
(fix) When modal window unmounts it reverts portal's original class list, instead of resetting it
https://github.com/rasdaniil/Semantic-UI-React/commit/17c19777f59e4b7b1b0976a7bece01e203de5873

Thanks for the workaround @rasdaniil.
We've got an open PR to solve this correctly as well, by adding an event pool. We have this problem with many other things such as pressing ESC with an open Popup/Modal/Dropdown.  Every component will close as they are all listening to that event.  The open PR makes a stack of events and only fires the latest one.

PR up in #2010 to fix this issue.

Super excited for this PR to be fixed so I can remove all the fixBody functions I've put everywhere 💯

Scrolling seems to not be working still. Checked with version 0.75.1.

@RetroCraft  this used to help me https://github.com/rasdaniil/Semantic-UI-React/commit/17c19777f59e4b7b1b0976a7bece01e203de5873

@rasdaniil This looks great and makes a lot more sense than what I hacked together.
Open a PR since I'd rather a proper solution like yours merge than a hacky thing like mine. The idea was already brought up before and it makes sense.

@RetroCraft I opened it some time ago but something went wrong :-)
https://github.com/Semantic-Org/Semantic-UI-React/pull/1326

I am still experiencing this in 0.77.1 (pen here).
Is this supposed to be fixed by now? (No offense, but I'm having a hard time telling from this issue tracker, there are a number of issues referencing each other, some of which are closed, some PRs merged, and I'm rather new to this.)
I guess we are waiting for the event pool PR? Or what is the status on this? Should one simply use the workaround by @rasdaniil right now and monkey-patch it locally?
The event pool sounds like a larger task, but if I can do something to get the workaround into master for now, let me know and I'll try.

@dfsp-spirit They do say 'contributions welcome' in the fine prints.
This bug affects me as well. I have submitted #2394. Please test and tell me if that works for you.

I am still experiencing this in 0.78.2
When can you fix it?

Was fixed in #2407, but not released yet.


how to inference using 70b? or we need to implement it with the same way to train it by ourself?

Have you implemented this yet? Can you share a wave?


[AnVIL Catalog] Configure consortia header menu

Depends On
https://github.com/clevercanary/data-explorer/issues/197

Complete


introspection?

Hi,
I wonder if it is also possible to query the state of the ospray API somehow. Currently I understand that the API only supports setting information such as parameter values etc. There could be use cases where it would be benefitial to have query functions which allow to query parameter values, object types or even things such as the list of supported parameternames on an ospray object. Having such functions could keep a software architecture built around ospray more slim and elegant.
What are your thoughts on that?
Best,
David
P.S.: feel free to close the issue after commenting....

hi David,
Thanks for the input!  Unfortunately, OSPRay does not currently let you query parameter values, mainly because this complicates the MPI device we are currently working on.  We definitely all agree that this would be beneficial and make debugging state significantly easier.  We have discussed a scenegraph type structure for all object params but no eta on this yet.

Hi David,
We used to have functions to query parameter values for objects currently in memory, but these functions are only trivial to implement when rendering locally.
Moving forward, we currently implement 2 devices: LocalDevice and MPIDevice (and deprecated a third -> KNC COIDevice). The local device implements the API to do all rendering locally on the CPU, which is what you get by default when you initilaize OSPRay. However, other devices are able to map slightly different semantics to the same API calls currently defined. Our current MPI device allows a single application to treat an entire cluster as a giant "offload" device, where objects are not local to the memory space of the application. This was similar to our COI device which would do the same, but doing so with (potentially multiple) KNC cards, where objects are also not local to the CPU the app is running on.
It was possible for us to implement the parameter query functions in these contexts, but it had very negative impact on performance as cross-node synchronization is expensive; thus we removed them completely. Furthermore, this issue is even more problematic (and perhaps not even possible to correctly implement) in a distributed application, where each node may make different API calls. Thus for apps which rely upon OSPRay tracking their data, almost the entirety of OSPRay internal objects would have to be queryable to allow apps to "discover" what the scene looks like on one particular node. Ultimately, we decided to keep the API in its current form to minimize divergence in how apps use the API when using different device rendering backends. In it's current form, the entire API can be called identically between local, MPI, [and COI] devices, where a single app can render locally or across cluster nodes without even needing to recompile.
The solution we settled on is directing responsibility of tracking parameter values to the layer of client code which is making OSPRay API calls. IMHO, it actually makes more sense to keep such information in the app as OSPRay doesn't care about what the scene means to the app, rather that there's just geometry and/or volumetric data to be rendered "by something". Depending on the complexity of your application, this could be fairly simple to implement or very big/comprehensive. As Carson suggested, a scene graph on top of OSPRay is a great way to solve the problem. We do have one in our samples apps (https://github.com/ospray/OSPRay/tree/devel/apps/common/sg), but we can't commit to maintaining/extending it as we do the core API at this time.
I hope that helps!
Cheers,
Jeff

I haven't thought about the implication of state queries in the context of distributed rendering. Thank you guys for elaborating on this. Having a SG on top of ospray on the client code side seems the way to go then.
Best,
David

While I agree to all above (i.e. OSPRay's API staying write-only) I like to discuss the other (orthogonal) aspect of the original question: How about exposing query functions to get a list of the offered parameters of an object and their meta information, i.e. not the value, but information such as type, default value, minimum and maximum valid value? This can be quite a useful feature, also allowing applications to easily make use of  (unknown) modules / plug-ins based on the SDK.

johannes,
absolutely.  We have discussed this previously as part of a scenegraph and you're right it would be very useful to users to have a check for missing required fields for instance and a state graph that we can verify rather than just throwing exceptions by hand.  Just not sure where that is on our priority list right now.


[TC-214] SSL Customer Cert Upload

Allow CDN tenants to upload a custom cert to the CDN for application to their services.
Customers that split traffic across multiple CDNs have to use their own FQDN and SSL cert. We need a process for them to securely upload their certs to us for storage and application against their services.
We also need to capture the FQDN of the cert and make sure it is applied as a host regex for their service so that the CDN recognizes it. It's possible that it is already in place when they upload the cert, but this should be checked.
Author: Ashish Timilsina
JIRA Link: https://issues.apache.org/jira/browse/TC-214

@ryandurfey
@ashish-timilsina

duplicate of #1905


Introduce openshift ansible install update system containers job

So we can test system containers upgrade as well

no conformance tests run so far, will be done later once all failing tests are fixed
upgrading to the same version (not an actual upgrade, just to test the upgrade execution path), once pre-built OCP images are available, we will perform a real upgrade
health-checks are disabled: @sosiouxme
built on top of test_pull_request_openshift_ansible_extended_conformance_install_system_containers

I have not added the new job to the openshift-ansible test-suite yet. I will do it once we agree the job is ready to go.
It takes ~1h to complete. Tested in the CI: https://ci.openshift.redhat.com/jenkins/job/test_pull_request_openshift_ansible_extended_conformance_install_update_system_containers/1/

@stevekuznetsov @kargakis @sdodson

@ashcrow @giuseppe

Copied from code comment
I think you'll end up getting latest if you leave off the tag but I'm not 100% sure. @giuseppe WDYT?


Initialize app

Create a react app with the following (or equivalent) items:

[x] app server (npm I assume)
[x] react library
[ ] a way to GET and POST data
[ ] testing framework

Stretch goals:

[ ] Dockerfile (for deployment)
[ ] docker-compose.yml (for request mocking?)
[ ] Makefile (for easy running of common tasks (see operationcode/operationcode)

X - Webpack-dev-server added
X - React listed as dependency in package.json


Many images are not viewable

[Enter feedback here]
Many of the images on this page are not effective (text is too small and barely visible) and do not have the option to zoom-in.  Many of these images are not effective and certainly not appropriate from an accessibility perspective.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 17e395ed-28e4-2562-0913-a39414b69efd
Version Independent ID: 085de69f-40ac-1c1e-5d9a-1e2932c1e000
Content: Using and managing discovery
Content Source: articles/external-attack-surface-management/using-and-managing-discovery.md
Service: security
GitHub Login: @danielledennis
Microsoft Alias: dandennis

@ceperezb
Thanks for your feedback! I've assigned this issue to the author who will investigate and update as appropriate.


FloatingButton disabled style

The FloatingButton control style does not reflect the button's disabled state.
As of now, the button keeps its original color and does not hover.
The expected behavior would be for the button to change its color to say gray.

In this image, the Plus button is currently set to disabled and is clearly not visually distinctive from the Search button, which is active.

let me fix it

for now u can use this
  <Style Selector="FloattingButton:disabled">
    <Setter Property="Background" Value="{DynamicResource ButtonBackgroundDisabled}" />
    <Setter Property="BorderBrush" Value="{DynamicResource ButtonBorderBrushDisabled}" />
    <Setter Property="TextBlock.Foreground" Value="{DynamicResource ButtonForegroundDisabled}" />
  </Style>

but I'll add that feature in the next version


Ubuntu 18 support?

Hi,
Does SimpleDet support Ubuntu 18? My current workstation is on Ubuntu 18.

If you use some sort of virtual environments like docker or singularity, the distro version should not be a problem. As for building from scratch, I think cuda9.2 + cudnn7 should works just fine.


Cannot override CSS settings as described in docs

Description
Trying to override the default theme with a couple of tweaks, primarily a few colors and the font. I followed the docs and created https://github.com/adammhaile/UselessCalculations/blob/master/assets/stylesheets/main.scss
You can see I added a few color tweaks to that. But nothing shows up when the site is generated.
I admit, I'm new to Jekyll, so I'm probably missing something. But everything I'm seeing in your docs and the jekyll docs seem to just say to copy the desired base file to the same path, and add the tweaks you want. I also tried with main.scss empty other than my tweaks as seems to be implied in your docs. But same issue.
Environment

Basically Basic version: 1.4.0
Ruby gem or remote theme version: gem <IP_ADDRESS>
Jekyll version: 3.8.2
Git repository URL: https://github.com/adammhaile/UselessCalculations/
Operating system: Ubuntu 18

Expected behavior
For the colors and fonts to be updated by updating /assets/stylesheets/main.scss
Steps to reproduce the behavior

Create /assets/stylesheets/main.scss
Add SASS tweaks
rebuild

Move the Sass variables before the @import lines and it should work.


[SPARK-35981][PYTHON][TEST] Use check_exact=False to loosen the check precision

What changes were proposed in this pull request?
We should use check_exact=False because the value check in StatsTest.test_cov_corr_meta is too strict.
Why are the changes needed?
In some environment, the precision could be different in pandas' DataFrame.corr function and the test StatsTest.test_cov_corr_meta fails.
AssertionError: DataFrame.iloc[:, 0] (column name="a") are different
DataFrame.iloc[:, 0] (column name="a") values are different (14.28571 %)
[index]: [a, b, c, d, e, f, g]
[left]:  [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 0.0]
[right]: [1.0, 1.0, 1.0, 1.0, 1.0, 1.0, 4.807406715958909e-17]

Does this PR introduce any user-facing change?
No.
How was this patch tested?
Modified tests should still pass.

cc @HyukjinKwon @itholic @xinrong-databricks

Test build #140540 has started for PR 33179 at commit 7e46edd.

Test build #140540 has finished for PR 33179 at commit 7e46edd.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45053/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140540/

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45053/

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45053/

Merged to master.


[FR DateTimeV2] Datetime recognized separately in French, which is inconsistent with English

For this weekday + time construction, only the weekday value is returned in FR. Both are returned in EN:
•	FR: "9h le Mardi" returns T09/T21 and XXXX-WXX-2 separately
•	EN: "9 a.m. on Tuesday" returns XXXX-WXX-2T09

looking into this one


Lokalise: Translations update

This pull request was initiated by Lokalise (user Peter Murray) at 2021-01-28 18:24:13

Test errors found. See https://jenkins-aws.indexdata.com/job/folio-org/job/ui-circulation-log/job/PR-57/1/

Test errors found. See https://jenkins-aws.indexdata.com/job/folio-org/job/ui-circulation-log/job/PR-57/1/

Test errors found. See https://jenkins-aws.indexdata.com/job/folio-org/job/ui-circulation-log/job/PR-57/2/

Test errors found. See https://jenkins-aws.indexdata.com/job/folio-org/job/ui-circulation-log/job/PR-57/2/


Install wasm-pack from cargo

Reduce failures due to GH API throttling
Hopefully increase cache hits

Looks like the latex image API is 500'ing


Python.h not found

On my system, the following error message shown up when compiling acs_py_enclave.c
Scanning dependencies of target pycomponent [ 34%] Building C object CMakeFiles/pycomponent.dir/intermediate/acs_py_enclave.c.o /home/gordon/incubator-teaclave/build/intermediate/acs_py_enclave.c:29:10: fatal error: Python.h: No such file or directory  #include <Python.h>           ^~~~~~~~~~ compilation terminated. CMakeFiles/pycomponent.dir/build.make:67: recipe for target 'CMakeFiles/pycomponent.dir/intermediate/acs_py_enclave.c.o' failed make[2]: *** [CMakeFiles/pycomponent.dir/intermediate/acs_py_enclave.c.o] Error 1 CMakeFiles/Makefile2:720: recipe for target 'CMakeFiles/pycomponent.dir/all' failed make[1]: *** [CMakeFiles/pycomponent.dir/all] Error 2 Makefile:83: recipe for target 'all' failed make: *** [all] Error 2
My finding is the following script snippet that didn't detect the dependency correctly in file CMakeLists.txt, because the package pypy also put some header files e.g. pypy_decl.h in this folder so we cannot safely say that the pypy_dev has got installed if the folder /usr/lib/pypy/include exists.
if(NOT EXISTS "/usr/lib/pypy/include")   message(     FATAL_ERROR       "pypy development package not found\nFor Ubuntu, please runapt-get install pypy-dev"   ) endif()

Nice catch! Thanks.
Normally, we use docker container to build Teaclave.
CMakeList may miss some dependency checks.

Merged.


Hack: Switchable Audio Interface with 2 different sound cards

Hack: Switchable Audio Interface with 2 different sound cards
a little different to https://github.com/MiczFlor/RPi-Jukebox-RFID/pull/1213 as I didn't have one soundcard with two outputs, I tried to use my USB sound card for speakers and onboard sound card for headphones
In the beginning it was a lot of trial and error to figure out, how both sound cards, names and IDs have to be used.
But eventually I found a working setup for me, being able to store the separate volumes for each audio output
Maybe it's a too specific setup, but maybe someone can use this:
Prerequisites

2 different sound cards, e.g. onboard and additional USB sound card
configuring both sound cards in config files, in my setup :
/etc/asound.conf

pcm.usbaudio {
        type hw
        card 1
}
ctl.usbaudio {
        type hw
        card 1
}

pcm.headphone {
        type hw
        card 0
}

ctl.headphone {
        type hw
        card 0
}

determine the names and hardware IDs of the sound cards:
aplay -L | grep -B2 "Direct hardware device without any conversions"

hw:CARD=Headphones,DEV=0
    bcm2835 Headphones, bcm2835 Headphones
    Direct hardware device without any conversions
--
hw:CARD=Device,DEV=0
    USB PnP Sound Device, USB Audio
    Direct hardware device without any conversions

amixer -c 0 scontents:
Simple mixer control 'Headphone',0
amixer -c q scontents:
Simple mixer control 'PCM',0

configure 2 audio outputs in /etc/mpd.conf

audio_output {
        type            "alsa"
        name            "Headphone"                                # name as in output of "amixer -c 0 scontents"
        device          "hw:0,0"        # optional                 # Device = output of aplay -L from above
        mixer_device    "default"                                    # mixer_device = "hw:" + Devicename after CARD=
        mixer_control   "Headphone"                            # name as in output of "amixer -c 1 scontents"
        mixer_index     "0"             # optional
}

audio_output {
        type            "alsa"
        name            "PCM"                                           # name as in output of "amixer -c 1 scontents"
        device          "hw:CARD=Device,DEV=0"           # Device = output of aplay -L from above
       mixer_device    "hw:Device"                               # mixer_device = "hw:" + Devicename after CARD=
        mixer_control   "PCM"                                      # name as in output of "amixer -c 1 scontents"
       mixer_index     "0"             # optional
}

create additional settings files with content "0" in RPi-Jukebox-RFID/settings/

Audio_Volume_Level_Headphone
Audio_Volume_Level_PCM
Max_Volume_Limit_Headphone
Max_Volume_Limit_PCM

added executable file switch_audio_output.sh to RPi-Jukebox-RFID/scripts/userscripts/

#!/bin/bash
PATHDATA="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )"
# Get active MPC Output
ACTIVE_OUTPUT=`mpc outputs | awk '/enabled/ { print $2 }' `
echo $ACTIVE_OUTPUT "is active"
#############################################################
# Define variables for Output Names and IDs according to the IDs from output of "mpc outputs"
MPC_OUTPUT1="PCM"
ALSA_OUTPUT1="1"
MPC_OUTPUT2="Headphone"
ALSA_OUTPUT2="0"
##############################################################
if [ $ACTIVE_OUTPUT -eq 2 ]
then
		echo "Activate PCM"
		# Save Volume and Max Volume settings for previous output
        $PATHDATA/../playout_controls.sh -c=getmaxvolume > $PATHDATA/../../settings/Max_Volume_Limit_$MPC_OUTPUT2
		$PATHDATA/../playout_controls.sh -c=getvolume > $PATHDATA/../../settings/Audio_Volume_Level_$MPC_OUTPUT2
		# Change Audio Output in config files
		sudo sed -i "s/defaults.pcm.card $ALSA_OUTPUT2/defaults.pcm.card $ALSA_OUTPUT1/" /usr/share/alsa/alsa.conf
		sudo sed -i "s/defaults.ctl.card $ALSA_OUTPUT2/defaults.ctl.card $ALSA_OUTPUT1/" /usr/share/alsa/alsa.conf
		sudo sed -i "s/$MPC_OUTPUT2/$MPC_OUTPUT1/" $PATHDATA/../../settings/Audio_iFace_Name
		# Change Audio Output in MPD
		mpc enable 1 && mpc disable 2
		# Get previous Volume and Max Volume for new output from file
		if [ ! -f  ${PATHDATA}/../../settings/Max_Volume_Limit_${MPC_OUTPUT1} ]
		then
			echo ${PATHDATA}/../../settings/Max_Volume_Limit > ${PATHDATA}/../../settings/Max_Volume_Limit_${MPC_OUTPUT1}
		fi
		if [ ! -f  ${PATHDATA}/../../settings/Audio_Volume_Level_${MPC_OUTPUT1} ]
		then
			echo ${PATHDATA}/../../settings/Startup_Volume > ${PATHDATA}/../../settings/Audio_Volume_Level_${MPC_OUTPUT1}
		fi

		$PATHDATA/../playout_controls.sh -c=setmaxvolume -v=$(<${PATHDATA}/../../settings/Max_Volume_Limit_${MPC_OUTPUT1})
		$PATHDATA/../playout_controls.sh -c=setvolume -v=$(<${PATHDATA}/../../settings/Audio_Volume_Level_${MPC_OUTPUT1})
elif [ $ACTIVE_OUTPUT -eq 1 ]
then
	if [[ $1 == "default" ]]                     # I try to call the script with a parameter "default" within the startup-scripts.sh, to set the desired "default" audio output
	then
		echo "Nothing to do"

	else

        echo "Activate Headphone"
		# Save Volume and Max Volume settings for previous output
		$PATHDATA/../playout_controls.sh -c=getmaxvolume > $PATHDATA/../../settings/Max_Volume_Limit_$MPC_OUTPUT1
		$PATHDATA/../playout_controls.sh -c=getvolume > $PATHDATA/../../settings/Audio_Volume_Level_$MPC_OUTPUT1
		# Change Audio Output in config files
		sudo sed -i "s/defaults.pcm.card $ALSA_OUTPUT1/defaults.pcm.card $ALSA_OUTPUT2/" /usr/share/alsa/alsa.conf
		sudo sed -i "s/defaults.ctl.card $ALSA_OUTPUT1/defaults.ctl.card $ALSA_OUTPUT2/" /usr/share/alsa/alsa.conf
		sudo sed -i "s/$MPC_OUTPUT1/$MPC_OUTPUT2/" $PATHDATA/../../settings/Audio_iFace_Name
		# Change Audio Output in MPD
		mpc enable 2 && mpc disable 1
		# Get previous Volume and Max Volume for new output from file
		if [ ! -f  ${PATHDATA}/../../settings/Max_Volume_Limit_${MPC_OUTPUT2} ]
		then
			echo ${PATHDATA}/../../settings/Max_Volume_Limit > ${PATHDATA}/../../settings/Max_Volume_Limit_${MPC_OUTPUT2}
		fi
		if [ ! -f  ${PATHDATA}/../../settings/Audio_Volume_Level_${MPC_OUTPUT2} ]
		then
			echo ${PATHDATA}/../../settings/Startup_Volume > ${PATHDATA}/../../settings/Audio_Volume_Level_${MPC_OUTPUT2}
		fi

		$PATHDATA/../playout_controls.sh -c=setmaxvolume -v=$(<${PATHDATA}/../../settings/Max_Volume_Limit_${MPC_OUTPUT2})
		$PATHDATA/../playout_controls.sh -c=setvolume -v=$(<${PATHDATA}/../../settings/Audio_Volume_Level_${MPC_OUTPUT2})
	fi

fi

I call the RPi-Jukebox-RFID/scripts/userscripts/switch_audio_output.sh vie RFID card, GPIO button would also be possible

Thanks!
I’m wondering, if we should add this to the wiki or if this could integrated in the code base with a PR?

I modified the script a bit. I cleared out the steps for saving the volume and named the devices to my likings.
And the toggle is working just fine.
I am currently trying to get the command bash RPi-Jukebox-RFID/scripts/userscripts/switch_audio_output.sh, which toggles the output devices, onto a button. (see discussion-1638

how can activate this script ?  bash RPi-Jukebox-RFID/scripts/userscripts/switch_audio_output.sh is not working
my usb speaker are on Card 2 so i only change the settings at /etc/asound.conf ?

@ddbkva I'm not sure, in my setup, exactly this command works
Additionally, i did a chmod +x RPi-Jukebox-RFID/scripts/userscripts/switch_audio_output.sh.
Did you also read https://github.com/MiczFlor/RPi-Jukebox-RFID/discussions/1638, maybe this helps?


[AutoPR web/resource-manager] Adding BillingMeters API

Created to sync https://github.com/Azure/azure-rest-api-specs/pull/2745

This PR has been merged into https://github.com/Azure/azure-sdk-for-go/pull/1475


Could objects be used instead of arrays for caches?

All of the cases where a cache field exists on a class in the tensor.ts module look like they could be converted to an object that would be easier to define types for. For example, the cache on the Add class has 2 elements a and b which are both either a Tensor or a number so if cache were changed to an object:
export class Add {
  cache?: {
    a: Tensor | number;
    b: Tensor | number;
  }

  forward(/* ... */) {
    this.cache = {a, b};
    // ...
  }

  backward(/* ... */) {
    if (typeof this.cache === "undefined") {
      throw Error("Cache is not defined.");
    }

    const {a, b} = this.cache;
    // ...
  }

doing this already turns up a type error with broadcast where the second parameter is typed as a Tensor but it should be Tensor | number | number[] | number[][].
Let me know what you think. It would be an easy change to switch the caches over to objects.

If you think it would make the code simpler an easier to apply classes to, then it makes sense. I used Arrays because I wasn't thinking about TS originally, and using Arrays takes up a single line of code.

Thanks! I see your point, and agree with it! Are you planning on adding that in your current PR, or should I add it separately?

If I add it I would probably make a new PR just so the changes are well separated from others but I'm not able to work on it for a bit so if you'd like to do it then I won't stop you!


Dart refactoring

The diff is huge. Please read diffs by commits.
Summary:

format code with dartfmt
follow Style Guide
use pub run test for tests.
remove OpenLocationCode object because there were no state and all the methods could be top-level functions. BTW it could be worth to have it and move some top-level function into (like the java version).
use num instead of double.

I didn't touch at the variable privacy but I think most of the constants should be private.

Thanks for that tidy up.

Alexandre, one more thing, before I can accept your code, could you sign the contributing license agreement (see CONTRIBUTING.md)? Thanks!

I already contribute to several google projects, so I think the CLA is already signed.

Maybe that's under different github IDs? When I check with a14n, I get a "not yet signed" response.
You could try logging into https://cla.developers.google.com/ and it will check.

strange that it works for other github projets. I updated the cla to add my github account.

friendly reminder.

Thanks for the ping, it's all merged now!


Improvement suggestions for the map popup

Some improvement suggestions for the map popup:

Do not display attributes without any data
Use a text for the link to OSM feature
Add the level attribute

Hi @rbovard, tahts a nice idea, i had it a while ago. But i didn't find a way where UMAP can do this. Maybe in the next Reelase with React it could be possible. Or do you know a way?

I don't know much about UMAP, but you can do it via a simple JS test when the popup will be generated by code in next release.
For now, can you at least address the two last points (link and level) in UMAP?

I'll give the next two points a try, if time this weekend. i'll keep you updated.

Feature already asked https://github.com/umap-project/umap/issues/884
Something like [[https://....|readable name]]
No need to help you 🤗

Level attribute is added right now.

Readable Link added right now

For the 1. Issue: I think UMAP isn't barely maintained at the moment. No action since 9 months. I will take a look in the next version of Defikarte.ch

Thanks a lot @chnuessli


Empire 3 Port for Malleable C2 HTTP Listener

I wasn't sure how else to get ahold of you, so sorry for the open issue.
I have been looking through some older pull requests on Empire and came across your Malleable C2 HTTP Listener from a while back. Overall it seems like a really cool concept and wanted to incorporate it into a future build, but I am having some issues getting it moved over to python 3. If you have some time available, could you discuss the implementation a bit with us?

Closing since this was updated and integrated into Empire.


buildMozillaMach: use enableFeature instead of "inlining" it

Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
22.11 Release Notes (or backporting 22.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

To the record: the failure happened because [] has higher precedence than application function. Oh my.

The attribute for this file is buildMozillaMach.

@ofborg build firefox-unwrapped

@ofborg build buildMozillaMach

The attribute for this file is buildMozillaMach.

Please use buildMozillaMach: instead of firefox/common.nix.

Please use buildMozillaMach: instead of firefox/common.nix:.

You are talking about the commit message?

@mweinelt ping :)

While this reuses and existing function it certainly does not improve readability, so I'm not convinced.

It certainly does not worsen the readability, while it reuses an existing function.

It certainly does not worsen the readability, while it reuses an existing function.

You say that now after reformatting it once more :wink:

You say that now after reformatting it once more 😉

I was still referring to the previous commit before force-pushing.
Now I am improving readability, in order to be more convincing.


Question: Missing .glabel for Jump Labels

Hello there,
I am working a disassembly project targets N64, that make use of splat, which depends on spimdisasm.
But I notice that it's generating .L* without .glabel .L*, for example:
glabel obj2Shell
/* 1AFE8 8001A3E8 27BDFD08 */  addiu      $sp, $sp, -0x2F8
/* 1AFEC 8001A3EC AFB1003C */  sw         $s1, 0x3C($sp)
/* 1AFF0 8001A3F0 AFBF005C */  sw         $ra, 0x5C($sp)
/* 1AFF4 8001A3F4 AFBE0058 */  sw         $fp, 0x58($sp)
/* 1AFF8 8001A3F8 AFB70054 */  sw         $s7, 0x54($sp)
/* 1AFFC 8001A3FC AFB60050 */  sw         $s6, 0x50($sp)
/* 1B000 8001A400 AFB5004C */  sw         $s5, 0x4C($sp)
/* 1B004 8001A404 AFB40048 */  sw         $s4, 0x48($sp)
/* 1B008 8001A408 AFB30044 */  sw         $s3, 0x44($sp)
/* 1B00C 8001A40C AFB20040 */  sw         $s2, 0x40($sp)
/* 1B010 8001A410 AFB00038 */  sw         $s0, 0x38($sp)
/* 1B014 8001A414 E7B90030 */  swc1       $f25, 0x30($sp)
/* 1B018 8001A418 E7B80034 */  swc1       $f24, 0x34($sp)
/* 1B01C 8001A41C E7B70028 */  swc1       $f23, 0x28($sp)
/* 1B020 8001A420 E7B6002C */  swc1       $f22, 0x2C($sp)
/* 1B024 8001A424 E7B50020 */  swc1       $f21, 0x20($sp)
/* 1B028 8001A428 E7B40024 */  swc1       $f20, 0x24($sp)
/* 1B02C 8001A42C AFA402F8 */  sw         $a0, 0x2F8($sp)
/* 1B030 8001A430 AFA502FC */  sw         $a1, 0x2FC($sp)
/* 1B034 8001A434 AFA60300 */  sw         $a2, 0x300($sp)
/* 1B038 8001A438 AFA70304 */  sw         $a3, 0x304($sp)
/* 1B03C 8001A43C 10800365 */  beqz       $a0, .L8001B1D4
/* 1B040 8001A440 27B102FC */   addiu     $s1, $sp, 0x2FC
/* 1B044 8001A444 2413000F */  addiu      $s3, $zero, 0xF
/* 1B048 8001A448 2412FFFC */  addiu      $s2, $zero, -0x4
.L8001A44C:
/* 1B04C 8001A44C 8FAF02F8 */  lw         $t7, 0x2F8($sp)
/* 1B050 8001A450 00000000 */  nop
/* 1B054 8001A454 25F8FFFF */  addiu      $t8, $t7, -0x1
/* 1B058 8001A458 2F01003A */  sltiu      $at, $t8, 0x3A
/* 1B05C 8001A45C 10200353 */  beqz       $at, .L8001B1AC
/* 1B060 8001A460 0018C080 */   sll       $t8, $t8, 2
/* 1B064 8001A464 3C018009 */  lui        $at, (0x80090000 >> 16)
/* 1B068 8001A468 00380821 */  addu       $at, $at, $t8
/* 1B06C 8001A46C 8C383130 */  lw         $t8, 0x3130($at)

in which .L8001B1AC is referenced in rodata:
/* 93D9C 8009319C 8001ACF4 */ .word 0x8001ACF4
/* 93DA0 800931A0 8001B1AC */ .word .L8001B1AC
/* 93DA4 800931A4 8001AD78 */ .word 0x8001AD78

This results in undefined reference on linking the objects, as .L8001B1AC cannot be seen by the linker.
I have look into the source code of splat, where they emit asm code via:
class CommonSegAsm(CommonSegCodeSubsegment):
# ... snip ...
    def split(self, rom_bytes: bytes):
        if not self.rom_start == self.rom_end and self.spim_section is not None:
            out_path = self.out_path()
            if out_path:
                out_path.parent.mkdir(parents=True, exist_ok=True)

                self.print_file_boundaries()

                with open(out_path, "w", newline="\n") as f:
                    for line in self.get_file_header():
                        f.write(line + "\n")
                    f.write(self.spim_section.disassemble())

and turns out the assembly was directly emitted by spimdisasm.
I have tried anaconda3 and standalone python 3.11.7, however both of them produced the exact same results.
Hence I am wondering if I have made any mistake on config or env setup.
I am using windows 11 with spimdisasm 1.20.0, and spimdisasm.common.GlobalConfig was:
GlobalConfigType(DISASSEMBLE_UNKNOWN_INSTRUCTIONS=False, PRODUCE_SYMBOLS_PLUS_OFFSET=True, TRUST_USER_FUNCTIONS=True, TRUST_JAL_FUNCTIONS=True, RODATA_STRING_GUESSER_LEVEL=1, DATA_STRING_GUESSER_LEVEL=2, PASCAL_RODATA_STRING_GUESSER_LEVEL=0, PASCAL_DATA_STRING_GUESSER_LEVEL=0, AUTOGENERATED_NAMES_BASED_ON_SECTION_TYPE=False, AUTOGENERATED_NAMES_BASED_ON_DATA_TYPE=False, AUTOGENERATED_NAMES_BASED_ON_FILE_NAME=False, SEQUENTIAL_LABEL_NAMES=False, LEGACY_SYM_ADDR_ZERO_PADDING=False, CUSTOM_SUFFIX='', COMPILER=<Compiler.IDO: 'IDO'>, DETECT_REDUNDANT_FUNCTION_END=True, ENDIAN=<InputEndian.BIG: 'big'>, ENDIAN_DATA=None, ENDIAN_RODATA=None, ABI=<Abi.O32: 'O32'>, ARCHLEVEL=<ArchLevel.MIPS3: 3>, INPUT_FILE_TYPE=<InputFileType.BINARY: 'binary'>, GP_VALUE=0, PIC=False, EMIT_CPLOAD=True, EMIT_INLINE_RELOC=False, SYMBOL_FINDER_FILTER_LOW_ADDRESSES=True, SYMBOL_FINDER_FILTER_ADDRESSES_ADDR_LOW=2147483648, SYMBOL_FINDER_FILTER_HIGH_ADDRESSES=True, SYMBOL_FINDER_FILTER_ADDRESSES_ADDR_HIGH=3221225472, SYMBOL_FINDER_FILTERED_ADDRESSES_AS_CONSTANTS=True, SYMBOL_FINDER_FILTERED_ADDRESSES_AS_HILO=False, ALLOW_UNKSEGMENT=True, ALLOW_ALL_ADDENDS_ON_DATA=True, ALLOW_ALL_CONSTANTS_ON_DATA=True, ASM_COMMENT=True, ASM_COMMENT_OFFSET_WIDTH=0, GLABEL_ASM_COUNT=False, ASM_REFERENCEE_SYMBOLS=False, ASM_TEXT_LABEL='glabel', ASM_TEXT_ALT_LABEL='glabel', ASM_JTBL_LABEL='glabel', ASM_DATA_LABEL='glabel', ASM_USE_SYMBOL_LABEL=True, ASM_TEXT_ENT_LABEL='', ASM_TEXT_END_LABEL='', ASM_TEXT_FUNC_AS_LABEL=False, ASM_DATA_SYM_AS_LABEL=False, ASM_EMIT_SIZE_DIRECTIVE=False, ASM_USE_PRELUDE=True, ASM_GENERATED_BY=True, PRINT_NEW_FILE_BOUNDARIES=False, USE_DOT_BYTE=True, USE_DOT_SHORT=True, LINE_ENDS='\n', PANIC_RANGE_CHECK=False, CREATE_DATA_PADS=True, CREATE_RODATA_PADS=False, QUIET=False, VERBOSE=False, PRINT_FUNCTION_ANALYSIS_DEBUG_INFO=False, PRINT_SYMBOL_FINDER_DEBUG_INFO=False, PRINT_UNPAIRED_LUIS_DEBUG_INFO=False, REMOVE_POINTERS=False, IGNORE_BRANCHES=False, IGNORE_WORD_LIST=set(), WRITE_BINARY=False)

Many thanks for the help.

Hey! Thanks for the bug report!
Sadly I can't reproduce the issue myself. I cloned the repo and followed the README instructions and the build produces an OK instead of a linker error.
On a further inspection of the generated assembly.

I get this on the rodata range you showed (note it uses labels instead of raw addresses):/* 93D9C 8009319C 8001ACF4 */ .word .L8001ACF4
/* 93DA0 800931A0 8001B1AC */ .word .L8001B1AC
/* 93DA4 800931A4 8001AD78 */ .word .L8001AD78

Those jumptable labels do get a proper glabel:/* 1BDA4 8001B1A4 10000006 */  b          .L8001B1C0
/* 1BDA8 8001B1A8 26390003 */   addiu     $t9, $s1, 0x3
glabel .L8001B1AC
/* 1BDAC 8001B1AC 3C048009 */  lui        $a0, %hi(D_800930E4)
/* 1BDB0 8001B1B0 8FA502F8 */  lw         $a1, 0x2F8($sp)
/* 1BDB4 8001B1B4 0C0003EF */  jal        errstop

/* 1B970 8001AD70 10000112 */  b          .L8001B1BC
/* 1B974 8001AD74 2413000F */   addiu     $s3, $zero, 0xF
glabel .L8001AD78
/* 1B978 8001AD78 26380003 */  addiu      $t8, $s1, 0x3
/* 1B97C 8001AD7C 03128824 */  and        $s1, $t8, $s2
/* 1B980 8001AD80 8E220000 */  lw         $v0, 0x0($s1)

The label .L8001A44C from the obj2Shell function (the one you showed) does indeed not emit a glabel, but that's because the label is not unused anywhere outside the function itself (it isn't referenced by a jumptable).

Seems like we are running the same spimdisasm version.
Which splat version did you use to test this? Try to check if yours is somehow outdated.
Seems like the splat submodule I used is 0.21.6. You can check the splat version by simply running it, it will print something like this:
splat 0.21.6 (powered by spimdisasm 1.20.0)

My Python version is 3.10.12 and I'm running on a native Linux distro.
Are you running this on native Windows 11 or are you using WSL? Both spimdisasm and splat should behave the regarding the Python version or OS it runs on, otherwise it would be pretty worrying.
lmk if you have any more info to try to reproduce this issue

I am talking to them on discord and they are using Msys to run this. They use Python 3.11.5 and I tried 3.11.7 and that didnt reproduce it. I also made sure to make my requirements.txt versions match their module versions and that didnt reproduce it issue. It's gotta be either some weird 3.11.5 bug (cascading into a spimdisasm issue) or a horrible environment issue as a result of using msys.

How does Msys handle Python? Is it like its own shell or is it running on a plain Windows cmd/powershell?
You could try running splat on a cmd/powershell directly instead of passing through Msys to see if that's somehow related

How does Msys handle Python? Is it like its own shell or is it running on a plain Windows cmd/powershell?
You could try running splat on a cmd/powershell directly instead of passing through Msys to see if that's somehow related

No I have run the script in cmd and anaconda3 prompt, both produced the exact same result.

I have tried to run splat on Ubuntu VM, and it seems output the correct assemblies without linking issues.
Does spimdisasm make use of unix shell or system features internally?
I thought the package was platform-independent.

Neither spimdisasm or splat use any OS dependent feature, so it should behave the same everywhere.
That said, I installed Windows 11 on a virtual machine with Python 3.11.5 and I managed to reproduce the bug. I'll try to see what causes this

Not sure that it helps, but I am unable to reproduce this issue under MSYS2 MinGW x64 on Windows 10. Python 3.11.7, I see the symbols resolved correctly:
marks@DESKTOP-AOUBO9E MINGW64 ~/TSA
$ grep -n3 8009319C  asm/data/93680.rodata.s
344-/* 93D90 80093190 8001ABB8 */ .word .L8001ABB8
345-/* 93D94 80093194 8001ABF4 */ .word .L8001ABF4
346-/* 93D98 80093198 8001AC74 */ .word .L8001AC74
347:/* 93D9C 8009319C 8001ACF4 */ .word .L8001ACF4
348-/* 93DA0 800931A0 8001B1AC */ .word .L8001B1AC
349-/* 93DA4 800931A4 8001AD78 */ .word .L8001AD78
350-/* 93DA8 800931A8 8001ADB8 */ .word .L8001ADB8

marks@DESKTOP-AOUBO9E MINGW64 ~/TSA
$ grep -R jtbl_80093130 asm
asm/177F0.s:/* 1B064 8001A464 3C018009 */  lui        $at, %hi(jtbl_80093130)
asm/177F0.s:/* 1B06C 8001A46C 8C383130 */  lw         $t8, %lo(jtbl_80093130)($at)
asm/data/93680.rodata.s:glabel jtbl_80093130

Not sure that it helps, but I am unable to reproduce this issue under MSYS2 MinGW x64 on Windows 10. Python 3.11.7, I see the symbols resolved correctly:
marks@DESKTOP-AOUBO9E MINGW64 ~/TSA
$ grep -n3 8009319C  asm/data/93680.rodata.s
344-/* 93D90 80093190 8001ABB8 */ .word .L8001ABB8
345-/* 93D94 80093194 8001ABF4 */ .word .L8001ABF4
346-/* 93D98 80093198 8001AC74 */ .word .L8001AC74
347:/* 93D9C 8009319C 8001ACF4 */ .word .L8001ACF4
348-/* 93DA0 800931A0 8001B1AC */ .word .L8001B1AC
349-/* 93DA4 800931A4 8001AD78 */ .word .L8001AD78
350-/* 93DA8 800931A8 8001ADB8 */ .word .L8001ADB8

marks@DESKTOP-AOUBO9E MINGW64 ~/TSA
$ grep -R jtbl_80093130 asm
asm/177F0.s:/* 1B064 8001A464 3C018009 */  lui        $at, %hi(jtbl_80093130)
asm/177F0.s:/* 1B06C 8001A46C 8C383130 */  lw         $t8, %lo(jtbl_80093130)($at)
asm/data/93680.rodata.s:glabel jtbl_80093130

I think the issue is not related to the shell as long as spimdisasm and splat are not using shell internally.
Have you tried to run python via cmd or anaconda prompt?
This could be an unknown python bug for Windows 11 if that worked for you.

We (well, Anghelo) have been debugging and it looks to be due to the "long" datatype being 32 bits under Windows, but 64 bits under Linux, which causes the symbol address to be calculated incorrectly.
I didn't encounter the problem because the rabbitizer wheel was compiled locally when I pip installed, but you & Anghelo got the pre built wheel from pypi.
Watch this space for a new release...

We (well, Anghelo) have been debugging and it looks to be due to the "long" datatype being 32 bits under Windows, but 64 bits under Linux, which causes the symbol address to be calculated incorrectly.
I didn't encounter the problem because the rabbitizer wheel was compiled locally when I pip installed, but you & Anghelo got the pre built wheel from pypi.
Watch this space for a new release...

Oh so it's an bug from rabbitizer.
Then I would have to build it by myself and replace the long with long long?

Rabbitizer will need to be updated and released - if you want to test the fix out beforehand, you can change this line https://github.com/Decompollaborate/rabbitizer/blob/c6e988affab6790a7a497e7c68a50bb58e78e1c1/rabbitizer/rabbitizer_type_LoPairingInfo.c#L26 from T_LONG to T_LONGLONG and rebuild the wheel (I think pip install .) once you've made that change.

Okay, many thanks for the help.
Shall we close this issue now?

I made a new release of rabbitizer that should address this issue (https://github.com/Decompollaborate/rabbitizer/pull/51 and https://github.com/Decompollaborate/rabbitizer/pull/52)
Could you please install the latest version of rabbitizer and tell us if the issue still persists?
To make sure you install the latest version you can run this:
python3 -m pip install "rabbitizer==1.8.3"

Could confirm that the issue has gone after installing the latest version of rabbitizer.

Cool! glad that it finally got solved


use a good way for waiting sometime test

Now we will wait some time for asynchronous test, like wait proxy to be online, wait ha doing failover over.
If the wait time is short, the test may not complete and we will get an invalid result, but if the wait time is long, the whole test will cost longer, which is unacceptable too.

Yea... We have been extremely careful about controlling testing duration in etcd. However, it still grows to 5 minutes including integration test (with cpu = 1, 2, 4 and race option enabled)...
If we did not control it in etcd, it would be HOURs...
Some projects do take hours to be built and tested, and the develops are used to that...
But we are Go proj right?


trakia-uni.bg

trakia-uni.bg

<EMAIL_ADDRESS>ISANI DISTRICT, PUBLIC SCHOOL #216
https://www.facebook.com/სსიპ-ქთბილისის-N216-საჯარო-სკოლა-473256156339558

@promonad Please provide us with:

the school official website URL
the school street address, including city and country
an URL of a page on the official website where the school offers an IT-related long-term (>1 year) course
a proof, which shows that the school recognizes the domain you are submitting as an official email domain for the students.

You can provide us with any of the following as the proof:

A copy of instruction (a hard-copy or electronic one) given to you by the school that tells you to use an email address in this email domain
An URL of a page at the official school website that says that students use this email domain
A reference to a recognized journal where an article was published by someone from the school, with explicit affiliation to the school, and e-mail address from the email domain
A WHOIS data that link the email domain to the school somehow
A copy of official letter from the school representative saying that the school provides e-mail addresses in this domain to the students
Anything else that can prove this fact in similar way, i.e. can be verified independently.

@promonad You might miss my previous comment. Please react.

http://www.uni-sz.bg || http://uni-sz.bg/engl

Trakia University, 6000 Stara Zagora, Student's campus, BULGARIA
https://www.google.com/maps/place/Тракийски+Университет/@42.4007147,25.5711639,15z/data=!4m5!3m4!1s0x0:0x9b28a6a11c26f997!8m2!3d42.4007147!4d25.5711639

http://uni-sz.bg/truni7/blog/ракийски-университет-стартира-прием/

www.trakia-uni.bg – Google Apps for Education – Trakia university


Support for tslint 4.X?

When using the current version of grunt-tslint with tslint 4.0.0+ the following is logged to the console:
$ grunt
Running "tslint:src" (tslint) task
Warning: Linter is not a constructor Use --force to continue.

will be addressed by #56

Published v4.0.0, let us know if you have any issues.