perf data idle time

speedscope provides a great time order view.
But for perf data, when the program is idle, speedscope will think that the time is consumed by the next sampled call stack. This is wrong, the program should be idle at this time.

$ cat test.c

#include <stdio.h>
#include <unistd.h>
#include <time.h>
#include <pthread.h>
#include <sys/time.h>
#include <sys/types.h>

void fselect() {
    fd_set rfds;
    struct timeval tv;
    int retval;

    FD_ZERO(&rfds);
    FD_SET(0, &rfds);
    tv.tv_sec = 2;
    tv.tv_usec = 0;
    retval = select(1, &rfds, NULL, NULL, &tv);

    if (retval == -1)
        perror("select()");
    else if (retval)
        printf("Data is available now.\n");
        /* FD_ISSET(0, &rfds) will be true. */
    else
        printf("No data within two seconds.\n");
}

void timed(int microseconds) {
    int sec, usec, diff;
    struct timeval tv;
    gettimeofday(&tv, NULL);
    // printf("begin seconds : %ld micro seconds : %ld\n", tv.tv_sec, tv.tv_usec);
    sec = tv.tv_sec;
    usec = tv.tv_usec;

    while (1) {
        gettimeofday(&tv, NULL);
        diff = (tv.tv_sec - sec) * 1000000 + tv.tv_usec - usec;
        if (diff > microseconds) {
            // printf("end seconds : %ld micro seconds : %ld\n", tv.tv_sec, tv.tv_usec);
            break;
        }
    }
}

void a() { timed(500000); }
void b() { timed(500000); }
void c() { timed(500000); }
void d() { timed(500000); }
void e() { timed(500000); }

void *fthread(void *args) {
    func();
    return NULL;
}

void func() {
    while (1) {
        a();
        b();
        fselect();
        c();
        d();
        e();
        printf("sleep begin\n");
        sleep(1.5);
        printf("sleep end\n");
    }
}

int main() {
    pthread_t thread;
    pthread_create(&thread, NULL, fthread, NULL);

    func();
    return 0;
}

$ gcc test.c -O0 -g -lpthread && ./a.out

$ perf record -F 99 -p 320355 -g -e cpu-clock

The result now looks like this:

A more correct result should look like this:

Hi @prim!
Thanks for providing clear repro instructions along with what you expect the output to be.  I was able to get it to build and run and output a .perf file, but then perf chokes on generating the output.
You can see the progress and the output I'm getting here: https://github.com/jlfwong/speedscope/pull/401#issuecomment-1200358447
So, at the moment, I'm stuck. Ideally, if you can identify what I'm doing wrong and figure out how to fix the dockerized output generation, that would be great. Failing that, if you can provide the full output of one of your profiles with the incorrect display in speedscope, that would be a different way of me making progres.
Thanks!

Here's a system wide profile that demonstrates the problem:
profile.out.gz
The DiscoveryClient thread 2614953 is a good choice, here's when the threads are actually on-CPU:

G1 Conc#0 also shows a related issue: for threads that don't have idle time and are only on-CPU time once during the profile the timeline doesn't reflect the entire profile time so you can't compare timelines when switching threads/processes.

Hmm, okay interesting. I think I understand the high level problem, but want to write it out to make sure I understand.
When a thread is idle because the OS scheduler isn't scheduling it either because it's sleeping or blocked on a certain kind of syscall like select, then perf doesn't report any samples about what that thread is doing during that time.
This is problematic because speedscope uses these samples to infer what's happening in continuous time. This isn't specific to perf import, but is a general problem with converting sampling profiles to flamegraphs -- you can't know what happened between samples, but you still need to attribute that time to some combination of the stack before the gap and the stack after the gap. Speedscope opts to attribute half the time to the sample before the gap and half the time to the sample after the gap:  https://github.com/jlfwong/speedscope/blob/6493c5f66f93be1b4f1ea399f7b0ed0cf0111527/src/lib/profile.ts#L512-L548
I'm not sure what the appropriate resolution here is. There are, I believe, two separate issues.

How do we detect that this issue is occurring at all? One option is to estimate the sampling frequency by looking at adjacent sample times, and then if we see sample times that are 10x longer than that (or some other factor we tune), then we know that something is weird.

If we detect it, how do we re-attribute time? Is it not the case that there are blocking syscalls that still cause a thread to be off-CPU that you would want to attribute to the stack that made the syscall?

I haven't checked the documentation or code, the following are my guesses.
The output of perf script is one by one sampling data. The first line of each sampling data consists of thread name, thread ID, timestamp, sampling interval, and sampling events, followed by N lines of function call stack.
grpc-default-wo 4615/4802 [001] 52473.278291: 20408163 cpu-clock:

Therefore, we can know that the sampling interval of @DanielThomas 's output is 0.20408163 seconds, which is 5 samples per second.

I use this little script below to process the output of the perf script and let speedscope render what I think is correct.
Please focus on the with_idle function.
speedscope also has problems when thread names contain spaces. replace_space_in_filename handles this. filename is actually the thread name, sorry.
# encoding: utf8

def split_line(line):
    line = line.strip()
    line = line.replace("\t", "")
    for i in xrange(8):
        line = line.replace("  ", " ")
    ps = line.rsplit(" ", 4)
    return ps

def format_time(begin, now):
    n = int(now - begin)
    minute = n / 60
    second = n % 60
    return "%02d:%02d" % (minute, second)

class Thread(object):

    def __init__(self, id, interval):
        self.id = id
        self.interval = interval
        self.except_amount = int(1 / interval)
        self.stats = {}
        self.min_ts = None
        self.max_ts = None
        self.ts_list = []
        self.cpu_usage = {}

    def handle(self, ps):
        ts = float(ps[2][:-1])
        second = int(ts)
        self.stats[second] = self.stats.get(second, 0) + 1
        if self.min_ts is None:
            self.min_ts = ts
        self.max_ts = ts

    def output(self):
        print "thread", self.id
        print "last seconds", self.max_ts - self.min_ts
        M = self.stats
        e = self.except_amount
        for sec, n in sorted(M.items()):
            r = n * 1.0 / e
            # print sec, n, e, r
            # if r > 0.3 and 0:
            #     print self.id, format_time(self.min_ts, sec), n, e, r
            self.cpu_usage[sec] = r

class PerfScript(object):

    def __init__(self, file_path):
        self.file_path = file_path
        self.thread_names = {}

        self.replace_space_in_filename()
        self.init()

    def replace_space_in_filename(self):
        m = {}
        with open(self.file_path, "r") as rfile:
            for line in rfile:
                if "cpu-clock" in line:
                    ps = split_line(line)
                    filename = ps[0]
                    if " " in filename:
                        m[filename] = filename.replace(" ", "-")

        with open(self.file_path, "rb") as rfile:
            content = rfile.read()

        for k, v in m.items():
            content = content.replace(k, v)

        with open(self.file_path, "wb") as wfile:
            wfile.write(content)

    def init(self):
        with open(self.file_path, "r") as rfile:
            for line in rfile:
                if "cpu-clock" in line:
                    ps = split_line(line)
                    thread_id = ps[1]
                    dt = int(ps[3]) /<PHONE_NUMBER>.
                    self.event_ps = ps
                    self.interval = dt
                    self.thread_names[thread_id] = ps[0]

    def with_idle(self, out_file_path):                                                                                [13/1933]
        lines = []
        dt = self.interval
        thread_last_ts = {}

        with open(self.file_path, "r") as rfile:
            for line in rfile:
                if "cpu-clock" in line:
                    ps = split_line(line)
                    ts = float(ps[2][:-1])
                    thread_id = ps[1]
                    last_ts = thread_last_ts.get(thread_id)
                    if last_ts is not None:
                        while True:
                            diff = ts - last_ts
                            # print "T", diff, dt, last_ts, ts
                            if diff > 0.0 and diff > 2 * dt:
                                last_ts += dt
                                # print "A", last_ts
                                self.event_ps[0] = self.thread_names[thread_id]
                                self.event_ps[1] = thread_id
                                self.event_ps[2] = str(last_ts) + ":"
                                lines.append(" ".join(self.event_ps) + "\n")
                                # lines.append("\t 0x0 [unknown] ([unknown])\n")
                                lines.append("\n")
                            else:
                                break
                    last_ts = ts
                    thread_last_ts[thread_id] = last_ts

                lines.append(line)

        with open(out_file_path, "w+") as wfile:
            wfile.write("".join(lines))

    def stat(self):
        threads = {}
        with open(self.file_path, "r") as rfile:
            for line in rfile:
                if "cpu-clock" in line:
                    ps = split_line(line)
                    thread_id = ps[1]
                    thread = threads.get(thread_id)
                    if thread is None:
                        thread = threads[thread_id] = Thread(thread_id, self.interval)
                    thread.handle(ps)

        for k, v in threads.items():
            v.output()

        ts = set()
        for k, v in threads.items():
            ts = ts.union(v.cpu_usage.keys())

        for k in sorted(ts):
            s = 0
            for _, v in threads.items():
                s += v.cpu_usage.get(k, 0)
            print "total cpu", k, s
            continue
            if s < 0.3:
                continue
            print "total cpu", k, s
            for _, v in threads.items():
                print v.id, v.cpu_usage.get(k, 0)
            print

p = PerfScript("perf.script")
p.with_idle("perf.script.idle")
p.stat()

I'm not sure if other sampling profile tools will not do sampling when the program is idle like perf.
I think some tools will and some won't.
Maybe we just need to deal with perf specially?

In fact, I'm trying to use speedscope to analyze CPU glitches in my program and locate the cause of high CPU consumption in a moment.
Like the stat function in the above python script, I think it is possible to infer the CPU utilization of the program at that time according to the number of perf samples, and then directly tell the user the time of high CPU utilization.

For perf, at least certainly for cpu and cpu-clock events, no detection is required, we know it's a statistical sampling profiler
In terms of attributing time. My profile was taken at 49Hz - for CPU busy periods if you bucket the timestamps by millisecond you'll get around that number.  Off-CPU time is an entirely different concern, just having on-CPU time work hugely helpful on it's own.

Oh, I was wrong. 20408163 refers to 0.020408163 seconds.

Perf has the ability to report context switches too, via perf record --switch-events. If you take that into account, you can visualize off-CPU time properly.
If you additionally do perf record --e sched:sched_switch ... you can also get a callgraph to attribute the off-CPU time to (which is very useful, it will point to e.g. sleep, lock contention, synchronous I/O, pagefaults, ...).


Azure Portal recent resources ADF link is lower casing the ADF name on the URL

Problem - If you have an ADF name of "MyADFactory" and click on it in your Azure Portal recent resources, the name of the ADF is lower cased in the URL causing issues downstream. e.g. /resourceGroups/dripprod/providers/Microsoft.DataFactory/factories/myadfactory
Workaround - If you go through the Azure Portal All Services link the ADF name retains proper casing and everything downstream works properly. e.g. /resourceGroups/DripProd/providers/Microsoft.DataFactory/factories/MyADFactory
Solution - The code that generates the URL in the recent resources list needs to be modified to not lowercase the ADF name in the URL.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 65f81ce0-8915-2390-2c8e-53eb8a93180b
Version Independent ID: 49fb5956-019b-0f5a-ebff-1ae19fe87c80
Content: Rules for naming Azure Data Factory entities
Content Source: articles/data-factory/naming-rules.md
Service: data-factory
GitHub Login: @sharonlo101
Microsoft Alias: shlo

@LuisGonzalezLT
Thank you for the feedback and bringing this to our notice. At this time we are reviewing the feedback and will update you soon.

@LuisGonzalezLT Would you please provide more details about the scenario where you are seeing this (Naming - Case insenstive) as an issue and also the impact?

We have an IF condition that has this in it:
@equals(pipeline().DataFactory, 'MyADFactory')
Due to the lower casing when coming into the ADF through Recent Resources it makes the wrong decision since the name has been translated to "mydatafactory" and does not match.
When we come in through All Services it makes the right decision because the name stays as "MyADFactory"and matches.
The only thing we noticed was different between the two entry points was that the adf name was being lower cased in the URL when entering through Recent Resources. Since the ADF name is case sensitive, it seems to me that lower casing the name in the URL is probably where the issue is.

@LuisGonzalezLT Thank you for the detailed info and bringing this to our notice. To mitigate your issue, we would recommend to use a 'toUpper'  or 'toLower' String Function as below which should resolve the issue. Please let us know if this doesn't work.
@equals(toUpper(pipeline().DataFactory), 'MYADFACTORY')
@equals(toLpper(pipeline().DataFactory), 'myadfactory')
We have provided your feedback to the product team. They will review and take appropriate action.

@LuisGonzalezLT Just wanted to see if the above suggestion (using toUpper/toLower string funciton) helped to resolve your issue?

We had done that already as a work-around but since the ADF names are documented to be case sensitive we wanted to report the issue since the work-around is more of a band-aid versus a real fix. Thanks :-)

@LuisGonzalezLT We really appreaciate your valuable feedback and thank you so much for brining this to our notice. We are working with product team to fix this issue.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue. Thanks :)


Create flucloxacillin quantity measure

Create new measure for quantities on flucloxacillin prescriptions.
Need to agree what we are looking at here - either:

Greater than 5 day prescriptions (PREVIEW) - with aim to decrease % but understand target is far from zero. Guidelines don't really suggest either as preferred duration so likely some push back from this as a metric unless a bigger push on 5 day durations nationally. Preview shows some areas have made progress with this - in particular Nottingham has large change recently - possibly change in local guidelines?
Greater than 7 day prescriptions (PREVIEW) - with rationale that only small proportion should be longer than this. Also need to reference info about usual dosing being 500mg QDS and not 1g QDS - see table below for the data. Preview shows a few outliers but most are probably where you'd expect.

Quantity per item - August 2022 to July 2023
(Will look to add this to a notebook to reference once I have the fix working.)

Quantity_per_item
Count
%

<20 caps
10557
0.3%

20 caps
320221
10.0%

>20 and  <28 caps
2002
0.1%

28 caps
2584972
80.6%

>28 caps
288663
9.0%

In contrast to amoxicillin measure NICE guidelines give a duration range of 5-7 days with no real preference specified for shorter duration. So either 5 day or 7 day (or even 6 day) prescription will be following guidelines.
Looking at PrescQUIPP dashboard, they use stacked bars. These work well here as show % of 5 days, % 7 days and % of other durations. So can hopefully show that for now good in terms of not prescribing longer than 7 days and still allowing tracking of a potential increase in 5 day courses.
https://www.prescqipp.info/our-resources/webkits/antimicrobial-stewardship/optimising-antimicrobial-duration-dashboard-flucloxacillin-500mg-capsules/
In the absence of national guidance promoting 5 day flucloxacillin courses, the 5 day measure might be a little unrealistic. Although quite a few do seem to be making recent progress.
Interestingly the worst performer in 7 day measure is NHS Tameside and Glossop - who appear to have local guidance recommended specifically 5 day courses- https://gmicb-tameside-nhs-abx-guidelines.github.io/#PCcellulitis

NHS EAST LEICESTERSHIRE AND RUTLAND, NHS WEST LEICESTERSHIRE, NHS LEICESTER CITY all have high rates of prescribing >28 capsules with a fairly sudden increase in August 2020.
Local guidelines found here recommend 1g QDS as standard flucloxacillin dosing.

Discussed at clin info meeting 29/04/24. Agree too difficult to interpret due to dosing ranges and variation in indication.


"Error: Access is denied" IE11 on Windows 8-10 with protected mode on

When using creating an instance of UserManager in IE11 on Windows 8-10 with protected mode on an error stating "Error: Access is denied" is thrown.
From the stack trace the error is thrown when attempting to access localStorage. This is caused by the fact that IE11 on Windows 8-10 in protected mode throws this Access Denied exception when any attempt is made to access local storage. There's a screenshot of the error below.

A very similar issue appears to have been raised against TinyMCE here: https://github.com/tinymce/tinymce/issues/4338
It looks like they fixed it by implementing a workaround whereby localStorage is used if available, otherwise sessionStorage is used. I don't know if that could be used here too or if there is some reason this wouldn't work for this library.
If anyone can look into this it would be super appreciated. I'll be taking a look too but i'm not familiar with the code base so not sure how much luck i'll have.
Thanks

@M4sterShake Hey, issue with window.localStorage has been resolved in the latest version of tinyMCE 4.8.2

Yes we still have the branch allowing the silent login to be used from a URL that isn't subscriber.icis.com , but we can surely merge the latest upstream into our fork

@suriya-n was just saying it's been fixed in tinyMCE. It's still an issue in oidc-client as far as I'm aware. I've applied the same fix that was done in tinyMCE which appears to fix the issue. I'll raise a PR as soon as I get a minute.

I'll give you some back story -- we use localStorage for the protocol request state because in IE if you use sessionStorage it flushes it when the browser navigates away from the current domain. No other browsers do that. So if localStorage and sessionStorage doesn't work, you're left with indexedDb or a cookie, and IMO a cookie is the wrong way to go.

Ahh, in that case the tinyMCE fix isn't going to resolve the issue unfortunately as that just uses sessionStorage if localStorage throws an Access Denied exception. What do you think about falling back to cookies if localStorage isn't available?

Cookies send their data to your server. SPAs don't have servers, and I don't like leaking sensitive values out to your server (think CDNs). I don't see the security feature behind browsers nerfing storage. DO yuo know what their rationale is?

 Maybe indexedDB is the way to go then. Seems like a lot more work though. I don't know the rationale behind it unfortunately. Isn't it part of Microsoft's mission statement to make sure IE is always at least a bit non standard? :P

There's already an abstraction around it via the storage API internally.

In my organization we have spent a lot of hours working with this issue, which seems to be a timing issue in IE11, combined with ungraceful handling of localStorage access from the oidc-client library. Because the initialization of the oidc-client library doesn't try/catch the localstorage access, it crashes if localStorage access is denied.
We have two similar applications, one using angular-auth-oidc-client and one using oidc-client.js. The former works fine, but the latter fails due to localStorage access.
Our application fails when the oidc-client library is imported into the application, and it fails on oidc-client.js -> var Global = function() .... ->
key: "localStorage",     get: function get() {         if (!testing) {             **return localStorage;**        }   }
It fails when the integrity level on the folder where localStorage is stored is "high", which can be the case for certain computers in organizations with a certain computer setup and strict polices.

I can certainly put some error handling around it.

So it's funny -- I came into to see what I could do about this issue, and I re-tested IE11 with the sessionStorage cross-domain redirects and it's now working. So something must have changed such that they do not purge sessionStorage as aggressively as they used to. Unfortunately, Edge still has the old behavior, so it still purges sessionStorage.
So, what's to be done? I was hoping to change the defaults to sessionStorage so it would work everywhere, but obviously that's not going to fly. So... perhaps in your scenario you can detect IE11 and configure it to use sessionStorage for this... whereas the other browsers you use the default?
To change the behavir you'd add this when creating the options:
var options = {
   // other values...
   stateStore = new Oidc.WebStorageStateStore({ store: Oidc.Global.sessionStorage }),
}

I think that would do it for you under IE.

@Deltids --

Our application fails when the oidc-client library is imported into the application, and it fails on oidc-client.js -> var Global = function() .... ->
key: "localStorage", get: function get() { if (!testing) { return localStorage; } }

Where/when does this throw? When localStorage is accessed? So you mean in the get method?

When we access the site, during loading. On the first import of the oidc-client library, it fails on that function. We traced the line and character number in the main.......bunde.js-file

@Deltids -- again, I went into to try to address this, and the exception is being thrown from a ctor. I think the only way to deal with this is for your top level code to wrap the new UserManager call in your own try/catch. Unless you have some better ideas, I don't see a way to make this cleaner. Sorry.


Fix some docblock return types and namespaces

This was fixed indirectly by merging #1573 - sorry, @dave1010!


Unable to unlock shift/cmd modifiers on MacOS

Normally with the standard WoW client on Mac you can use
"defaults write com.blizzard.worldofwarcraft disable-expose-fix -bool YES"
This will allow for shift modifiers to work with my Razer Naga. How would I go about fixing this with this client?

Sorry for not answering your issue.
Were you able to solve the issue?

Sorry for not answering your issue. Were you able to solve the issue?

Unfortunately no. This issue still exists

Oh okay, how can I test the issue?
Just bind an action to SHIFT+E?

Correct, shift anything, control+anything on Mac OS

And inside your razor menu for your mouse you bound "Control+E" onto a single button for example?

I also have a razer naga (pro).
I used defaults write com.blizzard.worldofwarcraft disable-expose-fix -bool YES inside the terminal and it seems to work for me.

I also have a razer naga (pro). I used defaults write com.blizzard.worldofwarcraft disable-expose-fix -bool YES inside the terminal and it seems to work for me. (Tested it with SHIFT+3 and CONTROL+3)

Awesome, I just did the same and that worked XD ty!

Great 😄


⚠ Jenkins Plugins Artifactory has degraded performance

In fa2abd2, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 2853 ms

Resolved: Jenkins Plugins Artifactory performance has improved in d1c0a2b after 15 minutes.


Makefile: use a specific template for mktemp files

Before this patch, we would hit a controller-gen bug when the temporary file would be of the form tmp.0oXXXXXX. This patch uses a custom mktemp template that will not trigger the bug.
See this CI run for an example of a failure triggered by the issue.
Tested by replacing the first two X from the template by 0o and running make manifests.

This is to update temp file names convention, I have verified this change locally, GHA jobs are all good.
Marking this ready to merge.


positioning of grids

When I enable the grids, they are placed away from the origin (0, 0, 0) by 120% of the model's biggest dimension (XY and YZ to the negative half of Z and X, whereas XZ to the positive half of Y).
I understand the convenience of this default setup, but I'd like to be able to adjust their offsets from the origin (e.g. place them right at the origin), so that I can track key dimensions of my model.
Is there a way to do it? If not, would it be possible to add such parameters to the viewer screen or the settings?

This has to do with clipping. I invested a lot of time to get clipping with caps faces working when the space (with the grids as boundary) is not symmetric. But there was no way to get that working. The only way it finally worked was with the scene being symmetric around the origin or center of the object.
btw. if you click the Axes@0 button the grid toggles from being centered around the origin (0,0,0) to being centered around the object center

@sgtkt Does using Axes@0 fix your problem?

Unfortunately, no, it just moves the axes, but not the grids.
I wanted to be able to place the grids anywhere I want and use them as a ruler, or at least use the XY grid at Z=0 position as the floor, same way as in the 3D printer slicer SW.

Did you try center_grid=True ?
b = Pos(3,0,0) * Box(1, 1, 5)
show(b, center_grid=True)

Yes, it's exactly what I wanted. It would be great if you could add this parameter to the settings, so that it can be enabled by default. Or feel free to close this issue as a duplicate of #60.

Have you tried set_defaults(grid=(True, False, False), center_grid=True, transparent=True) at the top of your script?

Yes, I'm aware of this option, but don't want to use it because I have many independent code files, and I don't want to spoil them with code that is not relevant to their purpose and change all of them one-by-one whenever I decide to tweak something. I'm really happy that it's possible to control the visual representation and behavior of the viewer via the settings.
By the way, it'd be great if there also was a setting for 'reset_camera', so that I don't have to put it in the show() function all the time.

The split between vscode settings and set_defaults is by intention. Things that can break show or that are most probably model specific are only available via set_defaults.
How about having a config.py with set_defaults that gets imported into all other files?

It's great that there's a way to make the viewer parameters project/model specific, and I use it sometimes, although I prefer to add such parameters in show() rather than set_defaults() (are there any differences?).
If there were no VSCode settings, I would have ended up with something like 'config.py' as a 'base' configuration. But, since we have 2 options, it makes no sense to use both at the same time, keeping some of the base parameters in VSCode settings and some in the config file.
Some settings like 'grids' or 'dark mode' can be seen more like user's personal preferences, and settings like 'measurement tools' or 'reset camera' I would just enable by default and never change further. In both cases it would be more logical to put them to the settings rather than the code.
This is just my personal feedback, and I would have no problem if you decide to keep it as it is now. There are plenty of options already.)

@sgtkt I will add centergrid to the workspace config, such as grid_XY, ... in the next release

added in 2.4.0


Just winpty is in just environement

On windows, when you run a just command, it acquires a TTY using winpty if you need one. This happens too late and the just environment is already loaded. At this point all of the {PROJECT_NAME}_* env variables are set, and so the "set if unset" doesn't override values when you change the .env file.
This will make changing env variables buggy, requiring you to restart your shell.
Have you observed this @drewgilliam ?

I don't think I've seen this - I thought the winpty was permanently applied when you sourced the setup.env file, not when you ran a just command (maybe I'm using older just projects, and the setup.env is no longer necessary)?
I tried on a just project - I successfully change variable values in the {PROJECT_NAME}.env file and the changes appear to be applied...

When you run just/juste, it runs a tty check the first time, and caches the result in JUST_IS_TTY so that is is only ever checked once (speed reasons, also less likely to have a bug where you end up creating a winpty every time, that would be bad.) The problem was the environment was loaded before this check, so the winpty inherited all the exported variables. Since everything in {proj}.env only sets unset variables, since everything was set, they did not update correctly, as reproducible by these following steps:

curl -LO https://raw.githubusercontent.com/VisionSystemsInc/vsi_common/master/linux/new_just
bash ./new_just
cd external/vsi_common
git checkout b2a144b36aa8653afda7b1673cbfc96541d43fac # Today's master
cd ../..
edit {proj}.env and add : ${BAR=15}
. setup.env
declare -p BAR # Unset, not in winpty yet
just --wrap declare -p BAR # Now I'm in winpty
declare -p BAR # set!?
edit {proj.env} and change to 16
just --wrap declare -p BAR # Still 15 :(

At any rate, I've already fixed this. 👍


Adapt iree/compiler to the reordered mmt4d dimensions

I added @GMNGeoffrey because there's an infra aspect here: this is adapting to a breaking change in third_party/llvm-project. For now I've pushed my local branch as-is including my commit updating the third_party/llvm-project repo reference bump. Once the LLVM commit is merged upstream ( https://reviews.llvm.org/D109692 ), we should be able to drop that aspect and land this PR on the "integrate" branch, right ?

Will IREE break if LLVM is updated without this? In that case you need to send a patch internally to be included as part of LLVM being updated. I can send you the details directly

I added @GMNGeoffrey because there's an infra aspect here: this is adapting to a breaking change in third_party/llvm-project. For now I've pushed my local branch as-is including my commit updating the third_party/llvm-project repo reference bump. Once the LLVM commit is merged upstream ( reviews.llvm.org/D109692 ), we should be able to drop that aspect and land this PR on the "integrate" branch, right ?

That is not the workflow. You need to land your LLVM patch. That will make it into Googles code base when the entire LLVM changes are pulled in. At that point this change is available on the google branch of IREE. Then there is a merge from google -> main that will be done by the IREE build cop. At that point the change is available in main and you can land this change.

Thanks for your comments! @GMNGeoffrey help me 1:1.
I have put the present changes in cl/396406856 .
My understanding is I'm waiting on you to grant review on https://reviews.llvm.org/D109692 , then it will appear on  the integrate dashboard, and I'll be able to reference the above CL there?


Language issues [No default align-model for language: gu]

Error :
Detected language: Gujarati
100%|██████████| 8533/8533 [00:16<00:00, 512.95frames/s]There is no default alignment model set for this language (gu).                Please find a wav2vec2.0 model finetuned on this language in https://huggingface.co/models, then pass the model name in --align_model [MODEL_NAME]

ValueError                                Traceback (most recent call last)
 in <cell line: 8>()
6
7 device = "cuda"
----> 8 alignment_model, metadata = whisperx.load_align_model(
9     language_code=whisper_results["language"], device=device
10 )
/usr/local/lib/python3.9/dist-packages/whisperx/alignment.py in load_align_model(language_code, device, model_name)
51             print(f"There is no default alignment model set for this language ({language_code}).
52                 Please find a wav2vec2.0 model finetuned on this language in https://huggingface.co/models, then pass the model name in --align_model [MODEL_NAME]")
---> 53             raise ValueError(f"No default align-model for language: {language_code}")
54
55     if model_name in torchaudio.pipelines.all:
ValueError: No default align-model for language: gu

Not all languages are supported right now, I'm actively working on supporting more languages

I am also willing to contribute for the same.
Just wanted little guidance.

Can you tell me how many languages are supported right now?

Right now word timestamps are generated using WhisperX, languages that are not supported in whisperx can be generated using Whisper Dynamic Time Warping, you can find tutorals for that on the original whisper repo, and supported languages are in the code

mn = "skylord/wav2vec2-large-xlsr-hindi" #@param
alignment_model, metadata = whisperx.load_align_model(
language_code=whisper_results["language"], device=device, model_name=mn
)
I have changes this line
it is used to take language specific model from hugging face
there are many language model available for many languages there
take model name from there that suits your language and put it in mn variable
and continue running...
WER will vary according to model you choose

@alloc7260 Hello, all languages that are supported in whisper are supported in the code now


[Feat]: Created Issue forms and made the issue options more visually appealing

This PR solves the issue #166

Added Issue Forms to the respective issues to make it easier for the contributor to raise it.

Screenshots of Result:

Issue Templates:

Bug report (example):

@TonyStark-47 merged!


Bug: Canvas doesn't look like I expect it to from the README

The README makes me expect that the canvas will look like this:

But instead I've found it looks like this:

I actually don't mind too much but it doesn't seem this is intended from the README

Hmm, groups also have the same effect.
Also this makes it so that it's hard to click on the handle to draw an arrow from a note that has an existing arrow on the same note FYI

there should be a much more stable version live now, sorry about that!


Basic Linux and Windows Thread Prioritisation for worker threads

This PR implements basic thread prioritisation on Linux and Windows and fixes a bug in dispatch_get_global_queue where the wrong QOS type is used.
Note that this only sets the initial thread priority by translating QoS to thread priorities. Relative priorities are ignored for now.  Later QoS overrides and other priority adjustments have no effect.
See the comments for implementation details.
Result on Windows
#include <stdio.h>
#include <windows.h>
#include <dispatch/dispatch.h>

int main (int arg,char **argv)
{
    void (^myBlock) (void) = ^{
            PWSTR desc;
            HANDLE current = GetCurrentThread();
            int prio = GetThreadPriority(current);
            GetThreadDescription(current, &desc);
            wprintf(L"priority %d descr %ls\n", prio, desc);
            LocalFree(desc);
    };

    dispatch_queue_t backgroundQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_BACKGROUND, 0);
    dispatch_queue_t utilityQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_LOW, 0);
    dispatch_queue_t defaultQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_DEFAULT, 0);
    dispatch_queue_t highQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_HIGH, 0);

    dispatch_async(backgroundQueue, myBlock);
    dispatch_async(utilityQueue, myBlock);
    dispatch_async(defaultQueue, myBlock);
    dispatch_async(highQueue, myBlock);

    dispatch_main();

}

hugo@YellowBox MSYS /tmp
# ./a.exe
priority 0 descr com.apple.root.default-qos
priority -1 descr com.apple.root.utility-qos
priority -4 descr com.apple.root.background-qos
priority 1 descr com.apple.root.user-initiated-qos

Result on Linux
#include <stdio.h>
#include <dispatch/dispatch.h>
#include <pthread.h>
#include <sys/resource.h>

int main (int arg,char **argv)
{
    void (^myBlock) (void) = ^{
	    int prio = getpriority(PRIO_PROCESS, 0);
	    printf("block with priority %d \n", prio);
    };

    dispatch_queue_t backgroundQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_BACKGROUND, 0);
    dispatch_queue_t utilityQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_LOW, 0);
    dispatch_queue_t defaultQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_DEFAULT, 0);
    dispatch_queue_t highQueue = dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_HIGH, 0);

    dispatch_async(backgroundQueue, myBlock);
    dispatch_async(utilityQueue, myBlock);
    dispatch_async(defaultQueue, myBlock);
    dispatch_async(highQueue, myBlock);

    dispatch_main();
}

block with priority 2
block with priority 0
block with priority 10
block with priority -2

We can probably move all platform-dependent thread prioritisation logic into a new function like _dispatch_set_priority() (analog to _dispatch_get_priority(). This function sets the TSD slot __TSD_THREAD_QOS_CLASS on Darwin, setpriority on Linux, and SetThreadPriority on Windows.

@compnerd @lxbndr would be great to get your thoughts on this. 🙏


Amazon cloud player in Chrome not working...

Hi!
The amazon cloud player scrobbling stopped working. The plugin is not recognizing that a song is playing. I am using german amazon cloud player...
Any ideas?

Duplicate of issue #835 which pull request #838 resolves.

It's not working for me either. I get the "is it already playing?"-link in the dialog window. it doesn't look resolved to me..?

I had to change the amazon.js file in my chrome extensions folder, then clear all cache and restart Chrome a few times, but then it worked fine!

How do I add the code mentioned above?

@Belonogast do you care to elaborate?  @hilgi I'm in the same boat as you and @Zylinderkatze  - It says that it has been fixed, but it's still not working for me.  I know how to find the developer page in the Chrome extensions, but if there's a change I have to make in there, I don't know what that is.  I'm thankful for you all with the knowledge, because coding is beyond me.

@brarig219 it's still not working for me and I assume (maybe wrongly) that it's because I'm on amazon.de not amazon.com? not sure whether the chrome plugin expects / requires a ".com".
This is the path that I play the music from:
https://www.amazon.de/gp/dmusic/cloudplayer/web/
..on which scrobbing is still not working.

@Zylinderkatze I just removed the app, shutdown Chrome and rebooted my PC, when I reinstalled it, everything works fine.

@hilgi I did exactly that and it's still not working.
(Song Playing but not Scrobbing)
..on amazon.de


Upgrade blake2b_simd dependency

Motivation

We want to update our blake2b_simd dependency to a later version. However we want to wait until orchard updates its own dependencies.
Related Work
See https://github.com/ZcashFoundation/zebra/pull/3086#pullrequestreview-812814725

Merged with #3094, because they have to be done together.


Support --overwrite options

Fixes https://github.com/maxogden/electron-packager/issues/39
Problem does not appear on Windows.
Tested on Mac. Would appreciate anyone to try this on linux.

@tengyifei could you please rebase and squash into one commit?

Done.

Any update on when this could get merged?

It should probably have been noted that this PR never touched the windows code path...
I will have this resolved for all 3 centrally in index.js on the branch that I PR once I figure out rebasing it.


SSH Client / Terminal emulator

What do you think about the integration of a terminal emulator for console work?

see these instead

https://atom.io/packages/atom-terminal
https://atom.io/packages/atom-terminal-panel
https://github.com/atom-archive/terminal (not maintained)

Sorry, but as far as I've seen, these are no emulators. These serve the native console of the operating system.

I'm not the maintainer of this project. I think it's a great idea, although perhaps as a separate package that tied into this one? Maybe you should start it up.
I for one wouldn't be able to spend time on a project like that. The black-screen project might be of interest to you, it is also built on Electron (atom shell).


added a few more images

👷 Deploy Preview for waterfrontiers processing.

Name
Link

🔨 Latest commit
8ab6dbd376f3e0ec911eaad33eb48140791973d9

🔍 Latest deploy log
https://app.netlify.com/sites/waterfrontiers/deploys/653910b327207f0008fc14bd


Removing package restore from csproj

Can one of the admins verify this patch?

Hi @dragonfly91, I'm your friendly neighborhood Azure Pull Request Bot (You can call me AZPRBOT). Thanks for your contribution!

This seems like a small (but important) contribution, so no contribution license agreement is required at this point. Real humans will now evaluate your PR.

TTYL, AZPRBOT;

add to whitelist


React Native, pnpm: Unable to resolve module @tanstack/query-core

Describe the bug
Using react query with react native and pnpm, I am presented with the error message that @tanstack/query-core could not be found. It is indeed missing in node_modules. If I add it manually, I get the same error message for use-sync-external-store.  As it seems, both are listed as direct dependencies in the package.json of @tanstack/react-query.
This happens regardless of v4 or v5.
If i add both packages manually, I get another error:
Class private methods are not enabled. Please add `@babel/plugin-transform-private-methods` to your configuration.

I can go on with this chain of adding and installing packages, but as this is not mentioned anywhere in the docs, I suppose it is not the expected behavior.
Your minimal, reproducible example
https://github.com/saaymeen/react-query-pnpm-react-native-issue
Steps to reproduce

Clone Repo
pnpm i
pnpx pod-install
pnpm ios

Expected behavior
App builds, bundles, creates a query client and renders the welcome page. Instead, an error message about missing imports is shown.
How often does this bug happen?
Every time
Screenshots or Videos
No response
Platform

MacOS Sonoma 14.3
<EMAIL_ADDRESS>@tanstack/react-query v4 or v5 does not matter
<EMAIL_ADDRESS>iOS Simulator

Tanstack Query adapter
react-query
TanStack Query version
5.24.8
TypeScript version
4.8.4
Additional context
No response

It's doubtful that v4 and v5 yield the same experience. use-sync-external-store is only needed in v4. The "private fields" error can only be in v5 because we only use private fields in v5. The requirements are documented here: https://tanstack.com/query/v5/docs/framework/react/installation#requirements
if your environment doesn't support private fields, you have to transpile the source yourself.

As it seems, both are listed as direct dependencies in the package.json of @tanstack/react-query

a package manager should install dependencies of a lib. Yes, @tanstack/react-query depends on @tanstack/query-core. There is nothing we can do if the dependency defined in package.json isn't installed for you for whatever reason.

also your lock file shows that query-core is there:
https://github.com/saaymeen/react-query-pnpm-react-native-issue/blob/6a49c95ebd0af8783f6ee97dbfed89a849185fa2/pnpm-lock.yaml#L1939-L1941

“private fields”错误只能出现在v5中，因为我们只在v5中使用private fields。"
I can't find support older browsers tips in vue doc


Propose new settings.json UI for both UI and json

Something like this

This would actually look cool I second this.

If you want, you can already open the settings editor and the json editor side by side, it looks like that is what you are looking for.

@roblourens No I was specifically want this to be accessible by open from settings menu
It was a struggling to open setting UI and then find a way to open the settings.json when the UI was set as the default editor. Selecting any one of it as default editor make it hard when we need to switch to other. This UI better be merge into one

@roblourens Please reopen

It's an interesting idea I am not planning on building a hybrid UI like this right now.

@roblourens It's fine if it's not right now but that's the reason why it should be kept opened as issue. You can put it on a backlog or something but not closing it. We could also let people discussion about it while it opened too

@roblourens And seriously, you close it for 3 days means even if it opened again, it would got pushing to to bottom or next pages. New issued has been piled up on mine
Fine. I think I will make new one. You can do anything about this issue. Close it or delete it as you can see. I will keep making this issue as long as you keep closing

You shouldn't be salty just for an issue being closed. It got considered, the developer has said no, let's just all be at peace, please. I like this idea too, but it's not fair to force it onto the developer(s)
Perhaps this could be an extension which forces both to pop up? Idk, but the "workaround" is there.

@beastdestroyer Just because issue kept open does not mean it was forced anyone to do it. But it means it not rejected because some very serious
If the individual developer just not want to do it then it could be push into some appropriate tag. And there could be someone pick it up sometimes, if it still opened and got some interest, such as upvoting
But this issue just got closed in under a day. Not even a week. While there was 5000+ issue still opened for years. This is really an unjustified hurry closing without any consideration
Seriously he got tagged and come look this issue and just close it in 12 minutes without really having discussed anything with me at all
The setting windows is very crucial, even it not frequent. It should not rely on workaround hacking by extension. It should be better

@Thaina, you might be interested in the history in this feature area, there has been a huge amount of discussion about the settings editors already, and if you search around you will find many issues. Here is one issue which I've left open for discussion - https://github.com/microsoft/vscode/issues/68386. Feel free to join the discussion there, but I'm not going to argue about this particular issue.

@roblourens Having any long discussion is not justified the result that it still not good and have much room for improvement. Did you remember when you change the color icon to yellow? You guy need to write a whole block describe the reason why you think it should be orange then need to apologize for changing it
And if you don't want to argue then JUST STOP CLOSING MY ISSUE and told any people who tag you to NOT EVER TAGGING YOU AGAIN period


HDXDSYS-1038 Fix for TCD population dataset change

TCD seems to no longer have adm2 data https://data.humdata.org/dataset/cod-ps-tcd
I've also made a trivial change to reverse the order of the number of datasets and number of resources checks in tests as it seems more logical to me to have number of datasets first.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>9
Details

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 93.067%

Totals

Change from base Build<PHONE_NUMBER>2:
0.0%

Covered Lines:
1517

Relevant Lines:
1630

💛  - Coveralls


Setting { transaction: false } on one migration disables transactions in all migrations

Environment
Knex version: 0.21.3
Database + version: Postgres 9.6
OS: macOS Mojave
Bug
Expected: Any migration that does not have exports.config = { transaction: false } should be subscribed to a migration
Actual: Setting exports.config = { transaction: false } in one migration results in the transaction being disabled for all following migrations

Please add reproduction. How are you selecting different config for different migrations?

I'm still running into this issue.
Knex: 0.95.6
Postgres: 11
OS: osx 10.15.7
exports.config = { transaction: false };

exports.up = async function (knex) {
  await knex.raw(`
    CREATE INDEX CONCURRENTLY IF NOT EXISTS foo on bar;
  `);
};

exports.down = async function (knex) {
  await knex.raw(`
    DROP INDEX IF EXISTS foo;
  `);
};


Switch to Testcontainers Oracle Free.

Also moving to the faststart label, hoping it will start less slow.
Closes https://github.com/spring-projects/spring-data-relational/issues/1665

Merged


Create Moloch v3 Macro Elements Package and Vault Card Component

Vault card

pass menu items prop

Description
A collection of macro elements to help spin up DAO app quickly. EX:

Proposal card
Proposal list

This will require a lot of

moving components out of the admin app
refactoring to nto use moloch v3 context
moving helper utilities into appropriate helper packages

TODO

Walk through admin app to define these.

QUESTIONS

Can these depend on hooks for data or should they be passed all relevant data in props?
Should micro elements be in a separate package?

https://hackmd.io/34kbawCEScKDzNbFC7AaTw

2 hours


Planning Ticket  CUDA 9.2 + cuDNN 7.1

Updated 02-JUNE-2018
I have done some testing with CUDA 9.2/cuDNN 7.1.4/NCCL 2.x with tf_cnn_benchmarks.
Below you will see that if you upgrade to cuDNN 7.1.4 and a newer device driver you get some pretty nice gains and no need to compile from source as well as using CUDA 9.0.  Compiling from source and using NCCL 2.x (Hierarchal Copy was almost the same) I was able to get 6,800+ 8xV100s ResNet50v1 FP16 with synthetic data and about 6,500+ real data sustained over a full run for under 5 hours.
I suspect many of you saw NVIDIA announce 1K and 1.3K for 1xV100 ResNet50.  That was with unreleased libraries and we are working to ensure we can hit those numbers when the libraries are available or with our own tricks.
I apologize for any short hand I use below in describing the runs.  I am happy to answer questions or make clarifications.  This testing was slightly informal but recent full scale testing yielded similar results.
CUDA 9.0
[Recommended driver] 6,197.70 CUDA 9.0 + 384.13 (v1.8.0-1386-g2dc7575) hierarchical copy
6,620 CUDA 9.0 + 390.59 (v1.8.0-1386-g2dc7575) NCCL
6,613.11 CUDA 9.0 + 396.26 (v1.8.0-2215-gf528eba) NCCL
6,564.9 CUDA 9.0 + 396.26 (v1.8.0-2215-gf528eba) hierarchical copy
6,541.25 CUDA 9.0 + 390.59 (1.9.0.dev20180523) hierarchical copy
6,276.02 CUDA 9.0 + 384.13 (1.9.0.dev20180523) hierarchical copy
6,197.70 CUDA 9.0 + 384.13 (v1.8.0-1386-g2dc7575) hierarchical copy
CUDA 9.1
[Recommended driver]  6,227.64 CUDA 9.1 + 390.59 (v1.8.0-2215-gf528eba) hierarchical copy
6,210.28 CUDA 9.1 + 396.26 (v1.8.0-2215-gf528eba) hierarchical copy
6,118.21 CUDA 9.1 + 396.26 (v1.8.0-2215-gf528eba) NCCL
CUDA 9.2
[Recommended driver]  6,696.39 CUDA 9.2 + 396.26 (v1.8.0-2215-gf528eba) NCCL
6,606.57 CUDA 9.2 + 396.26 (v1.8.0-2215-gf528eba) hierarchical copy
6,738.32 CUDA 9.2 + 396.26 (v1.8.0-2215-gf528eba) NCCL SGD
Full test runs with CUDA 9.2
top_1 ranges between 75.7% and 76% and does not seem to be based on the hyper parameters.  I was focused on testing NCCL vs. hierarchical copy.  I have a minor concern about my validation command, but this is still good info.
Hierarchical copy:  6441.64  Accuracy @ 1 = 0.7584 Accuracy @ 5 = 0.9267 [49920 examples]
NCCL (repacking:2):  6490.62  Accuracy @ 1 = 0.7572 Accuracy @ 5 = 0.9265 [49920 examples]
NCCL (repacking:8):  6490.62  Accuracy @ 1 = 0.7582 Accuracy @ 5 = 0.9268 [49920 examples]
My first hierarchical copy run was 76% exactly.
Note:  I would like to move to CUDA 9.2 as the default but the driver is not widely available for easy apt-get install.  I am working long-term to get the build team to support a secondary CUDA build.  I am also very open to feedback as I do not see any easy path forward to moving to newer CUDA versions faster.  You can always (usually) install a new cuDNN.  We are compiling with 7.0 but you see gains by installing 7.1.4 as you see above if you upgrade your driver.

Thank you for your post. We noticed you have not filled out the following field in the issue template. Could you update them if they are relevant in your case, or leave them as N/A? Thanks.
Have I written custom code
OS Platform and Distribution
TensorFlow installed from
TensorFlow version
Bazel version
CUDA/cuDNN version
GPU model and memory
Exact command to reproduce

Great! I was able to build TF with the configuration below but the biggest roadblock is to get a version of TensorRT that works with anything above 9.0 hopefully TensorRT 4.1 comes right in time for this r1.9
OS Platform and Distribution: Lubuntu 17.04
TensorFlow installed from Source
TensorFlow version r1.8
GCC version 7
Bazel version 0.12
CUDA/cuDNN version 9.1/7.1
NCCL 2.1.15
TensorRT None
GPU model and memory Dual GTX1080Ti + GTX980Ti

When 1.9 release can be expected, at least approximately?

1.9 had a code cut off of 31st May.  It normally takes 1-2 weeks to verify the RCs and let them "bake".  CUDA 9.2 will not be in 1.9 as the default due to CUDA 9.2 not being public yet and in my opinion the device driver is too new and still not available for Debian although you can get it for Ubuntu as "beta".  I am hopeful NVIDIA is making some changes that will reduce this pain.
@SephirothFFKH   I am just getting more involved in including TensorRT.  I did the testing for the NVIDIA "launch" but that was very one off.  Thank you for the info on versions working with 9.2.

1.9 has a code cut off target of 31st may.  It will not have CUDA 9.2 as the default due to 9.2 not being public yet and the device driver needed is just too new and not in Debian yet.  I am hopeful NVIDIA will resolve the device driver lock for CUDA releases later this year.  Moving CUDA versions forward is always my desire but I worry about abandoning people that cannot upgrade.  I worry more when I see the driver isn't even available on LTS editions of Linux yet.
@SephirothFFKH  Thank you for the TensorRT info.  I did the initial perf tests for the launch and I am about to start getting more involved again.  I hope we can smooth this out.  I did see some PRs (open source) that make TensorRT easier to use and hopefully even more seamless.
I appreciate all the comments, I like knowing what is happening so I can try to make things easier to use.  Keep them coming.

@tfboyd Thanks for clarification! So 1.9 will be shipped with CUDA 9.0 or at least switch to 9.1 could be expected?

CUDA 9.2 GA is just released and support official driver of course
FYI

I can't find cudnn for cuda 9.2 windows

I am trying to build tensorflow with cuda 9.2. Although cudnn doesn't support cuda 9.2 officially.

@K3n4
@achalshah20
cudnn also just been released
cudnn 7.1.4 for cuda 9.2

@alanpurple Thanks!

@alanpurple Thanks,
Is it possible to build tf with this configuration ?

@K3n4
I'll skip that one until 1.9rc
as a developer it's not a good timing for trying those, since 1.8 has many compiling issue( intel MPI support for example)
and 1.9 will come with prebuilt binary for cuda 9.2 and cudnn 7.1(so compiling will be promising), and mpi-support issue fixed
1.9rc are planned to come within 2 weeks as far as I know
so I recommend you also wait for 1.9rc

You've missed CUDA 9.1 and now decide to simply skip it? People will never be able to switch from CUDA 8.0 if the support for CUDAs 9.x among ML algos is so randomly scattered among these 3 versions (and counting)...

Yes, Tensorflow 1.7 can be built against CUDA 9.1 and CuDNN if you have 1-2 hours per each try and don't want automated builds (e.g. for Docker). Here's how to do it, dear Tensorflow team.

But wait, there's more: TinyMind prepared a comprehensive set of pre-compiled Tensorflow wheels, including those for CUDA 9.1. Make sure to star their hard work.

@mirekphd  no i'm using 9.1 to build tf-gpu 1.8 and i'm using it
i'm skipping 9.2 for 1.8, waiting 1.9rc

@alanpurple, if you have a working wheel for TF 1.8 compiled under CUDA 9.1 and CuDNN 7.1.2, than consider contributing it to TinyMind, they seem to be missing 1.8

@Harbing: try to
apt install protobuf-compiler

as it helped others here

@mirekphd, unfortunately there is no CUDA 9.2 build there.  To sum up, the problem is that Nvidia is pointing users to install CUDA 9.2, but the available builds are 9.0 compatible only.  It seems that the only solution is either downgrade to CUDA 9.0 (could use some help here, I couldn't find a simple way in Nvidia's site) or to compile Tensorflow from source.

It was just released a couple days ago.  There are a few problems:

It shipped day one with a patch
the device driver is very new  396.26 is needed. Ubuntu does not have it in their repo just yet and it will be a while before Debian has it even in experimental.  The DGX-1 also does not have a driver that supports it.

Not sure who will read this, but I am concluding that we should roll out TensorFlow with 9.1 as the default, which seems to be stable with ~4 patches you have to apply.  The downside is the NVIDIA download site for cuDNN does not list 9.1 but I think you can just use cuDNN based on 9.0 and that is just a typo.
Very much welcome feedback.  Keep in mind the target audience is a wide range of people and upgrade to a device driver released just a few years ago as a requirement to install TensorFlow is a little steep.
I would also like feedback on this idea:  I would like to have a second "cutting edge" build that is linux only to reduce the amount of resources needed to test and deploy.  Likely linux + python 2.x.  This will be really vital to many of you when we start playing with CUDA 10.  I am not aware of anything huge in CUDA 9.0 to 9.2 that is amazing but with data as proof I could be very wrong.

upgrade to a device driver released just a few years ago

I think you probably mean "days", not years, right? :-)
Another side of the story might be that people who right away upgrade to the newest TensorFlow version are cutting-edge anyway and also don't mind upgrading to the latest device driver.
I do believe that there's a significant portion of people that like to live on the "edge" and have the latest stuff, particularly with respect to CUDA version.

have a second "cutting edge" build
I do like the idea about that. Would be nice if there was a Windows build too though. Doesn't have to be for all Python versions etc., just the latest would be fine, to reduce the number of builds needed.

But why would you use python 2.x for that? There's not really much "cutting edge" about that. I don't think I even have python 2.x installed anymore.

@tfboyd cudnn 7.1.4 for cuda 9.2 is link to *_92.dll and for 9.0 use _90.dll. It is not typo, nvidia delete all cudnn 7.1. for cuda 9.1 download link except for Linux (Power8/Power9) with 7.1.2.
@patrikhuber
Here is tensorflow-gpu1.8.0 with cuda 9.2, cudnn 7.1.4 for windows, and this repo contain tensorflow with python2 for windows.
https://github.com/fo40225/tensorflow-windows-wheel/tree/master/1.8.0/py36/GPU/cuda92cudnn71sse2

@fo40225 Thanks for this wheel, I am able to install it under Anaconda 3.6 Python on a dual-1080 Ti machine with the latest official CUDA 9.2 driver 397.93, and run Keras R.

@fo40225 Thanks for your answer , it works for me.

Finally a tutorial on How to install Tensorflow GPU with CUDA 9.2, cudnn 7.1.4 and NCCL 2.2 for python on Ubuntu

@arunmandal53  I try this tutorial on ubuntu18.04，Failed。

@fo40225 I installed tensorflow-gpu1.8.0 with cuda 9.2, cudnn 7.1.4 for windows but i still get this error message when importing tensorflow:
Traceback (most recent call last):
File "C:\Users\royba\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\platform\self_check.py", line 75, in preload_check
ctypes.WinDLL(build_info.cudart_dll_name)
File "C:\Users\royba\AppData\Local\conda\conda\envs\tensorflow\lib\ctypes_init_.py", line 348, in init
self._handle = _dlopen(self._name, mode)
OSError: [WinError 126] The specified module could not be found
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\royba\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow_init_.py", line 24, in
from tensorflow.python import pywrap_tensorflow  # pylint: disable=unused-import
File "C:\Users\royba\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python_init_.py", line 49, in
from tensorflow.python import pywrap_tensorflow
File "C:\Users\royba\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 30, in
self_check.preload_check()
File "C:\Users\royba\AppData\Local\conda\conda\envs\tensorflow\lib\site-packages\tensorflow\python\platform\self_check.py", line 82, in preload_check
% (build_info.cudart_dll_name, build_info.cuda_version_number))
ImportError: Could not find 'cudart64_90.dll'. TensorFlow requires that this DLL be installed in a directory that is named in your %PATH% environment variable. Download and install CUDA 9.0 from this URL: https://developer.nvidia.com/cuda-toolkit
shouldn't it recall cudart64_92.dll rather than cudart64_90.dll?

@fo40225 I get the same issue as @VRscience  above!

...well I take that back. after exiting the command line and opening a new command window and re-activating the conda environment I did the installation in, going into python not longer showed the error above.
running python without pre-activating the conda environment did complain.

@purpledawn777 Are you using CUDA 9.2 toolkit? No other CUDA toolkit is installed in your machine?
I am still struggling with it but I do not really see how to solve the issue but downgrade to CUDA 9.0...

I am using toolkit 9.2
I installed in an anaconda environment and I first created a tensorflow conda environment, as instructed.
when testing it complained about not finding cuda 9.0.
I then installed the wheel nicely provided by fo40225
when I tested immediately it still had the error, but then when I reopened the command line, activate tensorflow and tested again, it worked.... sorta -- it now complained about missing cuDNN7, but I just had to install that from Nvidia's website into the cuda 9.2 directories and it works fully now.

@purpledawn777 I did exactly the same but i keep on having the same issue. Also, it seems there is no more need of installing the wheel provided by @fo40225 as on (tensorflow)C:> pip install --ignore-installed --upgrade tensorflow-gpu the wheel installed is already tensorflow_gpu-1.8.0-cp36-cp36m-win_amd64.whl .
Any idea?

@mirekphd
Sorry for the slow response. Every PR for TensorFlow is unit tested across every platform we support and then internally run against an even large set of tests.  Adding another version of CUDA expands the matrix and we are currently using hundreds of GPUs just for the unit testing much less performance testing.  CUDA 9.1 ended up being a slight perf regression depending on how you look at the results and what is compared.  I like all the builds people do to try out new things.
NVIDIA's official DGX-1 also was not upgraded and still, as of today, only supports CUDA 9.0 with the official image.
@fo40225 You likely figured this out but you can just use the CUDA 9.0 cuDNN with CUDA 9.1.  That is what NVIDIA suggested when I saw that a few days back.  I would not bother with CUDA 9.1.
@ViktorM  1.9 will be CUDA 9.0.  CUDA 9.1 seems to have a perf regression (check out my updated original post above) or I might have pushed for the upgrade after the driver for CUDA 9.2 was newer than I expected.  I am still working on NCCL 2.x as that provides a nice boost, but there are some license issues to work out.
Note:  I think it is cool other people post how to compile.  The community likely does a better job than I would as I take short cuts and have some weird preferences as to how I like to install things.  I also only do linux and old python (@patrikhuber :-))  What I can do in the future is post how I compiled along with the sha-hash or branch where I did so.  Far from perfect and if other people are ahead of me that is great.  I have a small insight.  TensorFlow is part of the Brain team at Google.  While some might upgrade to the latest versions of cuDNN and such, it is not something I hear people talking about.  I am still hopeful that CUDA 10 will bring a new approach to drivers that makes it easier for us to roll out minor CUDA bumps with less pain.
As a random note.  I strongly suggest using Docker.  I use to deal with all of these different versions of CUDA in python virtual environments.  I feel kind of silly having not moved to docker sooner.  So much better.

If someone wants to install CUDA 9.2 to Ubuntu 18.04, use this.
sudo apt-key adv --fetch-keys http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1710/x86_64/7fa2af80.pub
echo "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1710/x86_64 /" | sudo tee /etc/apt/sources.list.d/cuda.list
sudo apt update
sudo apt -o Dpkg::Options::="--force-overwrite" install cuda-9-2 cuda-drivers
sudo reboot

I still think all of you are nuts not to just use docker and just keep your local device driver updated.  :-)  That is how I do the performance test if you were curious.  Total docker convert here and I fought it to the end.

@yukoba  Have you try these command on ubuntu18.04， I try the first command
sudo apt-key adv --fetch-keys http://developer.download.nvidia.com/compute/cuda/repos/ubuntu1710/x86_64/7fa2af80.pub

I got:
gpg: no valid OpenPGP data found.
gpg: Total number processed: 0

and when i use the command sudo apt update:
W: GPG error: https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1710/x86_64  Release: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY F60F4B3D7FA2AF80
E: The repository 'https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1710/x86_64  Release' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

I build the cuda9.2 for TensorFlow1.8.0 on python3.6 use the ubuntu18.04
https://github.com/mtianyan/tensorflow-linux-wheel

I migrated to TensorFlow r1.8 with cuda 9.2.88+patch 1, cuDNN 7.1.4  from r1.3 20 days ago. Maybe some issues I experienced and found the way out would help you.
https://github.com/tensorflow/tensorflow/issues/19371

@alanhsieh2000
Hi, I also have cuda 9.2.88 with patch1, cuDNN 7.1.4, and tensorflow-gpu 1.8 in conda virtue environment with python 3.6. But I got following problem. Do you have any ideas?
ImportError: libcublas.so.9.0: cannot open shared object file: No such file or directory
Thanks!

@XiaoqiChai
Did you build tensorflow r1.8 from source? It looks like your python is trying to load cuda 9.0 rather than cuda 9.2. This information is specified when you configure Bazel before you started to build. You have to give it 9.2 rather than 9, when the config tool asks you for the cuda version.

I have recently created a Dockerfile that make it easy for anyone to compile tensorflow in Linux: https://github.com/hadim/docker-tensorflow-builder

Install Cuda 9.2.88_windows 10, and cuDNN 7.1 for cuda 9.2. dll is copied to "C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v9.2\bin".
installed tensorflow gpu python 3.6
But getting error while importing tensorflow
(tf15) C:\Users\91966>python
Python 3.6.5 |Anaconda, Inc.| (default, Mar 29 2018, 13:32:41) [MSC v.1900 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.

import tensorflow
Traceback (most recent call last):
File "C:\Users\91966\Anaconda3\envs\tf15\lib\site-packages\tensorflow\python\platform\self_check.py", line 75, in preload_check
ctypes.WinDLL(build_info.cudart_dll_name)
File "C:\Users\91966\Anaconda3\envs\tf15\lib\ctypes_init_.py", line 348, in init
self._handle = _dlopen(self._name, mode)
OSError: [WinError 126] The specified module could not be found

During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "", line 1, in
File "C:\Users\91966\Anaconda3\envs\tf15\lib\site-packages\tensorflow_init_.py", line 24, in
from tensorflow.python import pywrap_tensorflow  # pylint: disable=unused-import
File "C:\Users\91966\Anaconda3\envs\tf15\lib\site-packages\tensorflow\python_init_.py", line 49, in
from tensorflow.python import pywrap_tensorflow
File "C:\Users\91966\Anaconda3\envs\tf15\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 30, in
self_check.preload_check()
File "C:\Users\91966\Anaconda3\envs\tf15\lib\site-packages\tensorflow\python\platform\self_check.py", line 82, in preload_check
% (build_info.cudart_dll_name, build_info.cuda_version_number))
ImportError: Could not find 'cudart64_90.dll'. TensorFlow requires that this DLL be installed in a directory that is named in your %PATH% environment variable. Download and install CUDA 9.0 from this URL: https://developer.nvidia.com/cuda-toolkit

I tried to downgrade to 9.0, but failed to so.
Is there a solution for issue#1 and if not how do I downgrade to 9.0?

@VRscience Have you found a solution to your issue yet? I am getting the exact same issue (and it looks like @Sri06006 has run into this issue as well). It does look like the wheel being installed when running pip install --upgrade tensorflow-gpu is the one that purports to be for cuda 9.2 (the one @fo40225 posted) and yet when you look into the build_info after installation, it definitely says the build version is for cuda 9.0. So I am confused. I've tried uninstalling and reinstalling, clearing my cache and then reinstalling, and nothing seems to work. The only thing I can think to do right now is to install cuda 9.0 alongside cuda 9.2 (they can coexist afaik) and see if that helps, but it seems like I will be missing out on any potential performance boosts with cuda 9.2.

@Sri06006 I was also able to get things working by installing CUDA 9.0. I installed it along side CUDA 9.2 since I was told they can coexist. Things are working, but I still think it's odd that the whl file's description would say it has CUDA 9.2 support if it only explicitly looks for CUDA 9.0.

I have successfully built and run tensorflow1.8 and 1.9rc1 against cuda9.2 and cudnn 7.1, with python3.5 on Ubuntu 16.04. I put cuda9.2 stuffs in a separate test folder and source this script when building and whenever I run these version of tf (tf1.9 compiled with openmpi. but need to change
line 76 of tensorflow/tensorflow/contrib/mpi_collectives/kernels/mpi_ops.cc  from se to stream_executor or build would fail)
$PYTHONUSERBASE is set to the test folder so pip3 install --user would install the test tf whl inside the test folder without messing up the system's version. To invoke it would need to prepend $PYTHONPATH accordingly
export PREFIX=/home/beew/opt/cuda_test/cuda92
export PATH=$PREFIX/cuda/bin:$PREFIX/bin:$PATH
export CUDA_SDK_ROOT_DIR=$PREFIX/samples/common
export TENSORRT_PATH=$PREFIX/TensorRT-<IP_ADDRESS>

export LD_LIBRARY_PATH=$PREFIX/cuda/lib64:$PREFIX/cuda/extras/CUPTI/lib64:$LD_LIBRRAY_PATH:$TENSORRT_PATH/lib

export PYTHONUSERBASE=$PREFIX

export PYTHONPATH=$PREFIX/lib/python3.5/site-packages:$PYTHONPATH

export MPI_HOME=/usr/lib/openmpi

export CPATH=$PREFIX/include:$CPATH
export LIBRARY_PATH=$PREFIX/lib:$LIBRARY_PATH
export LD_LIBRARY_PATH=$PREFIX/lib:$LD_LIBRARY_PATH

alias nvblas92="LD_PRELOAD=$PREFIX/cuda/lib64/libnvblas.so"

Nagging Assignee @tfboyd: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

this issue can be closed, it's working with cuda 9.2 and cudnn 7.1 already

@sliedes  The part you may be missing is licensing and the legal ability to distribute something like CUDA, cuDNN (officially it is behind a login), or the other associated libraries.
As a side thing, I updated the install guide to include installing everything from NVIDIA with apt-get.  I have done this myself on a clean system and it seems to be smooth.  I would still do it from docker as it is easy to get the packages mixed up and get the versions misaligned.
On a positive side CUDA 10 will not require device driver updates and amusingly enough is going to be more backwards compatible than CUDA 9.2.  I and I am sure others have been working with NVIDIA to simplify everything.

Hopefully, this wheel file below helps.
TensorFlow 1.9.0 build with cuda 9.2, cudnn 7.1.4 and python 3.5 on ubuntu 16.04:
https://github.com/fangyihao/tensorflow-wheels/blob/master/tensorflow-1.9.0-cp35-cp35m-linux_x86_64.whl

hi is there a Windows build that works with Cuda 9.2?
9.0 is 10 months out of date and tensorflow is unusable.

Does someone have a way to build tensorflow-gpu for centOS and cuda 9.2. My cluster admin has updated driver and removed cuda 9.0 i can not fin anything for cuda 9.2 and CENTOS Linux. If anyone can make one or have a clue please let me know. Thank you  :(

I have been able to build tensorflow-gpu on Cuda 9.2 and Cuda 10 on Ubuntu 16.04, basically just configure, choose your options and install whatever missing. Shouldn't be a problem on  Centos if you have up to date bazel and Nvidia driver

I have started a thread on CUDA 10.
https://github.com/tensorflow/tensorflow/issues/22706

Hopefully, this wheel file below helps.
TensorFlow 1.9.0 build with cuda 9.2, cudnn 7.1.4 and python 3.5 on ubuntu 16.04:
https://github.com/fangyihao/tensorflow-wheels/blob/master/tensorflow-1.9.0-cp35-cp35m-linux_x86_64.whl
@fangyihao how have you built this one? Any chance you can share the dockerfile (if any)?


Chartero

Hello everyone
I would be thankful if you helped me to use this plugin. I installed it but it does not work and noting shows in it . I categorized my article

Could you provide a screenshot?

Hi
I would be thankful to check it. The dashboard section is empty
On Fri, Nov 1, 2024 at 9:02 PM volatile-static @.***>
wrote:

Could you provide a screenshot?
—
Reply to this email directly, view it on GitHub
https://github.com/volatile-static/Chartero/issues/131#issuecomment-2452775879,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BANPWVSGWCLTZRYV5XRWQQDZ6QQCLAVCNFSM6AAAAABRBFYTASVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDINJSG43TKOBXHE
.
You are receiving this because you authored the thread.Message ID:
@.***>

I cannot see your empty dashboard.
If you are attaching an image, don't reply via email.


[BUG] Getting odata.error "InvalidInput" when using Azurite and oData syntax with 'and' filter expression

Library name and version
Azure.Data.Tables
Describe the bug
I use Azurite for local development.
I run this query. The two variables userName and userPW came from a query string (e.g. http://<IP_ADDRESS>:7015/api/Command?Login&userName=Peter&userPW=abc). I'm using Azure functions.
The following code runs via "await Task.Run(() => [class-instance].[methodname]")
The weird is, when I hardcode the String "User eq 'Peter' and Password eq 'abc" it works fine and I got 1 result. But if I insert the variables, I'm getting the odata.error.
                Pageable<TableEntity> oDataQueryEntities =                     tableClient.Query<TableEntity>                     (filter: TableClient.CreateQueryFilter($"User eq '{userName}' and Password eq '{userPW}'"));
If I omit the second parameter, I'm also getting a result:
                    (filter: TableClient.CreateQueryFilter($"User eq '{userName}'"));
The table is there if I check it with the Storage Explorer.
Expected behavior
See above
Actual behavior
See above
Reproduction Steps
See above
Environment
Win10
Visual Studio Community 2022 17.6.2
Azure.Data.Tables 12.8.0
Azurite 3.22.0

Thank you for your feedback.  Tagging and routing to the team member best able to assist.

Thank you for your feedback. Tagging and routing to the team member best able to assist.

Am I right this being a bug? At the moment I didn't find a real good (simple) alternatives for my project. Have I to convert my both strings in some way?

Sorry, I closed the issue (because I have no other options after writing a comment). The issue is still there.

Please reopen the issue. Thanks!

CreateQueryFilter already does the odata escaping for you, so it would work if you removed the single quotes:
Thanks very much! For some strange reason (maybe the browser was the problem?) I tried it with and without escaping characters but in both cases I got multiple failed results back. I omit the escaping characters and it works now.


Ported Macaroons.Net to run on .NET Core

Hi Jorn, I have ported Macaroons.Net version for .NET Core as .NET Standard 2.0 library.
https://github.com/cyberdot/Macaroons.NETCore
Hope it's going to be useful for someone requiring Macaroons implementation for .NET Core (as I needed that as well)

That is neat :-) Are still using the same version of the crypto library? As I remember it, it is loaded from a C++ DLL ... how does that play with .NET Core?

Did you actually change any code - or was it just a matter of making a new csproj file for .NET Standard 2.0?

That is neat :-) Are still using the same version of the crypto library?
I had to use .NET Core specific packages: CuttingEdge.Conditions.NetStandard and Sodium.Core

Did you actually change any code - or was it just a matter of making a new csproj file for .NET Standard 2.0?

I had to change the code in a couple of places:
HexDataEncoding.cs - uses BitConverter instead of SoapHexBinary
SecretBoxCryptoAlgorithm.cs - Encrypt method, Sodium.SecretBox.Create no longer returns padded cipher text, had to update that as well
Utility.cs - uses memcmp method from msvcrt.dll, which is not portable, had to replace it with ReadOnlySpan implementation instead.
There is NuGet package available as well: https://www.nuget.org/packages/Macaroons.NETCore/

Nice work. I'm still somewhat new to .NET Core - but is it correct to assume that your .NET Core package should simply replace my .NET Standard solution? Your implementation should be plug-and-play replaceable for .NET Standard, right?
If so, then I won't make a NuGet package out of my version.

I see you still state me as the author on the NuGet package - not sure if that is right anymore.
Question ... should I pull your changes and release Macaroons.Net as a NuGet package from my repo, with your and my name on it - or would you rather just continue with your fork?

I'd be happy for you to incorporate my changes into your repo and have a single Macaroons.Net package supporting both .NET framework and .NET Core. Then I can remove my NuGet package from nuget.org

Cool. I'll see what I can do.

Turns out I don't know how to do it 🙄 According to Github there is no difference between your repo and my repo - so I cannot create a pull request (but, well, I haven't tried that before).
Can you make a pull request for me to pull into my repo?

Cool, no problem, I'll create a pull request

I am wondering if you have pushed your changes to Github? You have two visible commits - and neither of them includes any changes, only additions of files to the depot. If you haven't pushed the changes, it could explain why Git tells me that there are no changes to integrate from your repo.

I've just created a PR: https://github.com/JornWildt/Macaroons.Net/pull/9.

NuGet package meta information is residing in the project file now, this might affect the way you generate NuGet package.
The original code for .NET framework is unchanged. The conditional changes are only to ensure it runs on .NET core
I have used test project and console apps as a guidance to ensure correctness of the code changes

I have included your PR and released Macaroons.Net 2.0.0. See https://www.nuget.org/packages/Macaroons.Net/2.0.0


Handle a few forgotten cases of already resigned leaders.

In a failover or cleanout or resign leadership situation it is possible that in Current we have an already resigned leader. This needs to be taken into account when deciding which server to failover to or to move to. This fixes bad behaviour in corner cases.

http://jenkins01.arangodb.biz:8080/view/PR/job/arangodb-matrix-pr/11500/

Tests blue.


Make django-allauth-ui work in regular only config

https://github.com/danihodovic/django-allauth-ui/blob/697a7d09f13a511557e2b55ee18b6bb34886c250/allauth_ui/templates/account/login.html#L4 leads to a TemplateSyntaxError at /accounts/login/ during template rendering if django-allauth is configured without support for social accounts (regular account only).

Argh...wanna give it a try and open a pull-request mr fkromer?

I'll fix this once I make a sweeping change to the design of the UI.

Released as 0.3.1 https://pypi.org/project/django-allauth-ui/0.3.1/


Fix activation to create delegate and principal class

The new way of creating the app does so without calling main for activation, so we were not able to retrieve the name of the delegate or principal class.  This change allows both activation methods to work properly.

@mnithish is added to the review. #Closed

@jared is added to the review. #Closed

@jaredhms is added to the review. #Closed

:clock1:

///

We also need to do this for OnResume, VisibilityChanged and AppMemoryUsageIncreased

Refers to: msvc/vsimporter-templates/WinStore10-App/App.xaml.cpp:53 in 258d39a. [](commit_id = 258d39ae0c9c0b0d862e2d7143302892a0b2cd45, deletion_comment = False)

:clock1:

:shipit:

Build Suceeded


Permissions Api

I've added the 44 endpoints for the permissions Api (2.0), using the same class/interface organization used elsewhere in the project. I've tested most of the endpoints using an actual databricks cluster. I wasn't able to test every endpoint since we haven't used some features in databricks and I simply don't know how to set up an example to test against.
Those endpoints are:
Delta live pipelines, ML flow experiments and registered models, and sql warehouse endpoints.
Since the responses and handling code are identical across all the other endpoints I've tried I'm fairly confident they will work as expected, and I have included sample code to try it out (simply provide an Id for the resource)

Thanks for the quick look! Suggestions committed

/azp run


Map only showing partial

Make sure you are running the latest version of Home Assistant before reporting an issue.
You should only file an issue if you found a bug. Feature and enhancement requests should go in the Feature Requests section of our community forum:
**Home Assistant release (hass --version): 0.41.0
**Python release (python3 --version):3.5.2
**Component/platform:Map
**Description of problem:The map, since upgrading to 0.41.0, has started to only show certain "tiles" of the map. I am including a screen shot of what I see.
**Expected:Abiility to see the entire map.
**Problem-relevant configuration.yaml entries and steps to reproduce: View the map page and see what I am showing in the screenshot.

I have the same issue but only with Firefox.

Same here with HA 0.42 and Firefox 52.0.2 (64-Bit) and Microsoft Edge 38.14393.0.0 on Windows 10 Home 64-Bit.
From what I see in Firefox's developer console, alot/all tiles are loaded from https://cartodb-basemaps-b.global.ssl.fastly.net/, but the positioning is wrong. They are re-arranged using CSS' translated3D and the x-offset is computed wrong by multiple of a tile's width (256px).

Same here with HA 0.41, Firefox 52.0.1. On chromium 57.0, I don't have the issue.

@nordicblue Did you clear browser cache/cookies? That's what fixed this for me.

@brianjking Doesn't fix it for me.

Douh!! I feel like an idiot, as that fixed the issue for me. @brianjking, thanks for reminding me what I tell our customers all the time;)

For Firefox 52 clean cache/cookies doeasn't help.

Please re-open as clearing cache/cookies for FF and Edge does not resolve this.

In addition, it's also broken in iOS using Safari (iOS 10.3 on iPhone 5S)

Confirmed Edge is broken, even after cache cleared.

Confirm Edge and FF; @m0wlheld nailed the problem too.  Could it be that vendor specific prefixes are missing from the map styling?

same here

Yup, same here. Using latest macOS and Safari. New user, so this is my first install.

Although not mentioned in the release notes, the issue seems to be solved with v0.42 of home-assistant.

I can confirm that it's fixed in 0.42.

This issue is fixed.

I am now having this issue with Firefox on 0.49.0

Confirmed.  Latest version of FF, cleared cache and restarted.  Same thing.

I am having this issue in the 1.0.4 version of the iOS app (0.49.0 version of HASS).

I am also having this issue with safari

+1, Safari and iOS app

+1, iOS app and Safari

Upgraded to HASS 0.49.1, issue is still present.

upgraded to Home Assistant 0.50 using AIO with Firefox 54.0.1 and Microsoft Edge Issue is still present.

Same problem with HA 0.50.0 on Hassio in the iOS App.

problem persists in version 0.50.1 on a mac with safari as well as in the iOS app

same here

same here .

0.50.2 shows no improvement

problem persists in version 0.50.1 on a mac with safari as well as in the iOS app

Also got the problem in the iOS

Same problem with Windows/Firefox on HA 50.2  As others have said, works on Chrome.

Same problem on iOS with safari and the Apps.
Using 0.50.2

@balloob Can you refer us to the right person here? This one is lingering with each release. Appreciate you pointing us in the right direction. 😄

Should be fixed in the next release.

Fixed in 0.51.0

Can Confirm

I still see this now and then though, when i have it i can switch between tabs and that helps sometimes. Cannot really pinpoint the source or reproduce it correctly so far.

Nobody else reported here since 13 Aug, and since then I never experienced again the issue... maybe it can be related to your installation and not a bug in the code.
Try to post in the forum, maybe someone more experinced than me can help you to sort it out.


Disqus support

Requirements

Add disqus
Add shortname to blog setup and blog settings
Check condition if it is disqus being used, if not, hide the js snippets (_Layout, _Comments, _PostInfo)
Tweak css to make it fit on the post page
Make sure when post comment is disabled, disable the comment (this seems not doable)
Comment count

Questions
Should I use UniqueId instead of Id on data-disqus-identifier and page.identifier?
I have decided not to use guid, but instead have a Fan.Enums.ECommentTargetType, a discussion system will eventually be storing these comments, as such it needs to know a comment is for which target.
Currently page.identifier is "BlogPost_{id}"
Key Config Parameters
https://help.disqus.com/customer/portal/articles/472098-javascript-configuration-variables
shortname
this.page.identifier
this.page.title
this.page.url
this.page.category_id
shortname https://help.disqus.com/customer/portal/articles/466208-what-s-a-shortname-
Disqus identifier  https://help.disqus.com/customer/portal/articles/472099-what-is-a-disqus-identifier-
References
https://help.disqus.com/customer/portal/articles/472099-what-is-a-disqus-identifier-
https://help.disqus.com/customer/portal/articles/472098-javascript-configuration-variables
https://code.tutsplus.com/tutorials/integrating-disqus-into-wordpress--wp-25799
https://disqus.com/admin/ click on your site and scroll down choose universal code
https://fanray.disqus.com/admin/settings/universalcode/
https://blog.disqus.com/little-known-disqus-features?utm_source=motd_admin&utm_medium=web
https://help.disqus.com/customer/portal/articles/565624-adding-comment-count-links-to-your-home-page
https://ray247.wordpress.com/2009/09/02/how-to-develop-with-disqus-on-localhost/
https://stackoverflow.com/questions/9475821/disqus-comments-fails-to-load-on-localhost

A permalink is added for disqus purpose, so when author updates post slug after some comments already went into disqus for that post, the post link in disqus would not break.  Permalink for blog post is "/post/{id}", and it redirects to "/post/{year}/{month}/{day}/{slug}"


Done with basic setup to integrate map to our website

Adds the map to the website
Fixes #10
Please, go through these steps before you submit a PR.

[x] My Pod Leader knows I'm working on this Pull Request
[x] I've explained what the Pull Request is adding.
[x] I've explained why this is important.

I nearly forgot!
Please also reset the Gemfile.lock file. Since this PR doesn't add any new dependencies or revolve around fixing the build issues, we shouldn't be pushing it. We should open a separate PR for that.

@NoahCardoza reset means deleting the file ? That is what my partner and I could infer out of it.

Close! I'm not all that familiar with Ruby (compared to other languages) but generally .lock files are OS agnostic. What is going on here is that the dependencies were out of date, so most fellows needed to update them. That being said, to handle it properly a new issue should be made that addresses that issue. We shouldn't be updating dependencies when we add a new feature. Especially in this case, since some fellows might not push the update file (and vice versa) it could cause some nasty merge conflicts on that file.

It might also be cool to show the fellow's profile picture in the card that shows up when clicking the map marker.

Umm yess! I was thinking of customizing the marker itself with the profile pictures. What sounds better !?

Ohoo! I like your idea better!
Can't wait to see how it turns out!

Umm @NoahCardoza, I am not able to figure out the way to fetch the data from yaml file into js file. I tried to go through the pod portfolios but most of them have done it by explicit definition of the data in the map.js file.

Hey @Sargam-Agarwal, you can use something like this:
<div>
    {% for item in site.data.fellows %}
    <script>
        if("{{ item.name }}"==fellowName){
            name = "{{ item.name }}";
            img = "{{ item.img }}";
            loc = "{{ item.location }}";
            description = "{{ item.description }}";
            fav_programming_language = "{{ item.fav_programming_language }}";
            interests_outside_tech = "{{ item.interests_outside_tech }}";
            university =  "{{ item.university }}";
            linkedin = "{{ item.linkedin }}";
            twitter = "{{ item.twitter }}";
            github = "{{ item.github }}";
        }
    </script>
    {% endfor %}
</div>

We implemented this method in fellow.html to display a separate page for every fellow.

Hey @Pratyush1606
Thank you for this. I tried this out but this seems to work only for html files not in js files :(
Its giving errors with the syntax when used in js.

Hey @Pratyush1606 Thank you for this. I tried this out but this seems to work only for html files not in js files :( Its giving errors with the syntax when used in js.

You could try to put:
<script>
  const DATA = {{ site.data | jsonify }};
</script>

In side /index.html and then in your map.js access the DATA object which will include all the fellow data.

@NoahCardoza
I have made the required changes and the map seems to work just as expected. Kindly see to it now. Hope now its ready to be merged 🥲

One last thing, do you know if there is a way to fix the aspect ratio on these images? I'm not very familiar with Open Street Map but it would be nice if we could clean that up a little.
If not, no problem. I can merge it as is.
Here is an example of what I'm talking about:

Sure @NoahCardoza.
I'll see to it 👍🏻

@NoahCardoza
There doesn't seem to be any provision to improve the icon quality by Leaflet API.
https://leafletjs.com/reference.html#icon - these are all the options available to us for customizing our marker. I tried to play around with the width and height values for the icon and also the border radius values but that only changes the shape of the icon, not the quality of the image.

The only thing I can think of is cropping all the images to the same aspect ratio... but that's something for another issue/PR I think.


runtime error: invalid memory address or nil pointer dereference

Which version of Elastic are you using?
[ ] elastic.v2 (for Elasticsearch 1.x)
[ ] elastic.v3 (for Elasticsearch 2.x)
[x] elastic.v5 (for Elasticsearch 5.x)
Please describe the expected behavior
Putting a document without errors. The index exists.
Please describe the actual behavior
It returns this error:
panic.go:34: runtime error: invalid memory address or nil pointer dereference
/home/danilo/Go/src/gopkg.in/olivere/elastic.v5/client.go:1181 +0x86
gopkg.in/olivere/elastic%!e(MISSING)v5.(*IndexService).Do(0xc42060ab28, 0xe06d40, 0xc420016400, 0x1d, 0x0, 0x0)
	/home/danilo/Go/src/gopkg.in/olivere/elastic.v5/index.go:267 +0x13b

Any steps to reproduce the behavior?
type Food struct {
	ID       uint   `gorm:"primary_key" json:"id"`
	Name     string `json:"name"`
	Icon     string `json:"icon"`
	Category string `json:"category"`
}

food := models.Food{
  Name:      "Foo",
  Icon:         "Bar",
  Category: "Dog",
}
app.Db.Create(&food) // GORM

put, err := app.Elastic.Index().
  Index("foods").
  Type("food").
  Id(app.Utoa(food.ID)). // app.Utoa transforms uint to string
  BodyJson(food).
  Do(context.Background())
if err != nil {
  panic(err)
}
fmt.Printf("Indexed food %s to index %s, type %s\n", put.Id, put.Index, put.Type)

The "ID" is populated by GORM, so I insert item to DB, it set the "ID" field of the struct and then I index it with elastic, which is correctly connected (Elasticsearch returned with code 200 and version 5.0.0)
app.Elastic is this:
Elastic, err := elastic.NewClient()
	if err != nil {
		panic("Can't connect to ElasticSearch")
	}

When you see runtime error: invalid memory address or nil pointer dereference, there is a nil pointer involved. Make sure that none of your parameters are nil.
From the code snippets you send, I cannot see which variable is nil. It could be app.Db, or app.Elastic, or food.ID, or food. I don't know. If you want me to debug your code, please send a complete and executable main.

Oh, damn, app.Elastic was <nil>, I'm sorry! It confused me the fact that it was reporting as error the line Do(ctx).


Animation support

Hello!
I just installed the hydra pluging for Blender, my goal is to animate in Maya but render in Blender.
The problem is that I can't get the Animation of the .usd file working on hydra.
Is animation not supported?

Hello, animation of .usd is not yet supported, it'll be done in nearest future.

We've already made initial support of animated USD files in #168

There is an initial support only for viewport render.

Should be fixed in https://github.com/GPUOpen-LibrariesAndSDKs/BlenderUSDHydraAddon/pull/233


DP- Longest Increasing Subsequence

In this problem, we have to find the length of the longest subsequence of a given sequence such that all elements of the subsequence are sorted in increasing order.
Example:-    Sequence- {8,100,150,10,12,14,110}
Length of longest subsequence- 5        // (8,10,12,14,110)

don't forget to add problem statement in the code file